-- Logs begin at Mon 2022-07-18 13:36:38 UTC, end at Mon 2022-07-18 14:37:47 UTC. -- Jul 18 14:02:57.584901 dv-cinder-797608-58-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 18 14:02:57.594323 dv-cinder-797608-58-smb devstack@keystone.service[80425]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 18 14:02:57.596442 dv-cinder-797608-58-smb devstack@keystone.service[80425]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 14:02:57 2022] *** Jul 18 14:02:57.596442 dv-cinder-797608-58-smb devstack@keystone.service[80425]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 14:02:57.596442 dv-cinder-797608-58-smb devstack@keystone.service[80425]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 14:02:57.596442 dv-cinder-797608-58-smb devstack@keystone.service[80425]: nodename: dv-cinder-797608-58-smb Jul 18 14:02:57.596442 dv-cinder-797608-58-smb devstack@keystone.service[80425]: machine: x86_64 Jul 18 14:02:57.596442 dv-cinder-797608-58-smb devstack@keystone.service[80425]: clock source: unix Jul 18 14:02:57.596442 dv-cinder-797608-58-smb devstack@keystone.service[80425]: pcre jit disabled Jul 18 14:02:57.596442 dv-cinder-797608-58-smb devstack@keystone.service[80425]: detected number of CPU cores: 4 Jul 18 14:02:57.596442 dv-cinder-797608-58-smb devstack@keystone.service[80425]: current working directory: / Jul 18 14:02:57.596442 dv-cinder-797608-58-smb devstack@keystone.service[80425]: detected binary path: /usr/bin/uwsgi-core Jul 18 14:02:57.596442 dv-cinder-797608-58-smb devstack@keystone.service[80425]: your processes number limit is 47680 Jul 18 14:02:57.596442 dv-cinder-797608-58-smb devstack@keystone.service[80425]: your memory page size is 4096 bytes Jul 18 14:02:57.596442 dv-cinder-797608-58-smb devstack@keystone.service[80425]: detected max file descriptor number: 2048 Jul 18 14:02:57.596442 dv-cinder-797608-58-smb devstack@keystone.service[80425]: lock engine: pthread robust mutexes Jul 18 14:02:57.597288 dv-cinder-797608-58-smb devstack@keystone.service[80425]: thunder lock: enabled Jul 18 14:02:57.597288 dv-cinder-797608-58-smb devstack@keystone.service[80425]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 18 14:02:57.597288 dv-cinder-797608-58-smb devstack@keystone.service[80425]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 14:02:57.636982 dv-cinder-797608-58-smb devstack@keystone.service[80425]: Python main interpreter initialized at 0x55b9241af9c0 Jul 18 14:02:57.636982 dv-cinder-797608-58-smb devstack@keystone.service[80425]: python threads support enabled Jul 18 14:02:57.636982 dv-cinder-797608-58-smb devstack@keystone.service[80425]: your server socket listen backlog is limited to 100 connections Jul 18 14:02:57.636982 dv-cinder-797608-58-smb devstack@keystone.service[80425]: your mercy for graceful operations on workers is 90 seconds Jul 18 14:02:57.637323 dv-cinder-797608-58-smb devstack@keystone.service[80425]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 14:02:57.637395 dv-cinder-797608-58-smb devstack@keystone.service[80425]: *** Operational MODE: preforking *** Jul 18 14:02:57.637670 dv-cinder-797608-58-smb devstack@keystone.service[80425]: *** uWSGI is running in multiple interpreter mode *** Jul 18 14:02:57.637670 dv-cinder-797608-58-smb devstack@keystone.service[80425]: spawned uWSGI master process (pid: 80425) Jul 18 14:02:57.637875 dv-cinder-797608-58-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 18 14:02:57.640896 dv-cinder-797608-58-smb devstack@keystone.service[80425]: spawned uWSGI worker 1 (pid: 80435, cores: 1) Jul 18 14:02:57.640896 dv-cinder-797608-58-smb devstack@keystone.service[80425]: spawned uWSGI worker 2 (pid: 80436, cores: 1) Jul 18 14:02:57.640896 dv-cinder-797608-58-smb devstack@keystone.service[80425]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 14:03:02.964855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 14:03:02.964855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: from cryptography.utils import int_from_bytes Jul 18 14:03:02.965692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 14:03:02.965692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: from cryptography.utils import int_from_bytes Jul 18 14:03:02.974856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 14:03:02.974856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: from cryptography.utils import int_from_bytes Jul 18 14:03:02.975583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 14:03:02.975583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: from cryptography.utils import int_from_bytes Jul 18 14:03:03.021193 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 14:03:03.021410 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 14:03:03.021572 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] command line args: [] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 14:03:03.021845 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 14:03:03.022146 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ================================================================================ {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 14:03:03.022416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] admin_token = **** {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.022559 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 14:03:03.022651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] config_dir = [] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.022730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 14:03:03.022836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.022931 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] command line args: [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 14:03:03.023008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] config_source = [] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.023149 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 14:03:03.023287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] debug = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.023370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ================================================================================ {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 14:03:03.023432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.023687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] admin_token = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.023759 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.023824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] config_dir = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.023938 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.024017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.024113 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] config_source = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.024192 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.024289 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] debug = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.024401 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.024479 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.024627 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] list_limit = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.024718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.024784 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] log_config_append = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.024899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.024980 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.025148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.025263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] log_dir = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.025346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] log_file = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.025413 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.025575 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.025670 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.025731 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] log_config_append = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.025859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.025982 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.026095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] log_dir = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.026197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.026314 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] log_file = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.026414 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.026494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.026581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.026706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.026782 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.026983 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.027114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.027264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.027348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.027479 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.027562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.027685 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.027761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.027888 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.027964 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.028084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.028196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.028289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.028411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.028495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.028636 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.028722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.028891 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.029014 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.029093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.029376 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.029498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.99/identity {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.029656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.029787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] publish_errors = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.029933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.030153 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.99/identity {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.030275 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.030372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] publish_errors = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.030498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.030573 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.030699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.030775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.030891 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.030985 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.031147 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] standard_threads = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.031230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.031380 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.031463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.031640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] standard_threads = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.031729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.031808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.031880 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.032025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] use_journal = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.032109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.032193 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] use_json = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.032265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.032382 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] use_stderr = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.032457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] use_journal = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.032535 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] use_syslog = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.032606 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] use_json = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.032750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] use_stderr = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.032838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.032910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] use_syslog = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.033065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.033153 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:03:03.033380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.033468 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.033614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.033695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.033872 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.033954 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.034111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.034200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.034509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.034612 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.034692 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.034764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.034885 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.034979 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.035117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.035199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.035359 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.035487 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.035598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.035740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.035822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.036011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.036099 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.036260 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.036341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.036526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.036610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.036769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.036850 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.036999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.037077 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.037230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.037303 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.037473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.037567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.037724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.037812 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.037967 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.038052 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.038201 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.038278 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.038475 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.038556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.038736 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.038815 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.038987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.039092 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.039233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.039345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.039464 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.039613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.039697 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.039851 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.039934 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.040119 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.040197 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.040357 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.040434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.040605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.040681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.040835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.040912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.041065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.041142 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.041309 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.041385 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.041553 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.041632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.041786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.041869 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.042043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.042274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.042434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.042564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.042710 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.042818 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.042962 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.043040 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.043188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.043264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.043406 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.043483 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.043635 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.043712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.043869 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.043954 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.044101 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.044177 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.044330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.044412 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.044564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.044643 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.044791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.044875 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.045024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.045107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.045256 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.045344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.045488 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.045571 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.045717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.045793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.045951 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.046057 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.046183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.046294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.046419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.046561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.046676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.046774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.046869 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.046972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.047093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.047173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.047340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.047428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.047573 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.047652 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.047804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.047889 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.048033 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.048123 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.048281 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.048409 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.048514 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.048592 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.048742 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.048833 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.048975 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.049062 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.049208 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.049290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.049446 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.049533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.049683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.049762 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.049921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.050008 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.050213 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.050301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.050476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.050561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.050711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.050794 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.050944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.051035 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.051182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.051260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.051415 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.051495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.051648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.051734 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.051898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.051976 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.052231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.052343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.052513 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.052656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.052783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.052957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.053085 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.053225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.053303 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.053388 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.053617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.053697 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.053873 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.054048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.054288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.054676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.054762 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.054941 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.055203 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.055455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.055610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.055766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.055843 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.055946 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.056093 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.056198 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.056333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.056442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.056579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.056694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.056817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.056939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.057055 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.057227 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.057306 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.057501 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.057586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.057734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.057848 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.057965 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.058092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.058201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.058348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.058459 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.058635 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.058714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.058876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.058957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.059109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.external = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.059187 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.059339 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.059425 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.059627 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.059705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.059860 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.059937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.060093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.password = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.060180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.060323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.token = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.060415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] auth.external = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.060557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.060635 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.060795 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.060873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.061041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.061121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.061274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.061354 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] auth.password = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.061524 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.061603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] auth.token = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.061764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.061843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.061993 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.062072 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.062226 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.062312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.062485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.062568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.062733 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.062814 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.062981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.063058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.063213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.063292 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.063450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] credential.caching = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.063530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.063680 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.063758 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.063937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.064015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.064187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.064267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.064422 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.064501 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.064663 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.064740 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.064898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.064986 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.065164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.065243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.065421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.065500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.065684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.065768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.065941 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.066023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.066177 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.066256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.066429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.066513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.066677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.066756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.066923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.067002 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.067153 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.067234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.067399 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.067478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] federation.caching = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.067634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.067713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.067888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.067968 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.068124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.068203 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.068379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.068457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.068614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.068694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.068852 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.068930 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.069083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.069161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.069331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.069410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.069573 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.069651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.069806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.069962 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.070038 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.070110 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.070272 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.070351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity.caching = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.070526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.070619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.070768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.070847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.071015 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.071092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.071252 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.071339 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.071481 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.071560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.071710 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.071789 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.071941 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.072028 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.072182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.072274 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.072430 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.072510 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.072647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.072737 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.072881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.072961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.073112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.073190 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.073358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.073455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.073606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.073687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.073854 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.073933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.074082 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.074168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.074316 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.074415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.074638 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.074716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.074876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.074970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.075114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.075193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.075346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.075424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.075585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.075672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.075818 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.075896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.076054 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.076131 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.076302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.076412 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.076538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.076664 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.076785 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.076919 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.077032 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.077157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.077265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.077411 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.077488 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.077666 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.077745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.077901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.077981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.078153 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.078232 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.078432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.078515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.078655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.078736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.078889 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.078968 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.079120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.079198 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.079361 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.079440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.079592 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.079670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.079824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.079903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.080061 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.080140 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.080299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.080377 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.080530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.080607 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.080770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.080850 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.081002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.081081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.081255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.081346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.081519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.081694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.081768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.081949 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.082017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.082188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.082267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.082453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.082535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.082692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.082771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.082925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.083005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.083170 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.083249 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.083402 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.083479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.083637 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.083717 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.083870 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.084060 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.084139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.084314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.084401 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.084563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.084641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.084799 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.084877 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.085031 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.085118 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.085267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.085346 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.085494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.085575 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.085727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.085817 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.085960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.086037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.086198 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.086276 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.086454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.086552 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.086693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.086772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.086939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.087017 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.087185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.087271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.087414 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.087492 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.087660 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.087745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.087887 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.087973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.088121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.088199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.088353 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.088429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.088585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.088671 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.088821 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.088900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.089067 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.089147 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.089303 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.089389 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.089531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.089609 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.089767 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.089845 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.090004 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.090090 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.090238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.090315 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.090497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.090578 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.090736 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.090826 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.090981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.091058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.091224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.091301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.091455 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.091541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.091692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.091770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.091922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.091999 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] resource.caching = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.092157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.092244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.092389 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] role.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.092468 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.092634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] role.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.092712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.092865 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.093017 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.093112 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.093191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.093347 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.093424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.093590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.093676 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.093825 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.093903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.094067 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.094144 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.094301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] role.caching = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.094677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.094677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.094800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] role.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.094871 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.094942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.095025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.095099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.095263 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.095344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.095501 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.095581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.095746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.095827 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.095993 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.096072 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.096278 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.096389 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.096525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.096606 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.096775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.096866 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.097035 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.097114 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.097285 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.097366 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.097534 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.097612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.097784 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.097862 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.098031 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.098111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.098278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.098458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.098575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.098695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.098785 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.098948 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.099029 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.099200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.099287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.099447 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.099533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.099694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.099774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.099933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.100011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.100174 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.100253 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.100408 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.100486 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.100642 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.100721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.100872 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.100959 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] token.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.101104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.101181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.101337 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.101414 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.101573 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.101652 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.101825 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.101903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.102070 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.102148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.102302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.102381 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.102562 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.102640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.102794 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.102872 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.103031 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] token.caching = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.103112 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.103264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.103342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.103503 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.103581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.103735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.103816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.103983 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.104062 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.104234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.104409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.104554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.104681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.104802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.104967 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.105098 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.105226 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.105362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.connection = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.105503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.105651 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.105737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.105809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.105904 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.105983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.106141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.106227 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.106371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.106474 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.106626 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.106705 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.106860 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.106941 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.107093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.107172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.107333 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.107412 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.107565 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.107645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.connection = **** {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.107806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.107895 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.108037 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.108116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.108281 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.108368 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.108521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.108602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.108762 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.108842 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.108991 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.109077 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.109230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.109311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.109464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.109541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.109633 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 14:03:03.109711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.109930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.110171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.110436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.110678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.110912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.111156 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.111393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.111634 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.111867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:03:03.112039 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80436) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 14:03:03.140400 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.140636 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.140863 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.142248 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.142522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.142777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.149369 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.151693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.177163 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.177372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.177665 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.177900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.325744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.330443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.375715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.375996 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.377134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.377371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.440316 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.440578 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.440673 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.440832 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.440916 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.441039 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.441121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.441240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.441320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.441448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.441531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.441748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.466003 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.466235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.466496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.466620 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.466785 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.466873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.467004 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.467103 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.467228 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.467350 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.467472 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.467608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.467608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.467892 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.478358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.478809 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.491073 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.491279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.491522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.491644 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.491716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.491883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.492007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.492089 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.492167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.492324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.492448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.492517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.492745 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.492962 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80436) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 14:03:03.509713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.509931 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 14:03:03.510263 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.510467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 14:03:03.510649 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.510745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.511260 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 14:03:03.511363 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.511428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.511511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.511587 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 14:03:03.511661 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.511732 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.511923 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.512189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.512445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.522561 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.523634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.523634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.523634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.524430 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.524430 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.524430 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.524620 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.531472 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.532653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.534833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.535109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.535388 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.535774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.536010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.536165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.536253 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.536329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.536551 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.536680 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.536791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.536916 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.537100 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.537229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.537334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.537424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.537617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.537713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.537972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.538241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.538538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.538803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.564126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.565777 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.566056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.566181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.567753 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.568038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.571341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.571621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.571868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.573457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.573738 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.574018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.579236 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.579457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.581339 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.581614 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.584093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.584379 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.584661 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.584948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.585212 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.585482 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.585753 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.586018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.586216 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.586535 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.586815 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.587100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.587376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.587651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.587918 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.588182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.604646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.604921 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.607131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.607412 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.609415 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.611941 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.613134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.613426 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.615711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.616019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.618422 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.621032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.622146 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.625131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.626145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.626445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.626762 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.627042 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.627335 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.627617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.629008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.629309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.629589 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.629872 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.630133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.630448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.647061 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.647441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.647685 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.647981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.649557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.649935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.650207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.650509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.655859 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.657573 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.657844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.658592 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.660357 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.660639 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.660955 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.661236 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.661535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.661813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.662097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.663859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.664144 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.664440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.664717 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.664995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.675448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.675728 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.676014 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.676287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.676566 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.676853 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.677123 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.678527 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.678809 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.679090 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.679368 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.679631 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.679912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.680184 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.697485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.700396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.700979 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.703713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.704794 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.706531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.707113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.708184 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.708462 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.708732 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.708856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.710364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.710674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.710958 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.716117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.717712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.718502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.720275 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.721038 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.721323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.721607 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.721877 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.723620 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.723914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.724197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.724475 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.731202 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.731488 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.731766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.733797 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.734088 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.734369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.739603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.739884 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.740162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.740433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.740709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.740991 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.741260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.741498 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.741799 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.742075 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.742294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80436) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 14:03:03.742441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.742608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.742751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.742850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.742994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.743090 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.743247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.743525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.743817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.744135 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.744370 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.744645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.744912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.745177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.745444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.745705 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.745977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80436) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 14:03:03.781045 dv-cinder-797608-58-smb devstack@keystone.service[80435]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b9241af9c0 pid: 80435 (default app) Jul 18 14:03:03.784267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b9241af9c0 pid: 80436 (default app) Jul 18 14:03:03.784488 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd34336-8a3f-44f7-af33-4ae25349d0fe None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:03.784786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd34336-8a3f-44f7-af33-4ae25349d0fe None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:03.785067 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd34336-8a3f-44f7-af33-4ae25349d0fe None None] PATH_INFO: `/v3` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:03.789372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1/1] 10.222.0.99 () {50 vars in 791 bytes} [Mon Jul 18 14:03:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:11.431526 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879b5e4-71cf-4c6d-8f87-bccfdff658b0 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:11.432071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879b5e4-71cf-4c6d-8f87-bccfdff658b0 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:11.432071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879b5e4-71cf-4c6d-8f87-bccfdff658b0 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:11.436321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1/2] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:11.442342 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a85b6-aab8-45c0-be6b-5b5a49715abf None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:11.442820 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a85b6-aab8-45c0-be6b-5b5a49715abf None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:11.442939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a85b6-aab8-45c0-be6b-5b5a49715abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:11.510904 dv-cinder-797608-58-smb devstack@keystone.service[80435]: INFO dbcounter [None req-c75a85b6-aab8-45c0-be6b-5b5a49715abf None None] Registered counter for database keystone Jul 18 14:03:11.532707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG oslo_db.sqlalchemy.engines [None req-c75a85b6-aab8-45c0-be6b-5b5a49715abf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:03:11.540567 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writer thread running {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:03:11.719448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG passlib.handlers.bcrypt [None req-c75a85b6-aab8-45c0-be6b-5b5a49715abf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80435) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 14:03:11.719783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG passlib.handlers.bcrypt [None req-c75a85b6-aab8-45c0-be6b-5b5a49715abf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80435) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 14:03:11.775675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c75a85b6-aab8-45c0-be6b-5b5a49715abf None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:11.777323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c75a85b6-aab8-45c0-be6b-5b5a49715abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:11.907740 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 2/3] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 18 14:03:12.071416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879b5e4-71cf-4c6d-8f87-bccfdff658b0 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:12.139662 dv-cinder-797608-58-smb devstack@keystone.service[80436]: INFO dbcounter [None req-c879b5e4-71cf-4c6d-8f87-bccfdff658b0 None None] Registered counter for database keystone Jul 18 14:03:12.159465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG oslo_db.sqlalchemy.engines [None req-c879b5e4-71cf-4c6d-8f87-bccfdff658b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80436) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:03:12.168531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writer thread running {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:03:12.291016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879b5e4-71cf-4c6d-8f87-bccfdff658b0 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:12.295849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fa7aa-041e-4c17-b10e-68f8ea2bad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:12.296531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fa7aa-041e-4c17-b10e-68f8ea2bad61 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:12.296822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fa7aa-041e-4c17-b10e-68f8ea2bad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:12.297095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fa7aa-041e-4c17-b10e-68f8ea2bad61 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:12.305972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fa7aa-041e-4c17-b10e-68f8ea2bad61 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:12.357467 dv-cinder-797608-58-smb devstack@keystone.service[80436]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fe3fa7aa-041e-4c17-b10e-68f8ea2bad61 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 14:03:12.357735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fa7aa-041e-4c17-b10e-68f8ea2bad61 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:12.368073 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 2/4] 10.222.0.99 () {58 vars in 1324 bytes} [Mon Jul 18 14:03:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:03:12.377974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a85b6-aab8-45c0-be6b-5b5a49715abf None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:12.393936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a85b6-aab8-45c0-be6b-5b5a49715abf None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:12.400290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1400d6-4449-445f-bafc-f708838a7014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:12.401949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1400d6-4449-445f-bafc-f708838a7014 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:12.402411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1400d6-4449-445f-bafc-f708838a7014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:12.402817 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1400d6-4449-445f-bafc-f708838a7014 admin admin] PATH_INFO: `/v3/projects/268276b3ee674678ab5061125ae1a657` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:12.407427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1400d6-4449-445f-bafc-f708838a7014 admin admin] RBAC: Authorizing `identity:get_project(project_id=268276b3ee674678ab5061125ae1a657)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:12.457035 dv-cinder-797608-58-smb devstack@keystone.service[80435]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bb1400d6-4449-445f-bafc-f708838a7014 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 14:03:12.457624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1400d6-4449-445f-bafc-f708838a7014 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:12.462018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 3/5] 10.222.0.99 () {56 vars in 1207 bytes} [Mon Jul 18 14:03:12 2022] GET /identity/v3/projects/268276b3ee674678ab5061125ae1a657 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:14.459114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb867a7b-b064-47c2-9384-d997a8c40fcd None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:14.459114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb867a7b-b064-47c2-9384-d997a8c40fcd None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:14.462530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb867a7b-b064-47c2-9384-d997a8c40fcd None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:14.463485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 3/6] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:14.469115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e3ed1-11a4-431d-8656-8582d1241466 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:14.469537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e3ed1-11a4-431d-8656-8582d1241466 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:14.469678 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e3ed1-11a4-431d-8656-8582d1241466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:14.492399 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e39e3ed1-11a4-431d-8656-8582d1241466 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:14.493947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e39e3ed1-11a4-431d-8656-8582d1241466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:14.503974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 4/7] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 18 14:03:14.526727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb867a7b-b064-47c2-9384-d997a8c40fcd None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:14.541215 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb867a7b-b064-47c2-9384-d997a8c40fcd None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:14.547207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730977b0-d58b-4d3e-80bb-8478b33a6832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:14.548044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730977b0-d58b-4d3e-80bb-8478b33a6832 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:14.548390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730977b0-d58b-4d3e-80bb-8478b33a6832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:14.548722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730977b0-d58b-4d3e-80bb-8478b33a6832 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:14.557061 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730977b0-d58b-4d3e-80bb-8478b33a6832 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:14.558889 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730977b0-d58b-4d3e-80bb-8478b33a6832 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:14.567538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 4/8] 10.222.0.99 () {58 vars in 1324 bytes} [Mon Jul 18 14:03:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:03:14.573088 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e3ed1-11a4-431d-8656-8582d1241466 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:14.582787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e3ed1-11a4-431d-8656-8582d1241466 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:14.588606 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05756661-f15c-49d4-be3a-81950a24c8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:14.589483 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05756661-f15c-49d4-be3a-81950a24c8be admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:14.589770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05756661-f15c-49d4-be3a-81950a24c8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:14.590048 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05756661-f15c-49d4-be3a-81950a24c8be admin admin] PATH_INFO: `/v3/users/920f62903fc54cf3b0dedf0810c30914` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:14.591630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05756661-f15c-49d4-be3a-81950a24c8be admin admin] RBAC: Authorizing `identity:get_user(user_id=920f62903fc54cf3b0dedf0810c30914)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:14.593495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05756661-f15c-49d4-be3a-81950a24c8be admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:14.595139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 5/9] 10.222.0.99 () {56 vars in 1198 bytes} [Mon Jul 18 14:03:14 2022] GET /identity/v3/users/920f62903fc54cf3b0dedf0810c30914 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:16.630598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0717d8d-4773-4837-814a-aa49ff63b80c None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:16.631249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0717d8d-4773-4837-814a-aa49ff63b80c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:16.631249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0717d8d-4773-4837-814a-aa49ff63b80c None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:16.632483 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 5/10] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:03:16.638257 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87723e-ae3f-4c7b-a396-91a4686e615c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:16.638756 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87723e-ae3f-4c7b-a396-91a4686e615c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:16.639045 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87723e-ae3f-4c7b-a396-91a4686e615c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:16.659691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0d87723e-ae3f-4c7b-a396-91a4686e615c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:16.661382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0d87723e-ae3f-4c7b-a396-91a4686e615c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:16.671950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd04c8-24ee-4110-b50d-d1262f62bc2c None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:16.672201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd04c8-24ee-4110-b50d-d1262f62bc2c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:16.672932 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd04c8-24ee-4110-b50d-d1262f62bc2c None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:16.674334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 6/11] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:16.679331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd172ef9-f209-4c46-b966-42c4eee55cbf None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:16.679619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd172ef9-f209-4c46-b966-42c4eee55cbf None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:16.679901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd172ef9-f209-4c46-b966-42c4eee55cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:16.722345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG passlib.handlers.bcrypt [None req-cd172ef9-f209-4c46-b966-42c4eee55cbf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80436) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 14:03:16.722795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG passlib.handlers.bcrypt [None req-cd172ef9-f209-4c46-b966-42c4eee55cbf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80436) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 14:03:16.762639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 6/12] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:16.768466 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-cd172ef9-f209-4c46-b966-42c4eee55cbf None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:16.770157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-cd172ef9-f209-4c46-b966-42c4eee55cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:16.788390 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87723e-ae3f-4c7b-a396-91a4686e615c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:16.815945 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:16.872700 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 7/13] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:16.894791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd172ef9-f209-4c46-b966-42c4eee55cbf None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:16.899617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87723e-ae3f-4c7b-a396-91a4686e615c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:16.949212 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfd1bf-1284-4c13-8b5c-6e1fbdf83da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:16.950020 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfd1bf-1284-4c13-8b5c-6e1fbdf83da3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:16.950304 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfd1bf-1284-4c13-8b5c-6e1fbdf83da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:16.950614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfd1bf-1284-4c13-8b5c-6e1fbdf83da3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:16.962731 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfd1bf-1284-4c13-8b5c-6e1fbdf83da3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:16.973948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c2cfd1bf-1284-4c13-8b5c-6e1fbdf83da3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:16.973948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:16.973948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:16.973948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:16.973948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:16.973948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:16.973948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:16.973948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:16.973948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:16.973948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:16.973948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:16.973948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:16.973948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:16.973948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:16.973948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:16.973948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:16.974943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:16.974943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:16.974943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:16.974943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:16.974943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:16.974943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:16.974943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:16.974943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:16.974943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:16.974943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:16.974943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:16.974943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:16.974943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:16.974943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:16.974943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:16.974943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:16.975999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:16.975999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:16.975999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:16.975999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:16.975999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:16.975999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:16.975999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:16.975999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:16.975999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:16.975999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:16.975999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:16.975999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:03:16.975999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 7/14] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:03:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:16.981068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfd1bf-1284-4c13-8b5c-6e1fbdf83da3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:17.013133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd172ef9-f209-4c46-b966-42c4eee55cbf None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:17.015855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:17.052803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce9add-0960-4629-bb2b-68b634df3661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:17.053616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce9add-0960-4629-bb2b-68b634df3661 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:17.053893 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce9add-0960-4629-bb2b-68b634df3661 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:17.054166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce9add-0960-4629-bb2b-68b634df3661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:17.067599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:17.086461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfd1bf-1284-4c13-8b5c-6e1fbdf83da3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:17.121039 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fefb4-92b7-41b8-97dd-3673f5795970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:17.121713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fefb4-92b7-41b8-97dd-3673f5795970 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:17.122001 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fefb4-92b7-41b8-97dd-3673f5795970 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:17.122283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fefb4-92b7-41b8-97dd-3673f5795970 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:17.123083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fefb4-92b7-41b8-97dd-3673f5795970 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:17.123396 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fefb4-92b7-41b8-97dd-3673f5795970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:17.125129 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fefb4-92b7-41b8-97dd-3673f5795970 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:17.126076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce9add-0960-4629-bb2b-68b634df3661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:17.127710 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce9add-0960-4629-bb2b-68b634df3661 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:17.138189 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 8/15] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:17.144298 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fefb4-92b7-41b8-97dd-3673f5795970 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:17.252445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 8/16] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 14:03:17.258303 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce9add-0960-4629-bb2b-68b634df3661 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:17.258809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fefb4-92b7-41b8-97dd-3673f5795970 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:17.262232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:17.295961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d44942-241c-4314-a03b-1d792937c57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:17.296856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d44942-241c-4314-a03b-1d792937c57c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:17.297146 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d44942-241c-4314-a03b-1d792937c57c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:17.297396 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d44942-241c-4314-a03b-1d792937c57c None admin] PATH_INFO: `/v3/users/920f62903fc54cf3b0dedf0810c30914` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:17.298734 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d44942-241c-4314-a03b-1d792937c57c None admin] RBAC: Authorizing `identity:get_user(user_id=920f62903fc54cf3b0dedf0810c30914)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:17.300276 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d44942-241c-4314-a03b-1d792937c57c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:17.301935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 9/17] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:17 2022] GET /identity/v3/users/920f62903fc54cf3b0dedf0810c30914 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:17.310303 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d44942-241c-4314-a03b-1d792937c57c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:17.326049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:17.362547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce9add-0960-4629-bb2b-68b634df3661 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:17.399375 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2727c-753c-4d0e-9f9f-edf388017ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:17.400190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2727c-753c-4d0e-9f9f-edf388017ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:17.400470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2727c-753c-4d0e-9f9f-edf388017ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:17.400811 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2727c-753c-4d0e-9f9f-edf388017ee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:17.415186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d44942-241c-4314-a03b-1d792937c57c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:17.423044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2727c-753c-4d0e-9f9f-edf388017ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:17.424548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2727c-753c-4d0e-9f9f-edf388017ee9 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:17.447897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-9db2727c-753c-4d0e-9f9f-edf388017ee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:03:17.447897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:17.447897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:17.447897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:17.447897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:17.447897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:17.447897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:17.447897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:17.447897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:17.447897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:17.447897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:17.447897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:17.447897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:03:17.447897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:03:17.447897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:17.448765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:17.450018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:03:17.450018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:03:17.450018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:03:17.450018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:03:17.450018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 9/18] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:17.450942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb6d4b-bbaa-4466-86b0-b74c8c88b331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:17.451733 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb6d4b-bbaa-4466-86b0-b74c8c88b331 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:17.452011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb6d4b-bbaa-4466-86b0-b74c8c88b331 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:17.452276 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb6d4b-bbaa-4466-86b0-b74c8c88b331 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:17.453440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb6d4b-bbaa-4466-86b0-b74c8c88b331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:17.454937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2727c-753c-4d0e-9f9f-edf388017ee9 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:17.455199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb6d4b-bbaa-4466-86b0-b74c8c88b331 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:17.456857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 10/19] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:03:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:17.462443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb6d4b-bbaa-4466-86b0-b74c8c88b331 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:17.511809 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:17.543452 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:17.557754 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2727c-753c-4d0e-9f9f-edf388017ee9 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:17.565057 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb6d4b-bbaa-4466-86b0-b74c8c88b331 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:17.590846 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30f598-1180-4d17-8246-cf10b41ba7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:17.591506 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30f598-1180-4d17-8246-cf10b41ba7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:17.591791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30f598-1180-4d17-8246-cf10b41ba7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:17.592070 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30f598-1180-4d17-8246-cf10b41ba7e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:17.592793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30f598-1180-4d17-8246-cf10b41ba7e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:17.593095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30f598-1180-4d17-8246-cf10b41ba7e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:17.594530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30f598-1180-4d17-8246-cf10b41ba7e0 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:17.598503 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679a212-7b75-4507-8c1a-01b01a1792da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:17.599162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a212-7b75-4507-8c1a-01b01a1792da None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:17.599446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a212-7b75-4507-8c1a-01b01a1792da None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:17.599723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a212-7b75-4507-8c1a-01b01a1792da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:17.600559 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679a212-7b75-4507-8c1a-01b01a1792da None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.domain.id=default, user.id=920f62903fc54cf3b0dedf0810c30914) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:17.600869 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679a212-7b75-4507-8c1a-01b01a1792da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:17.602584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679a212-7b75-4507-8c1a-01b01a1792da None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:17.609823 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 11/20] 10.222.0.99 () {56 vars in 1322 bytes} [Mon Jul 18 14:03:17 2022] GET /identity/v3/role_assignments?user.id=920f62903fc54cf3b0dedf0810c30914&scope.domain.id=default&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:17.622567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 10/21] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:20.002316 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a73ffc-d0b4-432e-a7c9-0e9c28bf7ddc None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:20.002860 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a73ffc-d0b4-432e-a7c9-0e9c28bf7ddc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:20.003007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a73ffc-d0b4-432e-a7c9-0e9c28bf7ddc None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:20.004379 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 12/22] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:20.010117 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5009f9-ecaa-43a2-8eba-b9452afe224c None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:20.010540 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5009f9-ecaa-43a2-8eba-b9452afe224c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:20.010708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5009f9-ecaa-43a2-8eba-b9452afe224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:20.030687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-eb5009f9-ecaa-43a2-8eba-b9452afe224c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:20.031884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-eb5009f9-ecaa-43a2-8eba-b9452afe224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:20.091548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1710b6-7b08-4cbc-a908-43d6fc1c8c7f None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:20.091862 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1710b6-7b08-4cbc-a908-43d6fc1c8c7f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:20.092116 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1710b6-7b08-4cbc-a908-43d6fc1c8c7f None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:20.093499 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 13/23] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:20.108154 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702063b-42c0-464f-981e-622f953213b0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:20.108441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702063b-42c0-464f-981e-622f953213b0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:20.108727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702063b-42c0-464f-981e-622f953213b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:20.136162 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 11/24] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:20.143400 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5702063b-42c0-464f-981e-622f953213b0 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:20.144638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5702063b-42c0-464f-981e-622f953213b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:20.206332 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5009f9-ecaa-43a2-8eba-b9452afe224c None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:20.281636 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 14/25] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:20.283087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d72de8-9a5c-46fc-8f54-9dc881edee0d None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:20.283397 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d72de8-9a5c-46fc-8f54-9dc881edee0d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:20.283665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d72de8-9a5c-46fc-8f54-9dc881edee0d None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:20.285260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 15/26] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:20.290983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:20.291933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abbe4e-96f5-483e-85cc-c151c63005ea None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:20.292225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abbe4e-96f5-483e-85cc-c151c63005ea None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:20.292505 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abbe4e-96f5-483e-85cc-c151c63005ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:20.335499 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-64abbe4e-96f5-483e-85cc-c151c63005ea None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:20.336739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-64abbe4e-96f5-483e-85cc-c151c63005ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:20.364856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5009f9-ecaa-43a2-8eba-b9452afe224c None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:20.414574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e46f07-61a4-426a-85ca-ebd9e7c9753d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:20.415651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e46f07-61a4-426a-85ca-ebd9e7c9753d None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:20.415939 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e46f07-61a4-426a-85ca-ebd9e7c9753d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:20.416215 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e46f07-61a4-426a-85ca-ebd9e7c9753d None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:20.416986 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e46f07-61a4-426a-85ca-ebd9e7c9753d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:20.418503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e46f07-61a4-426a-85ca-ebd9e7c9753d None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:20.496761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 16/27] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:20.497630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abbe4e-96f5-483e-85cc-c151c63005ea None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:20.506884 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:20.590400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 12/28] 10.222.0.99 () {60 vars in 1131 bytes} [Mon Jul 18 14:03:20 2022] POST /identity/v3/roles => generated 219 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:03:20.591327 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e46f07-61a4-426a-85ca-ebd9e7c9753d None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:20.720414 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abbe4e-96f5-483e-85cc-c151c63005ea None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:20.730369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e46f07-61a4-426a-85ca-ebd9e7c9753d None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:20.741417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:20.769275 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17de71-0c2c-44f2-a69e-e2a73eee9c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:20.770251 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17de71-0c2c-44f2-a69e-e2a73eee9c49 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:20.770748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17de71-0c2c-44f2-a69e-e2a73eee9c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:20.771060 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17de71-0c2c-44f2-a69e-e2a73eee9c49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:20.784225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17de71-0c2c-44f2-a69e-e2a73eee9c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:20.798556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-0e17de71-0c2c-44f2-a69e-e2a73eee9c49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:20.798556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:20.798556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:20.798556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:20.798556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:20.798556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:20.798556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:20.798556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:20.798556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:20.798556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:20.798556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:20.798556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:20.798556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:20.798556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:20.798556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:20.798556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:20.799472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:20.799472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:20.799472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:20.799472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:20.799472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:20.799472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:20.799472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:20.799472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:20.799472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:20.799472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:20.799472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:20.799472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:20.799472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:20.799472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:20.799472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:20.799472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:20.801516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:20.801516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:20.801516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:20.801516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:20.801516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:20.801516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:20.801516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:20.801516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:20.801516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:20.801516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:20.801516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:20.801516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:03:20.801516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 13/29] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:03:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:20.808696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17de71-0c2c-44f2-a69e-e2a73eee9c49 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:20.859342 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8613e-c087-4755-9149-1783f0afd99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:20.860089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8613e-c087-4755-9149-1783f0afd99c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:20.860377 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8613e-c087-4755-9149-1783f0afd99c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:20.860669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8613e-c087-4755-9149-1783f0afd99c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:20.883964 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8613e-c087-4755-9149-1783f0afd99c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:20.885497 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8613e-c087-4755-9149-1783f0afd99c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:20.932077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b5b8613e-c087-4755-9149-1783f0afd99c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:03:20.932077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:20.932077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:20.932077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:20.932077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:20.932077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:20.932077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:20.932077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:20.932077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:20.932077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:20.932077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:20.932077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:20.932077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:03:20.932077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:03:20.932077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:20.932948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:20.934289 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:03:20.934289 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:03:20.934289 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:03:20.934289 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:03:20.934289 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 17/30] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:20.947474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8613e-c087-4755-9149-1783f0afd99c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:20.957046 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17de71-0c2c-44f2-a69e-e2a73eee9c49 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:21.005908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec4045-e62c-44b8-bbbf-f13fac225cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:21.006829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec4045-e62c-44b8-bbbf-f13fac225cdb None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:21.007218 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec4045-e62c-44b8-bbbf-f13fac225cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:21.007617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec4045-e62c-44b8-bbbf-f13fac225cdb None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:21.008444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec4045-e62c-44b8-bbbf-f13fac225cdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:21.008758 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec4045-e62c-44b8-bbbf-f13fac225cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:21.010379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec4045-e62c-44b8-bbbf-f13fac225cdb None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:21.024282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 14/31] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:21.025739 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3096369-16c9-4a70-af20-697de6573b70 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:21.026033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3096369-16c9-4a70-af20-697de6573b70 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:21.026320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3096369-16c9-4a70-af20-697de6573b70 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:21.027857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 15/32] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:21.033162 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824616c-17fa-4e5c-b156-0f90a18cb640 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:21.033458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824616c-17fa-4e5c-b156-0f90a18cb640 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:21.033738 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824616c-17fa-4e5c-b156-0f90a18cb640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:21.038677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:21.063033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-8824616c-17fa-4e5c-b156-0f90a18cb640 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:21.064630 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8824616c-17fa-4e5c-b156-0f90a18cb640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:21.092520 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:21.115035 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8613e-c087-4755-9149-1783f0afd99c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:21.155459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b6c5e-54b7-4c96-bedb-f82622bcc6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:21.156140 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b6c5e-54b7-4c96-bedb-f82622bcc6fc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:21.156429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b6c5e-54b7-4c96-bedb-f82622bcc6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:21.156711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b6c5e-54b7-4c96-bedb-f82622bcc6fc None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:21.157453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b6c5e-54b7-4c96-bedb-f82622bcc6fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:21.157916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b6c5e-54b7-4c96-bedb-f82622bcc6fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:21.159644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b6c5e-54b7-4c96-bedb-f82622bcc6fc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:21.160027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 16/33] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:21.160721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824616c-17fa-4e5c-b156-0f90a18cb640 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:21.189739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 18/34] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:21.190695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b6c5e-54b7-4c96-bedb-f82622bcc6fc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:21.270623 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824616c-17fa-4e5c-b156-0f90a18cb640 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:21.300473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b6c5e-54b7-4c96-bedb-f82622bcc6fc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:21.307848 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998eb4f-d348-4daf-bc56-f3d1cccb7518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:21.308854 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998eb4f-d348-4daf-bc56-f3d1cccb7518 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:21.309149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998eb4f-d348-4daf-bc56-f3d1cccb7518 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:21.309432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998eb4f-d348-4daf-bc56-f3d1cccb7518 None admin] PATH_INFO: `/v3/users/920f62903fc54cf3b0dedf0810c30914` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:21.311175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998eb4f-d348-4daf-bc56-f3d1cccb7518 None admin] RBAC: Authorizing `identity:get_user(user_id=920f62903fc54cf3b0dedf0810c30914)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:21.312664 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998eb4f-d348-4daf-bc56-f3d1cccb7518 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:21.314593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 17/35] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:21 2022] GET /identity/v3/users/920f62903fc54cf3b0dedf0810c30914 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:21.315257 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998eb4f-d348-4daf-bc56-f3d1cccb7518 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:21.324158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:21.339476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58f203-40ac-4305-800f-97f4e6dd60d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:21.340159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58f203-40ac-4305-800f-97f4e6dd60d2 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:21.340445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58f203-40ac-4305-800f-97f4e6dd60d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:21.340725 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58f203-40ac-4305-800f-97f4e6dd60d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:21.341593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58f203-40ac-4305-800f-97f4e6dd60d2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:21.343137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58f203-40ac-4305-800f-97f4e6dd60d2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:21.344672 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:21.422784 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998eb4f-d348-4daf-bc56-f3d1cccb7518 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:21.458823 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ff04f-1af0-4255-bbbe-c85e3b0ea731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:21.459556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ff04f-1af0-4255-bbbe-c85e3b0ea731 None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:21.459848 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ff04f-1af0-4255-bbbe-c85e3b0ea731 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:21.460132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ff04f-1af0-4255-bbbe-c85e3b0ea731 None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:21.460861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ff04f-1af0-4255-bbbe-c85e3b0ea731 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:21.462345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ff04f-1af0-4255-bbbe-c85e3b0ea731 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:21.477789 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 19/36] 10.222.0.99 () {60 vars in 1131 bytes} [Mon Jul 18 14:03:21 2022] POST /identity/v3/roles => generated 225 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:03:21.479499 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58f203-40ac-4305-800f-97f4e6dd60d2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:21.497186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 18/37] 10.222.0.99 () {60 vars in 1141 bytes} [Mon Jul 18 14:03:21 2022] POST /identity/v3/projects => generated 301 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:03:21.577322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44d95b-c9cc-4eea-973c-df248724fabc None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:21.577897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44d95b-c9cc-4eea-973c-df248724fabc None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:21.578489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44d95b-c9cc-4eea-973c-df248724fabc None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:21.581207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 19/38] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:21.589879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea41c1e-7b26-48ac-bd76-4593dee86e4a None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:21.590176 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea41c1e-7b26-48ac-bd76-4593dee86e4a None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:21.590513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea41c1e-7b26-48ac-bd76-4593dee86e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:21.608448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58f203-40ac-4305-800f-97f4e6dd60d2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:21.631838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-bea41c1e-7b26-48ac-bd76-4593dee86e4a None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:21.633114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-bea41c1e-7b26-48ac-bd76-4593dee86e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:21.649639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f8f64-de9e-4227-9b08-58b566bb75d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:21.650495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f8f64-de9e-4227-9b08-58b566bb75d6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:21.650790 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f8f64-de9e-4227-9b08-58b566bb75d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:21.651074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f8f64-de9e-4227-9b08-58b566bb75d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:21.652439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f8f64-de9e-4227-9b08-58b566bb75d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:21.654262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f8f64-de9e-4227-9b08-58b566bb75d6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:21.656435 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 20/39] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:03:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:21.662238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f8f64-de9e-4227-9b08-58b566bb75d6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:21.734965 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:21.765423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 20/40] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:21.767317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37a4a5-259a-4ed1-b21b-5d4da6946af0 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:21.767317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37a4a5-259a-4ed1-b21b-5d4da6946af0 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:21.767509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37a4a5-259a-4ed1-b21b-5d4da6946af0 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:21.769512 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 21/41] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:21.776768 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820be37d-3156-4871-b1fd-76ce4dcbbaa4 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:21.777059 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820be37d-3156-4871-b1fd-76ce4dcbbaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:21.777340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820be37d-3156-4871-b1fd-76ce4dcbbaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:21.797646 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-820be37d-3156-4871-b1fd-76ce4dcbbaa4 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:21.798901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-820be37d-3156-4871-b1fd-76ce4dcbbaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:21.801166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:21.824489 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f8f64-de9e-4227-9b08-58b566bb75d6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:21.872282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086d288-b1cc-4af3-9ce7-5138de5425b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:21.873157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d288-b1cc-4af3-9ce7-5138de5425b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:21.873441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d288-b1cc-4af3-9ce7-5138de5425b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:21.873722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086d288-b1cc-4af3-9ce7-5138de5425b6 None admin] PATH_INFO: `/v3/domains/default/users/920f62903fc54cf3b0dedf0810c30914/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:21.876232 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086d288-b1cc-4af3-9ce7-5138de5425b6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=920f62903fc54cf3b0dedf0810c30914, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:21.876374 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 22/42] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:03:21.877726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086d288-b1cc-4af3-9ce7-5138de5425b6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:21.883508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820be37d-3156-4871-b1fd-76ce4dcbbaa4 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:21.894309 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 21/43] 10.222.0.99 () {58 vars in 1361 bytes} [Mon Jul 18 14:03:21 2022] PUT /identity/v3/domains/default/users/920f62903fc54cf3b0dedf0810c30914/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:03:21.903769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086d288-b1cc-4af3-9ce7-5138de5425b6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:22.004316 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820be37d-3156-4871-b1fd-76ce4dcbbaa4 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:22.053615 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14c2c4-f404-4019-ab1d-a00261684577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:22.057019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14c2c4-f404-4019-ab1d-a00261684577 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:22.057019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14c2c4-f404-4019-ab1d-a00261684577 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:22.057019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14c2c4-f404-4019-ab1d-a00261684577 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:22.061279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14c2c4-f404-4019-ab1d-a00261684577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:22.061279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14c2c4-f404-4019-ab1d-a00261684577 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:22.061972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 23/44] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:03:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:22.068124 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14c2c4-f404-4019-ab1d-a00261684577 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:22.085146 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:22.137435 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086d288-b1cc-4af3-9ce7-5138de5425b6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:22.141314 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:22.183205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37617306-ce84-48f3-9882-87cf74f54cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:22.183883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37617306-ce84-48f3-9882-87cf74f54cdc None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:22.184164 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37617306-ce84-48f3-9882-87cf74f54cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:22.184439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37617306-ce84-48f3-9882-87cf74f54cdc None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:22.185207 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37617306-ce84-48f3-9882-87cf74f54cdc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:22.186699 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37617306-ce84-48f3-9882-87cf74f54cdc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:22.210416 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 22/45] 10.222.0.99 () {60 vars in 1131 bytes} [Mon Jul 18 14:03:21 2022] POST /identity/v3/roles => generated 223 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:03:22.318764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14c2c4-f404-4019-ab1d-a00261684577 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:22.359128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3180d42-82cc-48ed-92ab-24de862a354b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:22.360247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3180d42-82cc-48ed-92ab-24de862a354b None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:22.360247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3180d42-82cc-48ed-92ab-24de862a354b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:22.360435 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3180d42-82cc-48ed-92ab-24de862a354b None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:22.361171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3180d42-82cc-48ed-92ab-24de862a354b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:22.362798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3180d42-82cc-48ed-92ab-24de862a354b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:22.391486 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 24/46] 10.222.0.99 () {60 vars in 1141 bytes} [Mon Jul 18 14:03:22 2022] POST /identity/v3/projects => generated 312 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:03:23.949252 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb9f69-9a80-4c72-b312-fd23cc8fbecd None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:23.949786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb9f69-9a80-4c72-b312-fd23cc8fbecd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:23.949892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb9f69-9a80-4c72-b312-fd23cc8fbecd None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:23.951457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 23/47] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:23.957479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532927c9-c793-4e8d-9970-7385fdce0940 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:23.957954 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532927c9-c793-4e8d-9970-7385fdce0940 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:23.958340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532927c9-c793-4e8d-9970-7385fdce0940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:23.981552 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-532927c9-c793-4e8d-9970-7385fdce0940 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:23.983130 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-532927c9-c793-4e8d-9970-7385fdce0940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:24.044809 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:24.059631 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 25/48] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:24.082370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb9f69-9a80-4c72-b312-fd23cc8fbecd None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:24.198604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb9f69-9a80-4c72-b312-fd23cc8fbecd None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:24.235554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18572d38-37fa-4529-abf9-467ff7c5852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:24.236313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18572d38-37fa-4529-abf9-467ff7c5852f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:24.236602 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18572d38-37fa-4529-abf9-467ff7c5852f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:24.236883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18572d38-37fa-4529-abf9-467ff7c5852f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:24.248527 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18572d38-37fa-4529-abf9-467ff7c5852f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:24.257009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-18572d38-37fa-4529-abf9-467ff7c5852f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:24.257009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:24.257009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:24.257009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:24.257009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:24.257009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:24.257009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:24.257009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:24.257009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:24.257009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:24.257009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:24.257009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:24.257009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:24.257009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:24.257009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:24.257009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:24.258266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:24.258266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:24.258266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:24.258266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:24.258266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:24.258266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:24.258266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:24.258266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:24.258266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:24.258266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:24.258266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:24.258266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:24.258266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:24.258266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:24.258266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:24.258266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:24.265196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:24.265196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:24.265196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:24.265196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:24.265196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:24.265196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:24.265196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:24.265196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:24.265196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:24.265196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:24.265196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:24.265196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:03:24.265196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 24/49] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:03:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:24.265833 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532927c9-c793-4e8d-9970-7385fdce0940 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:24.380498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532927c9-c793-4e8d-9970-7385fdce0940 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:24.417255 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9eae4-3841-4c2f-970d-bc05ccf22060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:24.417928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9eae4-3841-4c2f-970d-bc05ccf22060 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:24.418214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9eae4-3841-4c2f-970d-bc05ccf22060 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:24.418519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9eae4-3841-4c2f-970d-bc05ccf22060 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:24.419292 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9eae4-3841-4c2f-970d-bc05ccf22060 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:24.419601 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9eae4-3841-4c2f-970d-bc05ccf22060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:24.421443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9eae4-3841-4c2f-970d-bc05ccf22060 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:24.422861 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8d7a1-765b-4fb3-9c5c-31c7076f421a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:24.423156 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8d7a1-765b-4fb3-9c5c-31c7076f421a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:24.423440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8d7a1-765b-4fb3-9c5c-31c7076f421a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:24.424841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 25/50] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:24.430676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a495e-7119-4a05-b501-ea449388b170 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:24.431003 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a495e-7119-4a05-b501-ea449388b170 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:24.431288 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a495e-7119-4a05-b501-ea449388b170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:24.436509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 26/51] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:24.442182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9eae4-3841-4c2f-970d-bc05ccf22060 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:24.449159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-490a495e-7119-4a05-b501-ea449388b170 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:24.450783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-490a495e-7119-4a05-b501-ea449388b170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:24.471642 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:24.497427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:24.528022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 26/52] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:24.554117 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9eae4-3841-4c2f-970d-bc05ccf22060 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:24.556372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a495e-7119-4a05-b501-ea449388b170 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:24.588107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff7d4b-fb52-4036-8563-9dd039506984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:24.588989 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff7d4b-fb52-4036-8563-9dd039506984 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:24.589269 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff7d4b-fb52-4036-8563-9dd039506984 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:24.589542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff7d4b-fb52-4036-8563-9dd039506984 None admin] PATH_INFO: `/v3/users/920f62903fc54cf3b0dedf0810c30914` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:24.590803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff7d4b-fb52-4036-8563-9dd039506984 None admin] RBAC: Authorizing `identity:get_user(user_id=920f62903fc54cf3b0dedf0810c30914)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:24.592825 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff7d4b-fb52-4036-8563-9dd039506984 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:24.593916 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 27/53] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:24 2022] GET /identity/v3/users/920f62903fc54cf3b0dedf0810c30914 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:24.599417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff7d4b-fb52-4036-8563-9dd039506984 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:24.661921 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a495e-7119-4a05-b501-ea449388b170 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:24.696865 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488e394-c0ea-4879-a574-d57ab4de8dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:24.697715 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488e394-c0ea-4879-a574-d57ab4de8dbd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:24.698027 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488e394-c0ea-4879-a574-d57ab4de8dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:24.698309 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488e394-c0ea-4879-a574-d57ab4de8dbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:24.699619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488e394-c0ea-4879-a574-d57ab4de8dbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:24.701140 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488e394-c0ea-4879-a574-d57ab4de8dbd None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:24.701453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff7d4b-fb52-4036-8563-9dd039506984 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:24.702889 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 27/54] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:03:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:24.708765 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488e394-c0ea-4879-a574-d57ab4de8dbd None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:24.721345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:24.736261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:24.740642 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2118d3-b1b7-49ca-84c8-13b7d94e6a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:24.741462 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2118d3-b1b7-49ca-84c8-13b7d94e6a81 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:24.741751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2118d3-b1b7-49ca-84c8-13b7d94e6a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:24.742039 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2118d3-b1b7-49ca-84c8-13b7d94e6a81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:24.743309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2118d3-b1b7-49ca-84c8-13b7d94e6a81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:24.744777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2118d3-b1b7-49ca-84c8-13b7d94e6a81 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:24.746454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 28/55] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:03:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:24.752831 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2118d3-b1b7-49ca-84c8-13b7d94e6a81 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:24.815347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488e394-c0ea-4879-a574-d57ab4de8dbd None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:24.854233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96a733-7c1e-453d-9e53-b5ae5d4d30bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:24.854993 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96a733-7c1e-453d-9e53-b5ae5d4d30bc None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:24.855278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96a733-7c1e-453d-9e53-b5ae5d4d30bc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:24.855552 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96a733-7c1e-453d-9e53-b5ae5d4d30bc None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:24.856264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96a733-7c1e-453d-9e53-b5ae5d4d30bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:24.857719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96a733-7c1e-453d-9e53-b5ae5d4d30bc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:24.866882 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2118d3-b1b7-49ca-84c8-13b7d94e6a81 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:24.885545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 28/56] 10.222.0.99 () {60 vars in 1140 bytes} [Mon Jul 18 14:03:24 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:03:24.903991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193fe8e-ea08-47cf-b5fd-095cea53d485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:24.904693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193fe8e-ea08-47cf-b5fd-095cea53d485 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:24.904986 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193fe8e-ea08-47cf-b5fd-095cea53d485 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:24.905277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193fe8e-ea08-47cf-b5fd-095cea53d485 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:24.906282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193fe8e-ea08-47cf-b5fd-095cea53d485 None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.domain.id=default, user.id=920f62903fc54cf3b0dedf0810c30914) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:24.906635 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193fe8e-ea08-47cf-b5fd-095cea53d485 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:24.908172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193fe8e-ea08-47cf-b5fd-095cea53d485 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:24.919171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 29/57] 10.222.0.99 () {56 vars in 1322 bytes} [Mon Jul 18 14:03:24 2022] GET /identity/v3/role_assignments?user.id=920f62903fc54cf3b0dedf0810c30914&scope.domain.id=default&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 530 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:26.955174 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031e2fe-1841-4523-9f2f-3907018ccb5e None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:26.955749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031e2fe-1841-4523-9f2f-3907018ccb5e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:26.955749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031e2fe-1841-4523-9f2f-3907018ccb5e None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:26.957565 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 29/58] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:26.964326 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02102a-87a9-4181-92d8-c8bfb4d86c09 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:26.964749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02102a-87a9-4181-92d8-c8bfb4d86c09 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:26.964913 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02102a-87a9-4181-92d8-c8bfb4d86c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:26.984312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-2b02102a-87a9-4181-92d8-c8bfb4d86c09 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:26.985517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2b02102a-87a9-4181-92d8-c8bfb4d86c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:27.034049 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:27.057136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 30/59] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:27.081805 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031e2fe-1841-4523-9f2f-3907018ccb5e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:27.171807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:27.199564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031e2fe-1841-4523-9f2f-3907018ccb5e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:27.233469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce598e-2b77-4fde-afc4-6ee05d9ef177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:27.234175 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce598e-2b77-4fde-afc4-6ee05d9ef177 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:27.234484 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce598e-2b77-4fde-afc4-6ee05d9ef177 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:27.234754 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce598e-2b77-4fde-afc4-6ee05d9ef177 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:27.235958 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce598e-2b77-4fde-afc4-6ee05d9ef177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:27.237612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce598e-2b77-4fde-afc4-6ee05d9ef177 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:27.239265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 30/60] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:03:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:27.246534 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02102a-87a9-4181-92d8-c8bfb4d86c09 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:27.346903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02102a-87a9-4181-92d8-c8bfb4d86c09 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:27.381864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a4622-c641-447c-bd25-759a63d85abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:27.382557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a4622-c641-447c-bd25-759a63d85abf None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:27.382846 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a4622-c641-447c-bd25-759a63d85abf None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:27.383125 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a4622-c641-447c-bd25-759a63d85abf None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:27.384906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a4622-c641-447c-bd25-759a63d85abf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:27.386409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a4622-c641-447c-bd25-759a63d85abf None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:27.414718 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 31/61] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:03:27 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:03:30.760802 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426668eb-4cf1-43af-b3aa-521279a33789 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:30.761685 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426668eb-4cf1-43af-b3aa-521279a33789 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:30.762098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426668eb-4cf1-43af-b3aa-521279a33789 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:30.763645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 31/62] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:03:30.780457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b6e51-ec18-4325-9aae-05d1aed9e8d3 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:30.781310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b6e51-ec18-4325-9aae-05d1aed9e8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:30.781748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b6e51-ec18-4325-9aae-05d1aed9e8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:30.807603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-037b6e51-ec18-4325-9aae-05d1aed9e8d3 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:30.809061 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-037b6e51-ec18-4325-9aae-05d1aed9e8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:30.850101 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:30.899486 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fa4bd-68f2-471b-b1e4-93410e13666b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:30.899770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fa4bd-68f2-471b-b1e4-93410e13666b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:30.900050 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fa4bd-68f2-471b-b1e4-93410e13666b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:30.902516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 32/63] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:30.907334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 32/64] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:03:30.907963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c715-b5f4-46b2-9383-69bdf40e55d6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:30.908445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c715-b5f4-46b2-9383-69bdf40e55d6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:30.908930 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c715-b5f4-46b2-9383-69bdf40e55d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:30.943467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b5c9c715-b5f4-46b2-9383-69bdf40e55d6 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:30.945035 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b5c9c715-b5f4-46b2-9383-69bdf40e55d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:30.958036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b6e51-ec18-4325-9aae-05d1aed9e8d3 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:31.047433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 33/65] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:31.055239 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db21bd-d5f6-4f3d-97e0-a13aa3216fdc None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:31.055239 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db21bd-d5f6-4f3d-97e0-a13aa3216fdc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:31.055239 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db21bd-d5f6-4f3d-97e0-a13aa3216fdc None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:31.055239 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 34/66] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:31.063693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88725aed-487d-436b-b566-dc31c2e38479 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:31.064012 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88725aed-487d-436b-b566-dc31c2e38479 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:31.064319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88725aed-487d-436b-b566-dc31c2e38479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:31.086613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-88725aed-487d-436b-b566-dc31c2e38479 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:31.087821 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-88725aed-487d-436b-b566-dc31c2e38479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:31.104943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b6e51-ec18-4325-9aae-05d1aed9e8d3 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:31.151114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6052e27-b322-4486-b047-19254da8c59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:31.152010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6052e27-b322-4486-b047-19254da8c59a None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:31.152349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6052e27-b322-4486-b047-19254da8c59a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:31.152816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6052e27-b322-4486-b047-19254da8c59a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:31.164347 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6052e27-b322-4486-b047-19254da8c59a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:31.172766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-f6052e27-b322-4486-b047-19254da8c59a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:31.172766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:31.172766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:31.172766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:31.172766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:31.172766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:31.172766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:31.172766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:31.172766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:31.172766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:31.172766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:31.172766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:31.172766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:31.172766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:31.172766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:31.172766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:31.173678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:31.173678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:31.173678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:31.173678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:31.173678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:31.173678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:31.173678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:31.173678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:31.173678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:31.173678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:31.173678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:31.173678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:31.173678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:31.173678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:31.173678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:31.173678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:31.174451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:31.174451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:31.174451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:31.174451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:31.174451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:31.174451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:31.174451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:31.174451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:31.174451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:31.174451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:31.174451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:31.174451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:03:31.174451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 33/67] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:03:31.175733 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec263ffe-cfdb-49fa-928f-778e0246d657 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:31.176015 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec263ffe-cfdb-49fa-928f-778e0246d657 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:31.176295 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec263ffe-cfdb-49fa-928f-778e0246d657 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:31.177766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 34/68] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:31.183154 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec263ffe-cfdb-49fa-928f-778e0246d657 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:31.187628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 35/69] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:31.191427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88725aed-487d-436b-b566-dc31c2e38479 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:31.194692 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:31.217298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:31.291369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec263ffe-cfdb-49fa-928f-778e0246d657 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:31.301224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88725aed-487d-436b-b566-dc31c2e38479 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:31.326277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15648e-2a8c-4393-9d12-05dc7bdf2b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:31.327148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15648e-2a8c-4393-9d12-05dc7bdf2b81 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:31.327425 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15648e-2a8c-4393-9d12-05dc7bdf2b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:31.327701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15648e-2a8c-4393-9d12-05dc7bdf2b81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:31.337936 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15648e-2a8c-4393-9d12-05dc7bdf2b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:31.342950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d065d-a69b-4a9b-a931-21a3f5f866a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:31.343632 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d065d-a69b-4a9b-a931-21a3f5f866a7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:31.343921 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d065d-a69b-4a9b-a931-21a3f5f866a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:31.344203 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d065d-a69b-4a9b-a931-21a3f5f866a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:31.344970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d065d-a69b-4a9b-a931-21a3f5f866a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:31.345283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d065d-a69b-4a9b-a931-21a3f5f866a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:31.345602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-6f15648e-2a8c-4393-9d12-05dc7bdf2b81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:31.345602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:31.345602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:31.345602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:31.345602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:31.345602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:31.345602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:31.345602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:31.345602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:31.345602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:31.345602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:31.345602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:31.345602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:31.345602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:31.345602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:31.345602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:31.347291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:31.347291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:31.347291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:31.347291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:31.347291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:31.347291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:31.347291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:31.347291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:31.347291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:31.347291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:31.347291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:31.347291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:31.347291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:31.347291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:31.347291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:31.347291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:31.348855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:31.348855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:31.348855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:31.348855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:31.348855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:31.348855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:31.348855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:31.348855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:31.348855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:31.348855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:31.348855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:31.348855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:03:31.350141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d065d-a69b-4a9b-a931-21a3f5f866a7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:31.350259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 35/70] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:03:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:31.350259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baeb87-012c-4ce6-a131-255312621d5e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:31.350259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baeb87-012c-4ce6-a131-255312621d5e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:31.350259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baeb87-012c-4ce6-a131-255312621d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:31.365340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-86baeb87-012c-4ce6-a131-255312621d5e None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:31.365981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 36/71] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:03:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:31.366579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-86baeb87-012c-4ce6-a131-255312621d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:31.366834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d065d-a69b-4a9b-a931-21a3f5f866a7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:31.434169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:31.438221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 36/72] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:31.439784 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c3a1d-1769-477d-9888-7fa27e896da0 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:31.440076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c3a1d-1769-477d-9888-7fa27e896da0 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:31.440415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c3a1d-1769-477d-9888-7fa27e896da0 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:31.441876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 37/73] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:31.447645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c3a1d-1769-477d-9888-7fa27e896da0 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:31.475830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d065d-a69b-4a9b-a931-21a3f5f866a7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:31.476745 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:31.525066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1eae9c-fe2b-4015-ae06-12c9524cce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:31.525870 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1eae9c-fe2b-4015-ae06-12c9524cce94 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:31.526154 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1eae9c-fe2b-4015-ae06-12c9524cce94 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:31.526453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1eae9c-fe2b-4015-ae06-12c9524cce94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:31.537580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1eae9c-fe2b-4015-ae06-12c9524cce94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:31.545576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-0d1eae9c-fe2b-4015-ae06-12c9524cce94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:03:31.545576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:31.545576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:31.545576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:31.545576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:31.545576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:31.545576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:31.545576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:31.545576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:31.545576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:31.545576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:31.545576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:31.545576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:31.545576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:31.545576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:31.545576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:31.546604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:31.546604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:31.546604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:31.546604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:31.546604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:31.546604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:31.546604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:31.546604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:31.546604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:31.546604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:31.546604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:31.546604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:31.546604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:31.546604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:31.546604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:31.546604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:31.547476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:31.547476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:31.547476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:31.547476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:31.547476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:31.547476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:31.547476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:31.547476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:31.547476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:31.547476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:31.547476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:03:31.547476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:03:31.547476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 37/74] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:03:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:31.548200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1eae9c-fe2b-4015-ae06-12c9524cce94 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:31.573169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c3a1d-1769-477d-9888-7fa27e896da0 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:31.608021 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb19a0-dd18-4e4b-98f6-886bb02ad031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:31.608691 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb19a0-dd18-4e4b-98f6-886bb02ad031 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:31.608972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb19a0-dd18-4e4b-98f6-886bb02ad031 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:31.609246 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb19a0-dd18-4e4b-98f6-886bb02ad031 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:31.609994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb19a0-dd18-4e4b-98f6-886bb02ad031 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:31.610296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb19a0-dd18-4e4b-98f6-886bb02ad031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:31.611722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb19a0-dd18-4e4b-98f6-886bb02ad031 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:31.620111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 38/75] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:31.621347 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacdfb7-5af1-493a-abc1-18e996518e5e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:31.621635 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacdfb7-5af1-493a-abc1-18e996518e5e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:31.621915 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacdfb7-5af1-493a-abc1-18e996518e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:31.638597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-2eacdfb7-5af1-493a-abc1-18e996518e5e None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:31.639849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2eacdfb7-5af1-493a-abc1-18e996518e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:31.655165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1eae9c-fe2b-4015-ae06-12c9524cce94 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:31.684141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:31.703091 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ee4d3-fe4f-4c2f-a9c8-e73cc08ce2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:31.703985 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee4d3-fe4f-4c2f-a9c8-e73cc08ce2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:31.704295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee4d3-fe4f-4c2f-a9c8-e73cc08ce2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:31.704571 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ee4d3-fe4f-4c2f-a9c8-e73cc08ce2d3 None admin] PATH_INFO: `/v3/users/9a6745d8d2ca460e887dba39a4d91854` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:31.710794 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 39/76] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:31.711653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacdfb7-5af1-493a-abc1-18e996518e5e None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:31.721664 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:31.729317 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ee4d3-fe4f-4c2f-a9c8-e73cc08ce2d3 None admin] RBAC: Authorizing `identity:get_user(user_id=9a6745d8d2ca460e887dba39a4d91854)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:31.730844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ee4d3-fe4f-4c2f-a9c8-e73cc08ce2d3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:31.732794 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 38/77] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:31 2022] GET /identity/v3/users/9a6745d8d2ca460e887dba39a4d91854 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:31.733466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ee4d3-fe4f-4c2f-a9c8-e73cc08ce2d3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:31.816027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacdfb7-5af1-493a-abc1-18e996518e5e None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:31.846222 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ee4d3-fe4f-4c2f-a9c8-e73cc08ce2d3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:31.852590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27731a39-163a-437f-b80d-41c0e085ec3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:31.853400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27731a39-163a-437f-b80d-41c0e085ec3d None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:31.853685 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27731a39-163a-437f-b80d-41c0e085ec3d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:31.854376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27731a39-163a-437f-b80d-41c0e085ec3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:31.866073 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27731a39-163a-437f-b80d-41c0e085ec3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:31.873800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-27731a39-163a-437f-b80d-41c0e085ec3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:31.873800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:31.873800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:31.873800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:31.873800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:31.873800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:31.873800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:31.873800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:31.873800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:31.873800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:31.873800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:31.873800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:31.873800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:31.873800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:31.873800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:31.873800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:31.875084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:31.875084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:31.875084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:31.875084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:31.875084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:31.875084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:31.875084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:31.875084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:31.875084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:31.875084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:31.875084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:31.875084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:31.875084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:31.875084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:31.875084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:31.875084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:31.881321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:31.881321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:31.881321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:31.881321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:31.881321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:31.881321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:31.881321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:31.881321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:31.881321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:31.881321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:31.881321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:31.881321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:03:31.881321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 40/78] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:31.881321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27731a39-163a-437f-b80d-41c0e085ec3d None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:31.883638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a02d72-bdcf-42cc-9acb-d239e8fc6176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:31.884461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a02d72-bdcf-42cc-9acb-d239e8fc6176 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:31.884657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a02d72-bdcf-42cc-9acb-d239e8fc6176 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:31.884939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a02d72-bdcf-42cc-9acb-d239e8fc6176 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:31.885709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a02d72-bdcf-42cc-9acb-d239e8fc6176 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:31.886023 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a02d72-bdcf-42cc-9acb-d239e8fc6176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:31.887599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a02d72-bdcf-42cc-9acb-d239e8fc6176 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:31.897025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 39/79] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:03:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:31.897871 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a02d72-bdcf-42cc-9acb-d239e8fc6176 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:31.948309 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:31.952228 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:31.997350 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27731a39-163a-437f-b80d-41c0e085ec3d None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:32.016981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a02d72-bdcf-42cc-9acb-d239e8fc6176 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:32.035612 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee6441-b3f9-4e2a-ae33-e57edf5ec5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:32.037159 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee6441-b3f9-4e2a-ae33-e57edf5ec5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:32.037678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee6441-b3f9-4e2a-ae33-e57edf5ec5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:32.038188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee6441-b3f9-4e2a-ae33-e57edf5ec5f6 None admin] PATH_INFO: `/v3/users/920f62903fc54cf3b0dedf0810c30914` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:32.040132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee6441-b3f9-4e2a-ae33-e57edf5ec5f6 None admin] RBAC: Authorizing `identity:get_user(user_id=920f62903fc54cf3b0dedf0810c30914)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:32.042656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee6441-b3f9-4e2a-ae33-e57edf5ec5f6 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:32.045641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 41/80] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:31 2022] GET /identity/v3/users/920f62903fc54cf3b0dedf0810c30914 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:32.046421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee6441-b3f9-4e2a-ae33-e57edf5ec5f6 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:32.069462 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b9eae-36c1-4197-b4de-709672790ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:32.070120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b9eae-36c1-4197-b4de-709672790ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:32.070413 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b9eae-36c1-4197-b4de-709672790ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:32.070720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b9eae-36c1-4197-b4de-709672790ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:32.149949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b9eae-36c1-4197-b4de-709672790ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:32.151694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b9eae-36c1-4197-b4de-709672790ba0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:32.156753 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee6441-b3f9-4e2a-ae33-e57edf5ec5f6 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:32.191799 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d852485-c469-4f1b-bfe5-1f5e7147f1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:32.192610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d852485-c469-4f1b-bfe5-1f5e7147f1bb None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:32.192899 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d852485-c469-4f1b-bfe5-1f5e7147f1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:32.193205 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d852485-c469-4f1b-bfe5-1f5e7147f1bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:32.194629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d852485-c469-4f1b-bfe5-1f5e7147f1bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:32.196111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d852485-c469-4f1b-bfe5-1f5e7147f1bb None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:32.197019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:32.197779 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 42/81] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:03:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:32.198795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d852485-c469-4f1b-bfe5-1f5e7147f1bb None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:32.206897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:32.258343 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 40/82] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:32.259237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b9eae-36c1-4197-b4de-709672790ba0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:32.326292 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d852485-c469-4f1b-bfe5-1f5e7147f1bb None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:32.360869 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d169fd-9de2-4a60-a7a3-8c9560d2abf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:32.361537 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d169fd-9de2-4a60-a7a3-8c9560d2abf0 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:32.361824 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d169fd-9de2-4a60-a7a3-8c9560d2abf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:32.362127 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d169fd-9de2-4a60-a7a3-8c9560d2abf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:32.362933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d169fd-9de2-4a60-a7a3-8c9560d2abf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:32.363241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d169fd-9de2-4a60-a7a3-8c9560d2abf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:32.364667 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d169fd-9de2-4a60-a7a3-8c9560d2abf0 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:32.368463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b9eae-36c1-4197-b4de-709672790ba0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:32.373579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 43/83] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:03:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:32.374338 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d169fd-9de2-4a60-a7a3-8c9560d2abf0 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:32.406168 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36f766-ddc0-4ab7-bf26-d4ca8d0533d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:32.407006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36f766-ddc0-4ab7-bf26-d4ca8d0533d2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:32.407298 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36f766-ddc0-4ab7-bf26-d4ca8d0533d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:32.407580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36f766-ddc0-4ab7-bf26-d4ca8d0533d2 None admin] PATH_INFO: `/v3/users/9a6745d8d2ca460e887dba39a4d91854` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:32.408798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36f766-ddc0-4ab7-bf26-d4ca8d0533d2 None admin] RBAC: Authorizing `identity:get_user(user_id=9a6745d8d2ca460e887dba39a4d91854)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:32.410281 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36f766-ddc0-4ab7-bf26-d4ca8d0533d2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:32.411968 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 41/84] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:32 2022] GET /identity/v3/users/9a6745d8d2ca460e887dba39a4d91854 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:32.412709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36f766-ddc0-4ab7-bf26-d4ca8d0533d2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:32.427661 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:32.457111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:32.494139 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d169fd-9de2-4a60-a7a3-8c9560d2abf0 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:32.526707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36f766-ddc0-4ab7-bf26-d4ca8d0533d2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:32.531903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2669f8-9b6d-433d-a8ca-e3ce95b8e3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:32.532578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2669f8-9b6d-433d-a8ca-e3ce95b8e3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:32.532868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2669f8-9b6d-433d-a8ca-e3ce95b8e3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:32.533149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2669f8-9b6d-433d-a8ca-e3ce95b8e3f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:32.563745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70b139-e556-4bfa-947e-dbe5ff66cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:32.564419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70b139-e556-4bfa-947e-dbe5ff66cb45 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:32.564705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70b139-e556-4bfa-947e-dbe5ff66cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:32.565051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70b139-e556-4bfa-947e-dbe5ff66cb45 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:32.565933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70b139-e556-4bfa-947e-dbe5ff66cb45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:32.571185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70b139-e556-4bfa-947e-dbe5ff66cb45 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:32.600181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 42/85] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:03:32 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:03:32.600808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70b139-e556-4bfa-947e-dbe5ff66cb45 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:32.619890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2669f8-9b6d-433d-a8ca-e3ce95b8e3f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:32.622052 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2669f8-9b6d-433d-a8ca-e3ce95b8e3f2 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:32.696854 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:32.708012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:32.740316 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70b139-e556-4bfa-947e-dbe5ff66cb45 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:32.757744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 44/86] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:32.758946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2669f8-9b6d-433d-a8ca-e3ce95b8e3f2 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:32.787476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1539e16-435a-4bb8-bd16-40ad46d32999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:32.788357 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1539e16-435a-4bb8-bd16-40ad46d32999 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:32.788644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1539e16-435a-4bb8-bd16-40ad46d32999 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:32.788918 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1539e16-435a-4bb8-bd16-40ad46d32999 None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:32.790438 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1539e16-435a-4bb8-bd16-40ad46d32999 None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:32.792422 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1539e16-435a-4bb8-bd16-40ad46d32999 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:32.798441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 43/87] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:32 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:32.798441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1539e16-435a-4bb8-bd16-40ad46d32999 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:32.896543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2669f8-9b6d-433d-a8ca-e3ce95b8e3f2 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:32.935690 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1539e16-435a-4bb8-bd16-40ad46d32999 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:32.942491 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef461c-ddd1-449d-85e3-7d3e9fba2d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:32.943356 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef461c-ddd1-449d-85e3-7d3e9fba2d0e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:32.943641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef461c-ddd1-449d-85e3-7d3e9fba2d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:32.944150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef461c-ddd1-449d-85e3-7d3e9fba2d0e None admin] PATH_INFO: `/v3/users/9a6745d8d2ca460e887dba39a4d91854` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:32.945489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef461c-ddd1-449d-85e3-7d3e9fba2d0e None admin] RBAC: Authorizing `identity:get_user(user_id=9a6745d8d2ca460e887dba39a4d91854)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:32.947108 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef461c-ddd1-449d-85e3-7d3e9fba2d0e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:32.948761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 45/88] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:32 2022] GET /identity/v3/users/9a6745d8d2ca460e887dba39a4d91854 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:32.949559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef461c-ddd1-449d-85e3-7d3e9fba2d0e None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:32.985787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b25f7-f5af-4f59-a314-b732cb689e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:32.986574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b25f7-f5af-4f59-a314-b732cb689e86 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:32.986873 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b25f7-f5af-4f59-a314-b732cb689e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:32.987224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b25f7-f5af-4f59-a314-b732cb689e86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:32.991255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:32.994565 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:33.071325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b25f7-f5af-4f59-a314-b732cb689e86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:33.073725 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b25f7-f5af-4f59-a314-b732cb689e86 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:33.078141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef461c-ddd1-449d-85e3-7d3e9fba2d0e None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:33.127867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe81dc-e7de-4ab7-852c-31b2bc6ad35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:33.128750 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe81dc-e7de-4ab7-852c-31b2bc6ad35d None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:33.129034 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe81dc-e7de-4ab7-852c-31b2bc6ad35d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:33.129308 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe81dc-e7de-4ab7-852c-31b2bc6ad35d None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:33.130875 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe81dc-e7de-4ab7-852c-31b2bc6ad35d None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:33.132344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe81dc-e7de-4ab7-852c-31b2bc6ad35d None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:33.138516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 46/89] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:32 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:33.139452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe81dc-e7de-4ab7-852c-31b2bc6ad35d None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:33.206776 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 44/90] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:33.208094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b25f7-f5af-4f59-a314-b732cb689e86 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:33.259473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:33.276335 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe81dc-e7de-4ab7-852c-31b2bc6ad35d None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:33.279443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:33.326523 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487fc4a-4c70-4b4a-a684-0caa9277bf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:33.327971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487fc4a-4c70-4b4a-a684-0caa9277bf93 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:33.328464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487fc4a-4c70-4b4a-a684-0caa9277bf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:33.329232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487fc4a-4c70-4b4a-a684-0caa9277bf93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:33.330620 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487fc4a-4c70-4b4a-a684-0caa9277bf93 None admin] RBAC: Adding query filter params (role.id=9e92f0503b5c47a4a7368e618f37c6ae, scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05, user.id=9a6745d8d2ca460e887dba39a4d91854) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:33.331247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487fc4a-4c70-4b4a-a684-0caa9277bf93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:33.332914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487fc4a-4c70-4b4a-a684-0caa9277bf93 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:33.341034 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 47/91] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:33 2022] GET /identity/v3/role_assignments?user.id=9a6745d8d2ca460e887dba39a4d91854&scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05&role.id=9e92f0503b5c47a4a7368e618f37c6ae => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:33.342198 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487fc4a-4c70-4b4a-a684-0caa9277bf93 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:33.359370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b25f7-f5af-4f59-a314-b732cb689e86 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:33.403521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdc641-3cab-4d34-a017-69d76bd53c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:33.404216 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdc641-3cab-4d34-a017-69d76bd53c59 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:33.404519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdc641-3cab-4d34-a017-69d76bd53c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:33.404795 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdc641-3cab-4d34-a017-69d76bd53c59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:33.485050 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdc641-3cab-4d34-a017-69d76bd53c59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:33.486842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cdc641-3cab-4d34-a017-69d76bd53c59 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:33.493602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487fc4a-4c70-4b4a-a684-0caa9277bf93 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:33.526219 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:33.537647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172c7bd-04a8-45a0-9bec-dc228eb4732f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:33.538746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172c7bd-04a8-45a0-9bec-dc228eb4732f None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:33.539249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172c7bd-04a8-45a0-9bec-dc228eb4732f None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:33.539718 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172c7bd-04a8-45a0-9bec-dc228eb4732f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:33.540910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172c7bd-04a8-45a0-9bec-dc228eb4732f None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05, user.id=920f62903fc54cf3b0dedf0810c30914) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:33.541424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172c7bd-04a8-45a0-9bec-dc228eb4732f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:33.543159 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172c7bd-04a8-45a0-9bec-dc228eb4732f None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:33.550488 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 48/92] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:33 2022] GET /identity/v3/role_assignments?user.id=920f62903fc54cf3b0dedf0810c30914&scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:33.551804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172c7bd-04a8-45a0-9bec-dc228eb4732f None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:33.588888 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:33.657187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 45/93] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:33.663051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdc641-3cab-4d34-a017-69d76bd53c59 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:33.675126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172c7bd-04a8-45a0-9bec-dc228eb4732f None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:33.718472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c41db-cfb9-4ecd-ab18-0394fa4ecddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:33.719769 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c41db-cfb9-4ecd-ab18-0394fa4ecddb None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:33.720259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c41db-cfb9-4ecd-ab18-0394fa4ecddb None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:33.720816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c41db-cfb9-4ecd-ab18-0394fa4ecddb None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:33.722654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c41db-cfb9-4ecd-ab18-0394fa4ecddb None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:33.724535 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c41db-cfb9-4ecd-ab18-0394fa4ecddb None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:33.727143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 49/94] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:33 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:33.733630 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c41db-cfb9-4ecd-ab18-0394fa4ecddb None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:33.846017 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:33.852231 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c41db-cfb9-4ecd-ab18-0394fa4ecddb None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:33.889182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1ef8c-a076-4fba-a399-addf0672b14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:33.890210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1ef8c-a076-4fba-a399-addf0672b14d None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:33.890714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1ef8c-a076-4fba-a399-addf0672b14d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:33.891186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1ef8c-a076-4fba-a399-addf0672b14d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:33.892414 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1ef8c-a076-4fba-a399-addf0672b14d None admin] RBAC: Adding query filter params (role.id=2e761f6eaaa94f9e85d77734e01ac393, scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05, user.id=9a6745d8d2ca460e887dba39a4d91854) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:33.892947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1ef8c-a076-4fba-a399-addf0672b14d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:33.894742 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1ef8c-a076-4fba-a399-addf0672b14d None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:33.901177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 50/95] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:33 2022] GET /identity/v3/role_assignments?user.id=9a6745d8d2ca460e887dba39a4d91854&scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05&role.id=2e761f6eaaa94f9e85d77734e01ac393 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:33.920452 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cdc641-3cab-4d34-a017-69d76bd53c59 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:33.974257 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77d2ce-0c1c-4a6c-bc0b-1fed0d8662f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:33.975171 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77d2ce-0c1c-4a6c-bc0b-1fed0d8662f8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:33.975456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77d2ce-0c1c-4a6c-bc0b-1fed0d8662f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:33.975734 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77d2ce-0c1c-4a6c-bc0b-1fed0d8662f8 None admin] PATH_INFO: `/v3/projects/6ef6874e447f44d6b362f38a5c0c7882` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:33.976959 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77d2ce-0c1c-4a6c-bc0b-1fed0d8662f8 None admin] RBAC: Authorizing `identity:get_project(project_id=6ef6874e447f44d6b362f38a5c0c7882)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:33.978461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77d2ce-0c1c-4a6c-bc0b-1fed0d8662f8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:33.980216 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 46/96] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:33 2022] GET /identity/v3/projects/6ef6874e447f44d6b362f38a5c0c7882 => generated 312 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:33.986544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1ef8c-a076-4fba-a399-addf0672b14d None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:34.120087 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1ef8c-a076-4fba-a399-addf0672b14d None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:34.158486 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d8c18-e33d-49a6-a18d-15c8bb7fb5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:34.159244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d8c18-e33d-49a6-a18d-15c8bb7fb5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:34.159542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d8c18-e33d-49a6-a18d-15c8bb7fb5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:34.159821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d8c18-e33d-49a6-a18d-15c8bb7fb5f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:34.160701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d8c18-e33d-49a6-a18d-15c8bb7fb5f4 None admin] RBAC: Adding query filter params (role.id=9e92f0503b5c47a4a7368e618f37c6ae, scope.project.id=6ef6874e447f44d6b362f38a5c0c7882, user.id=9a6745d8d2ca460e887dba39a4d91854) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:34.161018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d8c18-e33d-49a6-a18d-15c8bb7fb5f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:34.162574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d8c18-e33d-49a6-a18d-15c8bb7fb5f4 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:34.169607 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 51/97] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:33 2022] GET /identity/v3/role_assignments?user.id=9a6745d8d2ca460e887dba39a4d91854&scope.project.id=6ef6874e447f44d6b362f38a5c0c7882&role.id=9e92f0503b5c47a4a7368e618f37c6ae => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:35.512578 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814191ee-b4e6-44dc-b9d4-4bb6814c1045 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:35.513069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814191ee-b4e6-44dc-b9d4-4bb6814c1045 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:35.513069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814191ee-b4e6-44dc-b9d4-4bb6814c1045 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:35.514437 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 47/98] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:35.519900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f490a-5c4b-4775-a74e-b6fcb50bed30 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:35.520438 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f490a-5c4b-4775-a74e-b6fcb50bed30 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:35.520537 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f490a-5c4b-4775-a74e-b6fcb50bed30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:35.543442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-ea0f490a-5c4b-4775-a74e-b6fcb50bed30 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:35.544831 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ea0f490a-5c4b-4775-a74e-b6fcb50bed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:35.566514 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:35.623343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 52/99] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:03:35.649811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b674d-90d4-4f69-91c4-0477d10c9cae None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:35.650096 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b674d-90d4-4f69-91c4-0477d10c9cae None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:35.650374 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b674d-90d4-4f69-91c4-0477d10c9cae None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:35.651779 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 48/100] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:35.658194 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f490a-5c4b-4775-a74e-b6fcb50bed30 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:35.662141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab8807-e29e-4af5-b49b-e7cf0268be72 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:35.662446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab8807-e29e-4af5-b49b-e7cf0268be72 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:35.662726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab8807-e29e-4af5-b49b-e7cf0268be72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:35.671182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:35.692156 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-24ab8807-e29e-4af5-b49b-e7cf0268be72 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:35.693357 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-24ab8807-e29e-4af5-b49b-e7cf0268be72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:35.838979 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 49/101] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:03:35.845909 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f490a-5c4b-4775-a74e-b6fcb50bed30 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:35.879911 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab8807-e29e-4af5-b49b-e7cf0268be72 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:35.930902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418163b-2589-4d8f-be68-6cd821ce9925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:35.931721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418163b-2589-4d8f-be68-6cd821ce9925 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:35.932007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418163b-2589-4d8f-be68-6cd821ce9925 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:35.932288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418163b-2589-4d8f-be68-6cd821ce9925 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:35.934729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418163b-2589-4d8f-be68-6cd821ce9925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:35.936204 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418163b-2589-4d8f-be68-6cd821ce9925 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:35.937859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 53/102] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:03:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:35.943981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418163b-2589-4d8f-be68-6cd821ce9925 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:35.995606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:36.076723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab8807-e29e-4af5-b49b-e7cf0268be72 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:36.132188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418163b-2589-4d8f-be68-6cd821ce9925 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:36.146830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286d483-f635-4468-8cab-1e71281a08c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:36.147796 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286d483-f635-4468-8cab-1e71281a08c3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:36.147980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286d483-f635-4468-8cab-1e71281a08c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:36.148188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286d483-f635-4468-8cab-1e71281a08c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:36.150238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:36.165923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286d483-f635-4468-8cab-1e71281a08c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:36.174015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-4286d483-f635-4468-8cab-1e71281a08c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:03:36.174015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:36.174015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:36.174015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:36.174015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:36.174015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:36.174015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:36.174015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:36.174015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:36.174015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:36.174015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:36.174015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:36.174015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:36.174015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:36.174015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:36.174015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:36.175018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:36.175018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:36.175018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:36.175018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:36.175018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:36.175018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:36.175018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:36.175018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:36.175018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:36.175018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:36.175018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:36.175018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:36.175018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:36.175018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:36.175018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:36.175018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:36.175768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:36.175768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:36.175768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:36.175768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:36.175768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:36.175768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:36.175768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:36.175768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:36.175768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:36.175768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:36.175768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:03:36.175768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:03:36.178108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 50/103] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:36.189321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286d483-f635-4468-8cab-1e71281a08c3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:36.225111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836c2c8-ac2e-43cd-8923-cd84f99c6d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:36.225861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836c2c8-ac2e-43cd-8923-cd84f99c6d19 None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:36.226371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836c2c8-ac2e-43cd-8923-cd84f99c6d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:36.226489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836c2c8-ac2e-43cd-8923-cd84f99c6d19 None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:36.227185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836c2c8-ac2e-43cd-8923-cd84f99c6d19 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:36.228768 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836c2c8-ac2e-43cd-8923-cd84f99c6d19 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:36.280039 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 54/104] 10.222.0.99 () {60 vars in 1141 bytes} [Mon Jul 18 14:03:35 2022] POST /identity/v3/projects => generated 302 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:03:36.281441 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a87e70-7737-4222-9d08-315599c7582e None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:36.281739 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a87e70-7737-4222-9d08-315599c7582e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:36.283053 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a87e70-7737-4222-9d08-315599c7582e None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:36.284612 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 55/105] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:36.292119 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca0ecc-2103-4bce-ae7d-1a8e131ab8f1 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:36.292423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca0ecc-2103-4bce-ae7d-1a8e131ab8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:36.292691 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca0ecc-2103-4bce-ae7d-1a8e131ab8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:36.323620 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-9cca0ecc-2103-4bce-ae7d-1a8e131ab8f1 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:36.325158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9cca0ecc-2103-4bce-ae7d-1a8e131ab8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:36.401086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286d483-f635-4468-8cab-1e71281a08c3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:36.421668 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 56/106] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:36.423569 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e018a4-dc43-46e5-9eba-783402b07744 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:36.423910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e018a4-dc43-46e5-9eba-783402b07744 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:36.424249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e018a4-dc43-46e5-9eba-783402b07744 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:36.425690 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 57/107] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:36.432244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e6431-5098-474d-9c64-b5de046bae54 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:36.432531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e6431-5098-474d-9c64-b5de046bae54 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:36.432905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e6431-5098-474d-9c64-b5de046bae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:36.454772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:36.462997 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-a42e6431-5098-474d-9c64-b5de046bae54 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:36.472107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a42e6431-5098-474d-9c64-b5de046bae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:36.484080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dcb74-c341-4821-8839-dc0c3c8e90ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:36.484760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dcb74-c341-4821-8839-dc0c3c8e90ec None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:36.485043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dcb74-c341-4821-8839-dc0c3c8e90ec None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:36.485415 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dcb74-c341-4821-8839-dc0c3c8e90ec None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:36.486183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dcb74-c341-4821-8839-dc0c3c8e90ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:36.486518 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dcb74-c341-4821-8839-dc0c3c8e90ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:36.488045 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dcb74-c341-4821-8839-dc0c3c8e90ec None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:36.500189 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 51/108] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:03:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:36.503541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dcb74-c341-4821-8839-dc0c3c8e90ec None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:36.549750 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 58/109] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:36.550648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e6431-5098-474d-9c64-b5de046bae54 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:36.574811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:36.624251 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dcb74-c341-4821-8839-dc0c3c8e90ec None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:36.664814 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e6431-5098-474d-9c64-b5de046bae54 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:36.670779 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbad4d3-ef0a-49f0-8f2c-a426fca8b20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:36.671792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbad4d3-ef0a-49f0-8f2c-a426fca8b20d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:36.672218 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbad4d3-ef0a-49f0-8f2c-a426fca8b20d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:36.673127 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbad4d3-ef0a-49f0-8f2c-a426fca8b20d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:36.688255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbad4d3-ef0a-49f0-8f2c-a426fca8b20d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:36.700124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-7cbad4d3-ef0a-49f0-8f2c-a426fca8b20d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:36.700124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:36.700124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:36.700124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:36.700124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:36.700124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:36.700124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:36.700124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:36.700124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:36.700124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:36.700124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:36.700124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:36.700124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:36.700124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:36.700124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:36.700124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:36.701199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:36.701199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:36.701199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:36.701199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:36.701199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:36.701199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:36.701199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:36.701199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:36.701199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:36.701199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:36.701199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:36.701199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:36.701199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:36.701199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:36.701199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:36.701199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:36.702157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:36.702157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:36.702157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:36.702157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:36.702157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:36.702157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:36.702157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:36.702157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:36.702157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:36.702157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:36.702157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:36.702157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:03:36.704500 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe61d8f-aa7b-42d6-a5ce-b476545c772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:36.704740 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 52/110] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:36.705549 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe61d8f-aa7b-42d6-a5ce-b476545c772e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:36.705967 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe61d8f-aa7b-42d6-a5ce-b476545c772e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:36.706071 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbad4d3-ef0a-49f0-8f2c-a426fca8b20d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:36.710932 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe61d8f-aa7b-42d6-a5ce-b476545c772e None admin] PATH_INFO: `/v3/users/1d7ed5cfa594485589783f9872f16c01` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:36.715194 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:36.742436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe61d8f-aa7b-42d6-a5ce-b476545c772e None admin] RBAC: Authorizing `identity:get_user(user_id=1d7ed5cfa594485589783f9872f16c01)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:36.746689 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe61d8f-aa7b-42d6-a5ce-b476545c772e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:36.748698 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 59/111] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:36 2022] GET /identity/v3/users/1d7ed5cfa594485589783f9872f16c01 => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:36.749267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe61d8f-aa7b-42d6-a5ce-b476545c772e None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:36.897870 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe61d8f-aa7b-42d6-a5ce-b476545c772e None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:36.917452 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbad4d3-ef0a-49f0-8f2c-a426fca8b20d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:36.933613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b675e7-edbc-4bef-816f-856b4d8c2ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:36.934661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b675e7-edbc-4bef-816f-856b4d8c2ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:36.935157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b675e7-edbc-4bef-816f-856b4d8c2ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:36.935621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b675e7-edbc-4bef-816f-856b4d8c2ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:36.936581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b675e7-edbc-4bef-816f-856b4d8c2ef8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:36.937076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b675e7-edbc-4bef-816f-856b4d8c2ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:36.939259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b675e7-edbc-4bef-816f-856b4d8c2ef8 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:36.948405 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 60/112] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:03:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:36.949599 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b675e7-edbc-4bef-816f-856b4d8c2ef8 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:36.958757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:36.973837 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad1e43-1840-4bb4-8a00-176934f7b943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:36.974682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad1e43-1840-4bb4-8a00-176934f7b943 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:36.975021 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad1e43-1840-4bb4-8a00-176934f7b943 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:36.975303 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad1e43-1840-4bb4-8a00-176934f7b943 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:36.991495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad1e43-1840-4bb4-8a00-176934f7b943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:37.004466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-46ad1e43-1840-4bb4-8a00-176934f7b943 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:37.004466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:37.004466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:37.004466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:37.004466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:37.004466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:37.004466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:37.004466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:37.004466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:37.004466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:37.004466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:37.004466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:37.004466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:37.004466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:37.004466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:37.004466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:37.005324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:37.005324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:37.005324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:37.005324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:37.005324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:37.005324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:37.005324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:37.005324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:37.005324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:37.005324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:37.005324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:37.005324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:37.005324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:37.005324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:37.005324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:37.005324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:37.006068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:37.006068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:37.006068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:37.006068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:37.006068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:37.006068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:37.006068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:37.006068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:37.006068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:37.006068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:37.006068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:37.006068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:03:37.010418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 53/113] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:03:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:37.010974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad1e43-1840-4bb4-8a00-176934f7b943 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:37.043296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:37.120074 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b675e7-edbc-4bef-816f-856b4d8c2ef8 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:37.155054 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48eb40a-6dab-42da-bced-c95403bb9aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:37.156363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eb40a-6dab-42da-bced-c95403bb9aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:37.156799 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eb40a-6dab-42da-bced-c95403bb9aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:37.157181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eb40a-6dab-42da-bced-c95403bb9aa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:37.238682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad1e43-1840-4bb4-8a00-176934f7b943 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:37.272852 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48eb40a-6dab-42da-bced-c95403bb9aa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:37.274830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48eb40a-6dab-42da-bced-c95403bb9aa4 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:37.287898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d941f-f653-4c7e-8292-ae644756c462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:37.288786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d941f-f653-4c7e-8292-ae644756c462 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:37.289074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d941f-f653-4c7e-8292-ae644756c462 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:37.289356 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d941f-f653-4c7e-8292-ae644756c462 None admin] PATH_INFO: `/v3/users/9a6745d8d2ca460e887dba39a4d91854` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:37.290695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d941f-f653-4c7e-8292-ae644756c462 None admin] RBAC: Authorizing `identity:get_user(user_id=9a6745d8d2ca460e887dba39a4d91854)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:37.292176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d941f-f653-4c7e-8292-ae644756c462 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:37.293892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 54/114] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:37 2022] GET /identity/v3/users/9a6745d8d2ca460e887dba39a4d91854 => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:37.294763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d941f-f653-4c7e-8292-ae644756c462 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:37.341554 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:37.343877 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:37.392076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 61/115] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:37.393272 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8e52a-0e63-47c1-aa26-62c6253d769a None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:37.393566 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8e52a-0e63-47c1-aa26-62c6253d769a None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:37.393839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8e52a-0e63-47c1-aa26-62c6253d769a None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:37.395341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 62/116] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:37.396850 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c131e-3fe6-465f-918f-ebdc72b9c581 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:37.397138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c131e-3fe6-465f-918f-ebdc72b9c581 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:37.397582 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c131e-3fe6-465f-918f-ebdc72b9c581 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:37.399364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 63/117] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:37.400374 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c131e-3fe6-465f-918f-ebdc72b9c581 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:37.403158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d941f-f653-4c7e-8292-ae644756c462 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:37.446500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6cc2a-e766-4b2f-87ed-4232bd7b635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:37.447186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6cc2a-e766-4b2f-87ed-4232bd7b635c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:37.447473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6cc2a-e766-4b2f-87ed-4232bd7b635c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:37.447751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6cc2a-e766-4b2f-87ed-4232bd7b635c None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:37.449313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6cc2a-e766-4b2f-87ed-4232bd7b635c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:37.450009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6cc2a-e766-4b2f-87ed-4232bd7b635c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:37.451751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6cc2a-e766-4b2f-87ed-4232bd7b635c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:37.461251 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 55/118] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:37.462064 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6cc2a-e766-4b2f-87ed-4232bd7b635c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:37.518829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c131e-3fe6-465f-918f-ebdc72b9c581 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:37.555552 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb5221-cfe3-404b-993e-e748b1133401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:37.556408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb5221-cfe3-404b-993e-e748b1133401 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:37.556706 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb5221-cfe3-404b-993e-e748b1133401 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:37.556980 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb5221-cfe3-404b-993e-e748b1133401 None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:37.558310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb5221-cfe3-404b-993e-e748b1133401 None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:37.559811 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb5221-cfe3-404b-993e-e748b1133401 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:37.561887 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 64/119] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:37 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:37.562886 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83bfa9-5d9f-49a0-9865-c9f20af46c1c None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:37.563330 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83bfa9-5d9f-49a0-9865-c9f20af46c1c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:37.563613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83bfa9-5d9f-49a0-9865-c9f20af46c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:37.571368 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6cc2a-e766-4b2f-87ed-4232bd7b635c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:37.578930 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:37.581056 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-cf83bfa9-5d9f-49a0-9865-c9f20af46c1c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:37.583175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-cf83bfa9-5d9f-49a0-9865-c9f20af46c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:37.601344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:37.607573 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59330ff8-09ab-4c78-b089-9a7e8694998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:37.608446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59330ff8-09ab-4c78-b089-9a7e8694998c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:37.608736 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59330ff8-09ab-4c78-b089-9a7e8694998c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:37.609019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59330ff8-09ab-4c78-b089-9a7e8694998c None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:37.610213 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59330ff8-09ab-4c78-b089-9a7e8694998c None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:37.611746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59330ff8-09ab-4c78-b089-9a7e8694998c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:37.618290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 56/120] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:37 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:37.618290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d462e9-b03b-40d0-8601-b8a5cecfa8e3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:37.618290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d462e9-b03b-40d0-8601-b8a5cecfa8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:37.618290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d462e9-b03b-40d0-8601-b8a5cecfa8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:37.632969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-57d462e9-b03b-40d0-8601-b8a5cecfa8e3 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:37.634178 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-57d462e9-b03b-40d0-8601-b8a5cecfa8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:37.674796 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 65/121] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:37.675519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83bfa9-5d9f-49a0-9865-c9f20af46c1c None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:37.701646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 57/122] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:37.702530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d462e9-b03b-40d0-8601-b8a5cecfa8e3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:37.794909 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83bfa9-5d9f-49a0-9865-c9f20af46c1c None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:37.819048 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d462e9-b03b-40d0-8601-b8a5cecfa8e3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:37.822230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:37.830956 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc5f2d-9bac-4bca-b7cf-01230005a03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:37.831788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc5f2d-9bac-4bca-b7cf-01230005a03c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:37.832068 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc5f2d-9bac-4bca-b7cf-01230005a03c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:37.832343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc5f2d-9bac-4bca-b7cf-01230005a03c None admin] PATH_INFO: `/v3/users/920f62903fc54cf3b0dedf0810c30914` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:37.833718 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc5f2d-9bac-4bca-b7cf-01230005a03c None admin] RBAC: Authorizing `identity:get_user(user_id=920f62903fc54cf3b0dedf0810c30914)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:37.835196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc5f2d-9bac-4bca-b7cf-01230005a03c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:37.836847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 66/123] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:37 2022] GET /identity/v3/users/920f62903fc54cf3b0dedf0810c30914 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:37.837606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc5f2d-9bac-4bca-b7cf-01230005a03c None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:37.856712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f7ffc-db0f-4975-97d9-213b7b2d42b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:37.857609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f7ffc-db0f-4975-97d9-213b7b2d42b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:37.857895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f7ffc-db0f-4975-97d9-213b7b2d42b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:37.858173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f7ffc-db0f-4975-97d9-213b7b2d42b5 None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05/users/9a6745d8d2ca460e887dba39a4d91854/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:37.860214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f7ffc-db0f-4975-97d9-213b7b2d42b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5562cd7183a40e6a7b3680cf02f3e05, user_id=9a6745d8d2ca460e887dba39a4d91854, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:37.861637 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f7ffc-db0f-4975-97d9-213b7b2d42b5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:37.862970 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:37.876169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 58/124] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:03:37 2022] PUT /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05/users/9a6745d8d2ca460e887dba39a4d91854/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:03:37.876602 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f7ffc-db0f-4975-97d9-213b7b2d42b5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:37.980124 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc5f2d-9bac-4bca-b7cf-01230005a03c None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:38.018992 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f7ffc-db0f-4975-97d9-213b7b2d42b5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:38.020290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3debd-3ae3-4746-9801-d5e8f09e833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:38.020975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3debd-3ae3-4746-9801-d5e8f09e833a None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:38.021264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3debd-3ae3-4746-9801-d5e8f09e833a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:38.021545 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3debd-3ae3-4746-9801-d5e8f09e833a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:38.022430 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3debd-3ae3-4746-9801-d5e8f09e833a None admin] RBAC: Adding query filter params (role.id=9b47e9314a0349539ef025e68cb2569a, scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05, user.id=1d7ed5cfa594485589783f9872f16c01) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:38.022756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3debd-3ae3-4746-9801-d5e8f09e833a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:38.024528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3debd-3ae3-4746-9801-d5e8f09e833a None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:38.030955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 67/125] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:37 2022] GET /identity/v3/role_assignments?user.id=1d7ed5cfa594485589783f9872f16c01&scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05&role.id=9b47e9314a0349539ef025e68cb2569a => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:38.031589 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3debd-3ae3-4746-9801-d5e8f09e833a None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:38.076350 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa674ec-f199-4842-ac35-11f05b91fa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:38.080521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa674ec-f199-4842-ac35-11f05b91fa4e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:38.081145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa674ec-f199-4842-ac35-11f05b91fa4e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:38.081618 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa674ec-f199-4842-ac35-11f05b91fa4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:38.097254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa674ec-f199-4842-ac35-11f05b91fa4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:38.107683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-bfa674ec-f199-4842-ac35-11f05b91fa4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:03:38.107683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:38.107683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:38.107683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:38.107683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:38.107683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:38.107683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:38.107683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:38.107683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:38.107683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:38.107683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:38.107683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:38.107683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:38.107683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:38.107683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:38.107683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:38.108613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:38.108613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:38.108613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:38.108613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:38.108613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:38.108613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:38.108613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:38.108613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:38.108613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:38.108613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:38.108613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:38.108613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:38.108613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:38.108613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:38.108613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:38.108613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:38.109354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:38.109354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:38.109354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:38.109354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:38.109354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:38.109354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:38.109354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:38.109354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:38.109354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:38.109354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:38.109354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:03:38.109354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:03:38.109354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 59/126] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:03:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:38.109958 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa674ec-f199-4842-ac35-11f05b91fa4e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:38.149592 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:38.156346 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:38.176085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3debd-3ae3-4746-9801-d5e8f09e833a None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:38.241195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5259f-d247-41d7-925e-f2a5f3fa6548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:38.242036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5259f-d247-41d7-925e-f2a5f3fa6548 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:38.242297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5259f-d247-41d7-925e-f2a5f3fa6548 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:38.242611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5259f-d247-41d7-925e-f2a5f3fa6548 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:38.257058 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a5259f-d247-41d7-925e-f2a5f3fa6548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:38.261163 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa674ec-f199-4842-ac35-11f05b91fa4e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:38.265351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-83a5259f-d247-41d7-925e-f2a5f3fa6548 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:38.265351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:38.265351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:38.265351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:38.265351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:38.265351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:38.265351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:38.265351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:38.265351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:38.265351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:38.265351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:38.265351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:38.265351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:38.265351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:38.265351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:38.265351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:38.266191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:38.266191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:38.266191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:38.266191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:38.266191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:38.266191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:38.266191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:38.266191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:38.266191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:38.266191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:38.266191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:38.266191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:38.266191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:38.266191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:38.266191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:38.266191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:38.270844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:38.270844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:38.270844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:38.270844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:38.270844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:38.270844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:38.270844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:38.270844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:38.270844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:38.270844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:38.270844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:38.270844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:03:38.270844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 68/127] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:38.270844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5259f-d247-41d7-925e-f2a5f3fa6548 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:38.307398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffd209-ede0-48de-bc43-1db9232b057f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:38.308634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffd209-ede0-48de-bc43-1db9232b057f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:38.309069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffd209-ede0-48de-bc43-1db9232b057f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:38.309491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffd209-ede0-48de-bc43-1db9232b057f None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:38.311665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffd209-ede0-48de-bc43-1db9232b057f None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:38.313587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffd209-ede0-48de-bc43-1db9232b057f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:38.315631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 60/128] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:38 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:38.316674 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffd209-ede0-48de-bc43-1db9232b057f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:38.407111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5259f-d247-41d7-925e-f2a5f3fa6548 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:38.415621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:38.426004 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffd209-ede0-48de-bc43-1db9232b057f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:38.446231 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6357f-2a44-47b3-9609-fd15779ef692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:38.447036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6357f-2a44-47b3-9609-fd15779ef692 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:38.447385 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6357f-2a44-47b3-9609-fd15779ef692 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:38.447729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6357f-2a44-47b3-9609-fd15779ef692 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:38.448799 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6357f-2a44-47b3-9609-fd15779ef692 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:38.448927 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6357f-2a44-47b3-9609-fd15779ef692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:38.450361 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6357f-2a44-47b3-9609-fd15779ef692 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:38.460166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 69/129] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:03:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:38.465565 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6357f-2a44-47b3-9609-fd15779ef692 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:38.467924 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3862e5-97bd-4676-98ea-716eee71e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:38.468908 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3862e5-97bd-4676-98ea-716eee71e25f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:38.469392 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3862e5-97bd-4676-98ea-716eee71e25f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:38.469867 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3862e5-97bd-4676-98ea-716eee71e25f None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:38.470910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3862e5-97bd-4676-98ea-716eee71e25f None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:38.471451 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3862e5-97bd-4676-98ea-716eee71e25f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:38.473143 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3862e5-97bd-4676-98ea-716eee71e25f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:38.477482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:38.484204 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 61/130] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:03:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:38.485278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3862e5-97bd-4676-98ea-716eee71e25f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:38.576264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6357f-2a44-47b3-9609-fd15779ef692 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:38.594910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3862e5-97bd-4676-98ea-716eee71e25f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:38.610872 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb91d5-84a8-4ccb-a916-ed9131dec07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:38.611728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb91d5-84a8-4ccb-a916-ed9131dec07a None admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:38.612045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb91d5-84a8-4ccb-a916-ed9131dec07a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:38.612327 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb91d5-84a8-4ccb-a916-ed9131dec07a None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05/users/920f62903fc54cf3b0dedf0810c30914/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:38.614341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb91d5-84a8-4ccb-a916-ed9131dec07a None admin] RBAC: Authorizing `identity:create_grant(project_id=c5562cd7183a40e6a7b3680cf02f3e05, user_id=920f62903fc54cf3b0dedf0810c30914, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:38.615977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb91d5-84a8-4ccb-a916-ed9131dec07a None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:38.634909 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941050b5-a9b2-4368-8dfb-7ce2302d8554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:38.636480 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941050b5-a9b2-4368-8dfb-7ce2302d8554 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:38.636966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941050b5-a9b2-4368-8dfb-7ce2302d8554 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:38.637509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941050b5-a9b2-4368-8dfb-7ce2302d8554 None admin] PATH_INFO: `/v3/users/9a6745d8d2ca460e887dba39a4d91854` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:38.644101 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 70/131] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:03:38 2022] PUT /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05/users/920f62903fc54cf3b0dedf0810c30914/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:03:38.644101 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb91d5-84a8-4ccb-a916-ed9131dec07a None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:38.645455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941050b5-a9b2-4368-8dfb-7ce2302d8554 None admin] RBAC: Authorizing `identity:get_user(user_id=9a6745d8d2ca460e887dba39a4d91854)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:38.647381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941050b5-a9b2-4368-8dfb-7ce2302d8554 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:38.649622 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 62/132] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:38 2022] GET /identity/v3/users/9a6745d8d2ca460e887dba39a4d91854 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:38.657235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941050b5-a9b2-4368-8dfb-7ce2302d8554 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:38.702419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:38.723643 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:38.765659 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb91d5-84a8-4ccb-a916-ed9131dec07a None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:38.829234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd99665-7eb4-4850-be5f-a119527c06ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:38.831187 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd99665-7eb4-4850-be5f-a119527c06ed None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:38.832480 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd99665-7eb4-4850-be5f-a119527c06ed None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:38.833118 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd99665-7eb4-4850-be5f-a119527c06ed None admin] PATH_INFO: `/v3/users/9a6745d8d2ca460e887dba39a4d91854` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:38.835772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd99665-7eb4-4850-be5f-a119527c06ed None admin] RBAC: Authorizing `identity:get_user(user_id=9a6745d8d2ca460e887dba39a4d91854)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:38.838333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd99665-7eb4-4850-be5f-a119527c06ed None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:38.841934 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 71/133] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:38 2022] GET /identity/v3/users/9a6745d8d2ca460e887dba39a4d91854 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:38.851400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1ac9d-f304-43d0-a28a-6d7ff17f1689 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:38.852218 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1ac9d-f304-43d0-a28a-6d7ff17f1689 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:38.852646 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1ac9d-f304-43d0-a28a-6d7ff17f1689 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:38.857647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 72/134] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:38.859191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1ac9d-f304-43d0-a28a-6d7ff17f1689 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:38.881264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941050b5-a9b2-4368-8dfb-7ce2302d8554 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:38.923609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca20a6c-c79f-4960-a898-9306ab8a3c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:38.925207 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca20a6c-c79f-4960-a898-9306ab8a3c97 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:38.925643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca20a6c-c79f-4960-a898-9306ab8a3c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:38.926165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca20a6c-c79f-4960-a898-9306ab8a3c97 None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:38.927693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca20a6c-c79f-4960-a898-9306ab8a3c97 None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:38.929328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca20a6c-c79f-4960-a898-9306ab8a3c97 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:38.931421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 63/135] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:38 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:38.932966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fe426-8598-418f-8d13-a7353ea2883a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:38.933409 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fe426-8598-418f-8d13-a7353ea2883a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:38.933881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fe426-8598-418f-8d13-a7353ea2883a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:38.952082 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e99fe426-8598-418f-8d13-a7353ea2883a None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:38.953575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e99fe426-8598-418f-8d13-a7353ea2883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:38.988511 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1ac9d-f304-43d0-a28a-6d7ff17f1689 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:39.046477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aa007-e450-4911-86ef-629534419e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:39.047823 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aa007-e450-4911-86ef-629534419e55 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:39.048806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aa007-e450-4911-86ef-629534419e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:39.049385 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aa007-e450-4911-86ef-629534419e55 None admin] PATH_INFO: `/v3/projects/6ef6874e447f44d6b362f38a5c0c7882` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:39.052977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0aa007-e450-4911-86ef-629534419e55 None admin] RBAC: Authorizing `identity:get_project(project_id=6ef6874e447f44d6b362f38a5c0c7882)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:39.054434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 64/136] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:39.056491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fe426-8598-418f-8d13-a7353ea2883a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:39.057201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0aa007-e450-4911-86ef-629534419e55 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:39.059139 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 73/137] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:38 2022] GET /identity/v3/projects/6ef6874e447f44d6b362f38a5c0c7882 => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:39.068973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aa007-e450-4911-86ef-629534419e55 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:39.073019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:39.100590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:39.237588 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aa007-e450-4911-86ef-629534419e55 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:39.239622 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fe426-8598-418f-8d13-a7353ea2883a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:39.298410 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb20c1-8d6f-41ba-a4d0-09f027979b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:39.300139 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb20c1-8d6f-41ba-a4d0-09f027979b25 None admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:39.301846 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb20c1-8d6f-41ba-a4d0-09f027979b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:39.302621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203660e-1252-423b-8091-a64674631926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:39.303073 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb20c1-8d6f-41ba-a4d0-09f027979b25 None admin] PATH_INFO: `/v3/projects/6ef6874e447f44d6b362f38a5c0c7882/users/9a6745d8d2ca460e887dba39a4d91854/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:39.304946 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203660e-1252-423b-8091-a64674631926 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:39.305901 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203660e-1252-423b-8091-a64674631926 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:39.306773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb20c1-8d6f-41ba-a4d0-09f027979b25 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ef6874e447f44d6b362f38a5c0c7882, user_id=9a6745d8d2ca460e887dba39a4d91854, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:39.307213 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203660e-1252-423b-8091-a64674631926 None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05/users/9a6745d8d2ca460e887dba39a4d91854/roles/2e761f6eaaa94f9e85d77734e01ac393` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:39.309406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb20c1-8d6f-41ba-a4d0-09f027979b25 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:39.311370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203660e-1252-423b-8091-a64674631926 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5562cd7183a40e6a7b3680cf02f3e05, user_id=9a6745d8d2ca460e887dba39a4d91854, role_id=2e761f6eaaa94f9e85d77734e01ac393)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:39.313813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203660e-1252-423b-8091-a64674631926 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:39.338067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 74/138] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:03:39 2022] PUT /identity/v3/projects/6ef6874e447f44d6b362f38a5c0c7882/users/9a6745d8d2ca460e887dba39a4d91854/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:03:39.339929 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 65/139] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:03:39 2022] PUT /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05/users/9a6745d8d2ca460e887dba39a4d91854/roles/2e761f6eaaa94f9e85d77734e01ac393 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:03:39.340416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb20c1-8d6f-41ba-a4d0-09f027979b25 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:39.415921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:39.468467 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb20c1-8d6f-41ba-a4d0-09f027979b25 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:39.520697 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342473b5-44f0-45cc-bbb0-2e33c3e0dda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:39.521896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342473b5-44f0-45cc-bbb0-2e33c3e0dda7 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:39.522345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342473b5-44f0-45cc-bbb0-2e33c3e0dda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:39.522800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342473b5-44f0-45cc-bbb0-2e33c3e0dda7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:39.524342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342473b5-44f0-45cc-bbb0-2e33c3e0dda7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:39.526061 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342473b5-44f0-45cc-bbb0-2e33c3e0dda7 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:39.530898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 75/140] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:03:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:39.536765 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203660e-1252-423b-8091-a64674631926 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:39.631034 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:39.654812 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203660e-1252-423b-8091-a64674631926 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:39.690736 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbb819-c9d5-419c-9b51-123bd94e28e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:39.691680 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbb819-c9d5-419c-9b51-123bd94e28e1 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:39.692108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbb819-c9d5-419c-9b51-123bd94e28e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:39.692543 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbb819-c9d5-419c-9b51-123bd94e28e1 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:39.693434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbb819-c9d5-419c-9b51-123bd94e28e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:39.695082 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbb819-c9d5-419c-9b51-123bd94e28e1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:39.718613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 66/141] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:03:39 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:03:40.500857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb0b76-d621-4d54-96c2-abcc76e7852f None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:40.501365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb0b76-d621-4d54-96c2-abcc76e7852f None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:40.501365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb0b76-d621-4d54-96c2-abcc76e7852f None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:40.504278 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 76/142] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:40.509822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77450e-66a2-4508-b296-3aaab86f7379 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:40.510120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77450e-66a2-4508-b296-3aaab86f7379 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:40.510429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77450e-66a2-4508-b296-3aaab86f7379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:40.536358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7e77450e-66a2-4508-b296-3aaab86f7379 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:40.537495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7e77450e-66a2-4508-b296-3aaab86f7379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:40.614507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 67/143] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:40.644122 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb0b76-d621-4d54-96c2-abcc76e7852f None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:40.767517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb0b76-d621-4d54-96c2-abcc76e7852f None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:40.808495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:40.814756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdebf17-9ca4-4456-8ad4-a2f6d97390d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:40.815605 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdebf17-9ca4-4456-8ad4-a2f6d97390d4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:40.815886 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdebf17-9ca4-4456-8ad4-a2f6d97390d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:40.816175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdebf17-9ca4-4456-8ad4-a2f6d97390d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:40.830560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdebf17-9ca4-4456-8ad4-a2f6d97390d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:40.838348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-ecdebf17-9ca4-4456-8ad4-a2f6d97390d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:40.838348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:40.838348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:40.838348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:40.838348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:40.838348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:40.838348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:40.838348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:40.838348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:40.838348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:40.838348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:40.838348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:40.838348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:40.838348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:40.838348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:40.838348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:40.839239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:40.839239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:40.839239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:40.839239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:40.839239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:40.839239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:40.839239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:40.839239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:40.839239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:40.839239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:40.839239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:40.839239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:40.839239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:40.839239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:40.839239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:40.839239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:40.840009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:40.840009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:40.840009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:40.840009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:40.840009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:40.840009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:40.840009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:40.840009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:40.840009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:40.840009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:40.840009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:40.840009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:03:40.840009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 77/144] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:40.846827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77450e-66a2-4508-b296-3aaab86f7379 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:40.922150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:40.935612 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550e45c-943a-4ef9-a449-a76607c3b54a None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:40.935930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550e45c-943a-4ef9-a449-a76607c3b54a None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:40.936170 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550e45c-943a-4ef9-a449-a76607c3b54a None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:40.937850 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 78/145] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:03:40.943418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2c6e3-295b-4834-a082-a37fa49da6b2 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:40.943990 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2c6e3-295b-4834-a082-a37fa49da6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:40.944485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2c6e3-295b-4834-a082-a37fa49da6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:40.964228 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-25b2c6e3-295b-4834-a082-a37fa49da6b2 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:40.965945 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-25b2c6e3-295b-4834-a082-a37fa49da6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:40.975271 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77450e-66a2-4508-b296-3aaab86f7379 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:41.047628 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 79/146] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:03:41.052428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54a13e-233f-44d3-a61e-dedae945b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:41.053360 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54a13e-233f-44d3-a61e-dedae945b09d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:41.053872 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54a13e-233f-44d3-a61e-dedae945b09d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:41.054432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54a13e-233f-44d3-a61e-dedae945b09d None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:41.055416 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54a13e-233f-44d3-a61e-dedae945b09d None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:41.055930 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54a13e-233f-44d3-a61e-dedae945b09d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:41.057534 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54a13e-233f-44d3-a61e-dedae945b09d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:41.068319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 68/147] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:03:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:41.074261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2c6e3-295b-4834-a082-a37fa49da6b2 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:41.080945 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54a13e-233f-44d3-a61e-dedae945b09d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:41.194919 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2c6e3-295b-4834-a082-a37fa49da6b2 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:41.224344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:41.238674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024087a-037b-478c-9bf4-5781ab1737c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:41.240329 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024087a-037b-478c-9bf4-5781ab1737c0 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:41.241001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024087a-037b-478c-9bf4-5781ab1737c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:41.241486 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024087a-037b-478c-9bf4-5781ab1737c0 None admin] PATH_INFO: `/v3/users/9a6745d8d2ca460e887dba39a4d91854` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:41.243021 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024087a-037b-478c-9bf4-5781ab1737c0 None admin] RBAC: Authorizing `identity:get_user(user_id=9a6745d8d2ca460e887dba39a4d91854)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:41.244715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024087a-037b-478c-9bf4-5781ab1737c0 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:41.247076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 80/148] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:41 2022] GET /identity/v3/users/9a6745d8d2ca460e887dba39a4d91854 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:41.256378 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024087a-037b-478c-9bf4-5781ab1737c0 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:41.340631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54a13e-233f-44d3-a61e-dedae945b09d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:41.374153 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024087a-037b-478c-9bf4-5781ab1737c0 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:41.404397 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:41.420696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0e261-d12a-4147-b664-91a09d039647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:41.421699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0e261-d12a-4147-b664-91a09d039647 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:41.422198 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0e261-d12a-4147-b664-91a09d039647 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:41.422736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0e261-d12a-4147-b664-91a09d039647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:41.435142 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0d712-f17d-4ceb-b2e4-13c3e14fdc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:41.435942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0d712-f17d-4ceb-b2e4-13c3e14fdc6e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:41.436230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0d712-f17d-4ceb-b2e4-13c3e14fdc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:41.436506 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0d712-f17d-4ceb-b2e4-13c3e14fdc6e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:41.467006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0d712-f17d-4ceb-b2e4-13c3e14fdc6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:41.474759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b1e0d712-f17d-4ceb-b2e4-13c3e14fdc6e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:03:41.474759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:41.474759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:41.474759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:41.474759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:41.474759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:41.474759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:41.474759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:41.474759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:41.474759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:41.474759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:41.474759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:41.474759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:41.474759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:41.474759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:41.474759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:41.475662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:41.475662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:41.475662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:41.475662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:41.475662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:41.475662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:41.475662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:41.475662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:41.475662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:41.475662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:41.475662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:41.475662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:41.475662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:41.475662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:41.475662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:41.475662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:41.476425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:41.476425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:41.476425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:41.476425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:41.476425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:41.476425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:41.476425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:41.476425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:41.476425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:41.476425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:41.476425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:03:41.476425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:03:41.476425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 69/149] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:41.482745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0d712-f17d-4ceb-b2e4-13c3e14fdc6e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:41.493444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:41.519612 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0e261-d12a-4147-b664-91a09d039647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:41.521117 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0e261-d12a-4147-b664-91a09d039647 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:41.696296 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0d712-f17d-4ceb-b2e4-13c3e14fdc6e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:41.743834 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 81/150] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:41.746966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfba33-f971-457e-a0cf-f2ab65c54ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:41.747897 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfba33-f971-457e-a0cf-f2ab65c54ccf None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:41.751073 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfba33-f971-457e-a0cf-f2ab65c54ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:41.751439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0e261-d12a-4147-b664-91a09d039647 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:41.751816 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfba33-f971-457e-a0cf-f2ab65c54ccf None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:41.752868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfba33-f971-457e-a0cf-f2ab65c54ccf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:41.753390 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfba33-f971-457e-a0cf-f2ab65c54ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:41.758032 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfba33-f971-457e-a0cf-f2ab65c54ccf None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:41.771629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 70/151] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:03:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:41.777176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfba33-f971-457e-a0cf-f2ab65c54ccf None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:41.858434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:41.908142 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfba33-f971-457e-a0cf-f2ab65c54ccf None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:41.945810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:41.961829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0e261-d12a-4147-b664-91a09d039647 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:41.976445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08301d9-fa82-4ffe-9292-d000e123896b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:41.976445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08301d9-fa82-4ffe-9292-d000e123896b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:41.976445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08301d9-fa82-4ffe-9292-d000e123896b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:41.976445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08301d9-fa82-4ffe-9292-d000e123896b None admin] PATH_INFO: `/v3/users/1d7ed5cfa594485589783f9872f16c01` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:41.980375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08301d9-fa82-4ffe-9292-d000e123896b None admin] RBAC: Authorizing `identity:get_user(user_id=1d7ed5cfa594485589783f9872f16c01)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:41.982262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08301d9-fa82-4ffe-9292-d000e123896b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:41.984673 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 71/152] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:41 2022] GET /identity/v3/users/1d7ed5cfa594485589783f9872f16c01 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:41.990285 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08301d9-fa82-4ffe-9292-d000e123896b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:42.027810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8947b5-dd77-43f8-8b8a-270892cbcad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:42.029225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8947b5-dd77-43f8-8b8a-270892cbcad4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:42.029941 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8947b5-dd77-43f8-8b8a-270892cbcad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:42.030633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8947b5-dd77-43f8-8b8a-270892cbcad4 None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:42.032450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8947b5-dd77-43f8-8b8a-270892cbcad4 None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:42.034206 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8947b5-dd77-43f8-8b8a-270892cbcad4 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:42.037425 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 82/153] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:41 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:42.044507 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8947b5-dd77-43f8-8b8a-270892cbcad4 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:42.225372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08301d9-fa82-4ffe-9292-d000e123896b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:42.262792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:42.292274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011d1aa-9503-44c5-94d4-3b5668117d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:42.292474 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8947b5-dd77-43f8-8b8a-270892cbcad4 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:42.293149 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011d1aa-9503-44c5-94d4-3b5668117d57 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:42.293434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011d1aa-9503-44c5-94d4-3b5668117d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:42.293712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011d1aa-9503-44c5-94d4-3b5668117d57 None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:42.296753 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011d1aa-9503-44c5-94d4-3b5668117d57 None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:42.298234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011d1aa-9503-44c5-94d4-3b5668117d57 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:42.300076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 72/154] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:41 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:42.306589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997070e-c515-44dd-9c07-97460f3c4aba None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:42.306878 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997070e-c515-44dd-9c07-97460f3c4aba None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:42.307628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997070e-c515-44dd-9c07-97460f3c4aba None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:42.309282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 73/155] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:42.309978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997070e-c515-44dd-9c07-97460f3c4aba None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:42.375034 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797f9e6-2bff-48df-89a1-5bc7a15572e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:42.375739 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797f9e6-2bff-48df-89a1-5bc7a15572e0 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:42.376022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797f9e6-2bff-48df-89a1-5bc7a15572e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:42.376300 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797f9e6-2bff-48df-89a1-5bc7a15572e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:42.377152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797f9e6-2bff-48df-89a1-5bc7a15572e0 None admin] RBAC: Adding query filter params (role.id=9e92f0503b5c47a4a7368e618f37c6ae, scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05, user.id=9a6745d8d2ca460e887dba39a4d91854) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:42.377466 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797f9e6-2bff-48df-89a1-5bc7a15572e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:42.379102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797f9e6-2bff-48df-89a1-5bc7a15572e0 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:42.394026 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 83/156] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:42 2022] GET /identity/v3/role_assignments?user.id=9a6745d8d2ca460e887dba39a4d91854&scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05&role.id=9e92f0503b5c47a4a7368e618f37c6ae => generated 608 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:42.395358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fec0c-21fb-4755-a597-d908eb7dd964 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:42.395649 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fec0c-21fb-4755-a597-d908eb7dd964 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:42.395930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fec0c-21fb-4755-a597-d908eb7dd964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:42.430768 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-e61fec0c-21fb-4755-a597-d908eb7dd964 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:42.432081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e61fec0c-21fb-4755-a597-d908eb7dd964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:42.462777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:42.533495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997070e-c515-44dd-9c07-97460f3c4aba None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:42.586502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 84/157] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:42.587970 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38a92a-efda-4a05-a4b9-7626fa26d759 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:42.588248 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38a92a-efda-4a05-a4b9-7626fa26d759 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:42.588521 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38a92a-efda-4a05-a4b9-7626fa26d759 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:42.589894 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 85/158] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:42.595834 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc2336-82b9-4d58-93d6-e158bea26249 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:42.596121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc2336-82b9-4d58-93d6-e158bea26249 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:42.596469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc2336-82b9-4d58-93d6-e158bea26249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:42.619137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79129f-1346-4066-b755-fafc17d68bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:42.620056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79129f-1346-4066-b755-fafc17d68bd4 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:42.620340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79129f-1346-4066-b755-fafc17d68bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:42.620618 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79129f-1346-4066-b755-fafc17d68bd4 None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05/users/1d7ed5cfa594485589783f9872f16c01/roles/9b47e9314a0349539ef025e68cb2569a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:42.623466 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-99dc2336-82b9-4d58-93d6-e158bea26249 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:42.625002 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-99dc2336-82b9-4d58-93d6-e158bea26249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:42.628034 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79129f-1346-4066-b755-fafc17d68bd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5562cd7183a40e6a7b3680cf02f3e05, user_id=1d7ed5cfa594485589783f9872f16c01, role_id=9b47e9314a0349539ef025e68cb2569a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:42.629526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79129f-1346-4066-b755-fafc17d68bd4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:42.665604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 74/159] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:03:42 2022] PUT /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05/users/1d7ed5cfa594485589783f9872f16c01/roles/9b47e9314a0349539ef025e68cb2569a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:03:42.666472 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79129f-1346-4066-b755-fafc17d68bd4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:42.726981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 86/160] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:03:42.772001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc2336-82b9-4d58-93d6-e158bea26249 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:42.779111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:42.894373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:42.920585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79129f-1346-4066-b755-fafc17d68bd4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:42.926619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc2336-82b9-4d58-93d6-e158bea26249 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:42.979094 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74640f8f-9b8f-44f4-bb07-acee4b76256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:42.979916 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74640f8f-9b8f-44f4-bb07-acee4b76256b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:42.980199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74640f8f-9b8f-44f4-bb07-acee4b76256b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:42.980476 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74640f8f-9b8f-44f4-bb07-acee4b76256b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:42.996157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74640f8f-9b8f-44f4-bb07-acee4b76256b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:43.014444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-74640f8f-9b8f-44f4-bb07-acee4b76256b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:03:43.014444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:43.014444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:43.014444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:43.014444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:43.014444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:43.014444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:43.014444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:43.014444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:43.014444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:43.014444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:43.014444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:43.014444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:43.014444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:43.014444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:43.014444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:43.015364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:43.015364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:43.015364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:43.015364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:43.015364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:43.015364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:43.015364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:43.015364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:43.015364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:43.015364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:43.015364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:43.015364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:43.015364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:43.015364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:43.015364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:43.015364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:43.016109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:43.016109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:43.016109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:43.016109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:43.016109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:43.016109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:43.016109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:43.016109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:43.016109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:43.016109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:43.016109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:03:43.016109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:03:43.018481 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 87/161] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:03:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:43.025224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74640f8f-9b8f-44f4-bb07-acee4b76256b None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:43.059132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe75a2-3db7-46eb-a8ea-f121a021234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:43.059955 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe75a2-3db7-46eb-a8ea-f121a021234c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:43.060242 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe75a2-3db7-46eb-a8ea-f121a021234c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:43.060513 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe75a2-3db7-46eb-a8ea-f121a021234c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:43.091369 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe75a2-3db7-46eb-a8ea-f121a021234c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:43.103269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-43fe75a2-3db7-46eb-a8ea-f121a021234c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:43.103269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:43.103269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:43.103269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:43.103269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:43.103269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:43.103269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:43.103269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:43.103269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:43.103269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:43.103269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:43.103269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:43.103269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:43.103269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:43.103269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:43.103269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:43.104161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:43.104161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:43.104161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:43.104161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:43.104161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:43.104161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:43.104161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:43.104161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:43.104161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:43.104161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:43.104161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:43.104161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:43.104161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:43.104161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:43.104161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:43.104161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:43.104971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:43.104971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:43.104971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:43.104971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:43.104971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:43.104971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:43.104971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:43.104971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:43.104971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:43.104971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:43.104971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:43.104971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:03:43.104971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 75/162] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:03:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:43.128312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe75a2-3db7-46eb-a8ea-f121a021234c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:43.164740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74640f8f-9b8f-44f4-bb07-acee4b76256b None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:43.210061 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc7bc9-1e19-42a7-942f-74853c506df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:43.210777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc7bc9-1e19-42a7-942f-74853c506df7 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:43.211063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc7bc9-1e19-42a7-942f-74853c506df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:43.211350 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc7bc9-1e19-42a7-942f-74853c506df7 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:43.212093 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc7bc9-1e19-42a7-942f-74853c506df7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:43.212403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc7bc9-1e19-42a7-942f-74853c506df7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:43.213807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc7bc9-1e19-42a7-942f-74853c506df7 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:43.235201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 88/163] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:03:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:43.240566 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc7bc9-1e19-42a7-942f-74853c506df7 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:43.251197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:43.381623 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe75a2-3db7-46eb-a8ea-f121a021234c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:43.422855 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:43.446527 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc7bc9-1e19-42a7-942f-74853c506df7 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:43.452454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3c218-0895-4ca5-8a03-0475560b28d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:43.453138 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3c218-0895-4ca5-8a03-0475560b28d8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:43.453419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3c218-0895-4ca5-8a03-0475560b28d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:43.453696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3c218-0895-4ca5-8a03-0475560b28d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:43.454485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3c218-0895-4ca5-8a03-0475560b28d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:43.454798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3c218-0895-4ca5-8a03-0475560b28d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:43.456257 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3c218-0895-4ca5-8a03-0475560b28d8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:43.474263 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 76/164] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:43.475650 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f9257-69c7-4f3d-bfe6-07b44ebfc899 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:43.475937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f9257-69c7-4f3d-bfe6-07b44ebfc899 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:43.476215 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f9257-69c7-4f3d-bfe6-07b44ebfc899 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:43.477674 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 77/165] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:43.483505 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e020f41-9c0d-4acf-b643-fd2b6228f106 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:43.483939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e020f41-9c0d-4acf-b643-fd2b6228f106 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:43.484223 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e020f41-9c0d-4acf-b643-fd2b6228f106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:43.520111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083e8d5-2d44-4d18-9df5-326fbad4fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:43.521074 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083e8d5-2d44-4d18-9df5-326fbad4fde1 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:43.521360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083e8d5-2d44-4d18-9df5-326fbad4fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:43.521685 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083e8d5-2d44-4d18-9df5-326fbad4fde1 None admin] PATH_INFO: `/v3/users/9a6745d8d2ca460e887dba39a4d91854` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:43.523420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7e020f41-9c0d-4acf-b643-fd2b6228f106 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:43.524638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7e020f41-9c0d-4acf-b643-fd2b6228f106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:43.527153 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083e8d5-2d44-4d18-9df5-326fbad4fde1 None admin] RBAC: Authorizing `identity:get_user(user_id=9a6745d8d2ca460e887dba39a4d91854)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:43.528712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083e8d5-2d44-4d18-9df5-326fbad4fde1 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:43.530916 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 89/166] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:43 2022] GET /identity/v3/users/9a6745d8d2ca460e887dba39a4d91854 => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:43.531515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083e8d5-2d44-4d18-9df5-326fbad4fde1 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:43.595353 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 78/167] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:03:43.596045 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e020f41-9c0d-4acf-b643-fd2b6228f106 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:43.689827 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:43.699670 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e020f41-9c0d-4acf-b643-fd2b6228f106 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:43.703022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:43.735827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2d5fa-2657-4dba-9a9d-5614bcfd036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:43.736721 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2d5fa-2657-4dba-9a9d-5614bcfd036c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:43.737283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2d5fa-2657-4dba-9a9d-5614bcfd036c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:43.737705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2d5fa-2657-4dba-9a9d-5614bcfd036c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:43.769493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083e8d5-2d44-4d18-9df5-326fbad4fde1 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:43.808921 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2d5fa-2657-4dba-9a9d-5614bcfd036c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:43.810891 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2d5fa-2657-4dba-9a9d-5614bcfd036c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:43.836305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39088642-098b-484e-b6a8-d3f117e64a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:43.837525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39088642-098b-484e-b6a8-d3f117e64a0d None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:43.837949 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39088642-098b-484e-b6a8-d3f117e64a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:43.838364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39088642-098b-484e-b6a8-d3f117e64a0d None admin] PATH_INFO: `/v3/users/920f62903fc54cf3b0dedf0810c30914` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:43.843210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39088642-098b-484e-b6a8-d3f117e64a0d None admin] RBAC: Authorizing `identity:get_user(user_id=920f62903fc54cf3b0dedf0810c30914)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:43.844937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39088642-098b-484e-b6a8-d3f117e64a0d None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:43.847038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 90/168] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:43 2022] GET /identity/v3/users/920f62903fc54cf3b0dedf0810c30914 => generated 247 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:43.847941 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39088642-098b-484e-b6a8-d3f117e64a0d None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:43.910849 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:43.916808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 79/169] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:43.917893 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2d5fa-2657-4dba-9a9d-5614bcfd036c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:44.021854 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2d5fa-2657-4dba-9a9d-5614bcfd036c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:44.064334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce978c37-e2b3-4ec3-8219-35a202b14fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:44.065398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce978c37-e2b3-4ec3-8219-35a202b14fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:44.065902 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce978c37-e2b3-4ec3-8219-35a202b14fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:44.066418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce978c37-e2b3-4ec3-8219-35a202b14fa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:44.096523 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39088642-098b-484e-b6a8-d3f117e64a0d None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:44.137549 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce978c37-e2b3-4ec3-8219-35a202b14fa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:44.139566 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce978c37-e2b3-4ec3-8219-35a202b14fa4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:44.166843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:44.187121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45dfd8c-50be-4ef4-9a4b-64b4690f4ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:44.187951 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45dfd8c-50be-4ef4-9a4b-64b4690f4ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:44.188238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45dfd8c-50be-4ef4-9a4b-64b4690f4ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:44.188517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45dfd8c-50be-4ef4-9a4b-64b4690f4ce2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:44.208526 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:44.217209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45dfd8c-50be-4ef4-9a4b-64b4690f4ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:44.224994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-c45dfd8c-50be-4ef4-9a4b-64b4690f4ce2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:44.224994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:44.224994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:44.224994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:44.224994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:44.224994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:44.224994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:44.224994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:44.224994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:44.224994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:44.224994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:44.224994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:44.224994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:44.224994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:44.224994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:44.224994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:44.225914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:44.225914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:44.225914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:44.225914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:44.225914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:44.225914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:44.225914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:44.225914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:44.225914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:44.225914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:44.225914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:44.225914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:44.225914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:44.225914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:44.225914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:44.225914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:44.226704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:44.226704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:44.226704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:44.226704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:44.226704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:44.226704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:44.226704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:44.226704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:44.226704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:44.226704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:44.226704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:44.226704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:03:44.226704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 91/170] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:44.235381 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45dfd8c-50be-4ef4-9a4b-64b4690f4ce2 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:44.253610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 80/171] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:44.255117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce978c37-e2b3-4ec3-8219-35a202b14fa4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:44.408931 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45dfd8c-50be-4ef4-9a4b-64b4690f4ce2 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:44.428838 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce978c37-e2b3-4ec3-8219-35a202b14fa4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:44.438723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:44.474098 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe375d90-c7b7-4671-8e92-9762f78d1679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:44.474998 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe375d90-c7b7-4671-8e92-9762f78d1679 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:44.475278 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe375d90-c7b7-4671-8e92-9762f78d1679 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:44.475556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe375d90-c7b7-4671-8e92-9762f78d1679 None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:44.477443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe375d90-c7b7-4671-8e92-9762f78d1679 None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:44.479673 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe375d90-c7b7-4671-8e92-9762f78d1679 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:44.481396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 92/172] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:44 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:44.482355 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe375d90-c7b7-4671-8e92-9762f78d1679 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:44.496475 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d5386-de0e-4ca4-b515-5a2b7e73e3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:44.497149 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d5386-de0e-4ca4-b515-5a2b7e73e3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:44.497432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d5386-de0e-4ca4-b515-5a2b7e73e3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:44.497708 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d5386-de0e-4ca4-b515-5a2b7e73e3d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:44.498494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d5386-de0e-4ca4-b515-5a2b7e73e3d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:44.498855 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d5386-de0e-4ca4-b515-5a2b7e73e3d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:44.502310 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d5386-de0e-4ca4-b515-5a2b7e73e3d2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:44.517503 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 81/173] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:03:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:44.518943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245d060-7d68-4a99-839e-671f17963a6c None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:44.519230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245d060-7d68-4a99-839e-671f17963a6c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:44.519505 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245d060-7d68-4a99-839e-671f17963a6c None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:44.523287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 82/174] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:44.524922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245d060-7d68-4a99-839e-671f17963a6c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:44.625654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:44.690575 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe375d90-c7b7-4671-8e92-9762f78d1679 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:44.734709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245d060-7d68-4a99-839e-671f17963a6c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:44.751261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e68304-6e91-4203-8c83-b78d5aea867c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:44.752132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e68304-6e91-4203-8c83-b78d5aea867c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:44.752413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e68304-6e91-4203-8c83-b78d5aea867c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:44.752816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e68304-6e91-4203-8c83-b78d5aea867c None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:44.755358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e68304-6e91-4203-8c83-b78d5aea867c None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:44.756831 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e68304-6e91-4203-8c83-b78d5aea867c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:44.758576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 93/175] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:44 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:44.759581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e68304-6e91-4203-8c83-b78d5aea867c None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:44.784634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d559d-096d-4776-bb51-c8dde4d2f14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:44.785295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d559d-096d-4776-bb51-c8dde4d2f14d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:44.785998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d559d-096d-4776-bb51-c8dde4d2f14d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:44.786514 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d559d-096d-4776-bb51-c8dde4d2f14d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:44.787538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d559d-096d-4776-bb51-c8dde4d2f14d None admin] RBAC: Adding query filter params (role.id=2e761f6eaaa94f9e85d77734e01ac393, scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05, user.id=9a6745d8d2ca460e887dba39a4d91854) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:44.788078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d559d-096d-4776-bb51-c8dde4d2f14d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:44.789741 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d559d-096d-4776-bb51-c8dde4d2f14d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:44.801707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 83/176] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:44 2022] GET /identity/v3/role_assignments?user.id=9a6745d8d2ca460e887dba39a4d91854&scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05&role.id=2e761f6eaaa94f9e85d77734e01ac393 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:44.801707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8399a-f74c-405e-a8d5-6014b67299d4 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:44.801707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8399a-f74c-405e-a8d5-6014b67299d4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:44.801707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8399a-f74c-405e-a8d5-6014b67299d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:44.842412 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-bed8399a-f74c-405e-a8d5-6014b67299d4 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:44.842412 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bed8399a-f74c-405e-a8d5-6014b67299d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:44.884777 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:44.922684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e68304-6e91-4203-8c83-b78d5aea867c None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:44.953005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 84/177] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:44.958132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2005e2-05c0-4a49-9b5f-81ffc7a2c5df None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:44.958132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2005e2-05c0-4a49-9b5f-81ffc7a2c5df None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:44.958132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2005e2-05c0-4a49-9b5f-81ffc7a2c5df None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:44.958437 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 85/178] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:44.959782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2005e2-05c0-4a49-9b5f-81ffc7a2c5df None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:44.993010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e8620-0dcc-4dcc-8cb2-f4d09a9bcab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:44.994261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e8620-0dcc-4dcc-8cb2-f4d09a9bcab7 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:44.994775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e8620-0dcc-4dcc-8cb2-f4d09a9bcab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:44.995249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e8620-0dcc-4dcc-8cb2-f4d09a9bcab7 None admin] PATH_INFO: `/v3/users/9a6745d8d2ca460e887dba39a4d91854` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:44.996817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e8620-0dcc-4dcc-8cb2-f4d09a9bcab7 None admin] RBAC: Authorizing `identity:get_user(user_id=9a6745d8d2ca460e887dba39a4d91854)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:44.998472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e8620-0dcc-4dcc-8cb2-f4d09a9bcab7 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:45.000913 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 94/179] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:44 2022] GET /identity/v3/users/9a6745d8d2ca460e887dba39a4d91854 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:45.002284 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8989-2ac6-471e-a4b5-858a43af529d None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:45.002959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8989-2ac6-471e-a4b5-858a43af529d None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:45.003431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8989-2ac6-471e-a4b5-858a43af529d None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:45.004882 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 95/180] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:45.006285 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43054ef-c3b3-47f1-b4de-296a9331f742 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:45.006871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43054ef-c3b3-47f1-b4de-296a9331f742 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:45.007367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43054ef-c3b3-47f1-b4de-296a9331f742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:45.016762 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:45.032308 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-a43054ef-c3b3-47f1-b4de-296a9331f742 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:45.033881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a43054ef-c3b3-47f1-b4de-296a9331f742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:45.103527 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2005e2-05c0-4a49-9b5f-81ffc7a2c5df None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:45.123006 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 96/181] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:45.123708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43054ef-c3b3-47f1-b4de-296a9331f742 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:45.151473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff7240-461d-4e2b-b43a-06a662637994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:45.152663 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff7240-461d-4e2b-b43a-06a662637994 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:45.153090 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff7240-461d-4e2b-b43a-06a662637994 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:45.153499 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff7240-461d-4e2b-b43a-06a662637994 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:45.154612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff7240-461d-4e2b-b43a-06a662637994 None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05, user.id=920f62903fc54cf3b0dedf0810c30914) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:45.155001 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff7240-461d-4e2b-b43a-06a662637994 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:45.157121 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff7240-461d-4e2b-b43a-06a662637994 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:45.174782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 86/182] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:44 2022] GET /identity/v3/role_assignments?user.id=920f62903fc54cf3b0dedf0810c30914&scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:45.174782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff7240-461d-4e2b-b43a-06a662637994 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:45.199267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:45.258378 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43054ef-c3b3-47f1-b4de-296a9331f742 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:45.296617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949d894-032c-48e3-9e74-ab43aabecd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:45.297591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949d894-032c-48e3-9e74-ab43aabecd20 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:45.297996 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949d894-032c-48e3-9e74-ab43aabecd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:45.298373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949d894-032c-48e3-9e74-ab43aabecd20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:45.300981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:45.312654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949d894-032c-48e3-9e74-ab43aabecd20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:45.317242 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff7240-461d-4e2b-b43a-06a662637994 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:45.321297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-5949d894-032c-48e3-9e74-ab43aabecd20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:45.321297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:45.321297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:45.321297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:45.321297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:45.321297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:45.321297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:45.321297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:45.321297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:45.321297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:45.321297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:45.321297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:45.321297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:45.321297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:45.321297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:45.321297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:45.322369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:45.322369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:45.322369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:45.322369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:45.322369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:45.322369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:45.322369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:45.322369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:45.322369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:45.322369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:45.322369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:45.322369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:45.322369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:45.322369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:45.322369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:45.322369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:45.323359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:45.323359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:45.323359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:45.323359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:45.323359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:45.323359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:45.323359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:45.323359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:45.323359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:45.323359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:45.323359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:45.323359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:03:45.329963 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 97/183] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:03:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:45.329963 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b470c5-fab9-4e41-b768-4c8b62589408 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:45.329963 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b470c5-fab9-4e41-b768-4c8b62589408 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:45.329963 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b470c5-fab9-4e41-b768-4c8b62589408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:45.346697 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-89b470c5-fab9-4e41-b768-4c8b62589408 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:45.348334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-89b470c5-fab9-4e41-b768-4c8b62589408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:45.371237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bfaa2-6851-47fe-bbad-77732056f313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:45.371903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bfaa2-6851-47fe-bbad-77732056f313 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:45.372190 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bfaa2-6851-47fe-bbad-77732056f313 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:45.372472 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bfaa2-6851-47fe-bbad-77732056f313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:45.442419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 98/184] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:45.442419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b470c5-fab9-4e41-b768-4c8b62589408 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:45.457709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bfaa2-6851-47fe-bbad-77732056f313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:45.459389 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bfaa2-6851-47fe-bbad-77732056f313 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:45.479470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:45.550959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b470c5-fab9-4e41-b768-4c8b62589408 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:45.577398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:45.579019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 87/185] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:45.579952 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bfaa2-6851-47fe-bbad-77732056f313 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:45.590147 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f94ea-2aed-4c1b-a3ae-664e2ade0d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:45.590982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f94ea-2aed-4c1b-a3ae-664e2ade0d69 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:45.591263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f94ea-2aed-4c1b-a3ae-664e2ade0d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:45.591536 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f94ea-2aed-4c1b-a3ae-664e2ade0d69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:45.592942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f94ea-2aed-4c1b-a3ae-664e2ade0d69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:45.594561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f94ea-2aed-4c1b-a3ae-664e2ade0d69 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:45.596468 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 99/186] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:03:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:45.597085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f94ea-2aed-4c1b-a3ae-664e2ade0d69 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:45.685472 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bfaa2-6851-47fe-bbad-77732056f313 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:45.693526 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f94ea-2aed-4c1b-a3ae-664e2ade0d69 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:45.702862 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:45.720457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ed48d-7800-4803-889f-33c91561d6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:45.721097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ed48d-7800-4803-889f-33c91561d6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:45.721432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ed48d-7800-4803-889f-33c91561d6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:45.721711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ed48d-7800-4803-889f-33c91561d6b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:45.722505 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ed48d-7800-4803-889f-33c91561d6b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:45.722812 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ed48d-7800-4803-889f-33c91561d6b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:45.724209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ed48d-7800-4803-889f-33c91561d6b9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:45.728022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8d418-64d1-4af5-a6cd-d0edb1c2eeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:45.728839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8d418-64d1-4af5-a6cd-d0edb1c2eeef None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:45.729150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8d418-64d1-4af5-a6cd-d0edb1c2eeef None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:45.729432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8d418-64d1-4af5-a6cd-d0edb1c2eeef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:45.732669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 88/187] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:45.733592 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ed48d-7800-4803-889f-33c91561d6b9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:45.739704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8d418-64d1-4af5-a6cd-d0edb1c2eeef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:45.747910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-a4d8d418-64d1-4af5-a6cd-d0edb1c2eeef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:03:45.747910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:45.747910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:45.747910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:45.747910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:45.747910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:45.747910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:45.747910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:45.747910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:45.747910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:45.747910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:45.747910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:45.747910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:45.747910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:45.747910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:45.747910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:45.748900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:45.748900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:45.748900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:45.748900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:45.748900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:45.748900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:45.748900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:45.748900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:45.748900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:45.748900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:45.748900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:45.748900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:45.748900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:45.748900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:45.748900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:45.748900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:45.750012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:45.750012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:45.750012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:45.750012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:45.750012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:45.750012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:45.750012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:45.750012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:45.750012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:45.750012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:45.750012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:03:45.750012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:03:45.750012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 100/188] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:03:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:45.750879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed182fe-0595-4674-899f-2cffc5bf69fc None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:45.750954 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed182fe-0595-4674-899f-2cffc5bf69fc None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:45.751233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed182fe-0595-4674-899f-2cffc5bf69fc None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:45.752513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 101/189] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:45.753188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed182fe-0595-4674-899f-2cffc5bf69fc None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:45.806828 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:45.836188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ed48d-7800-4803-889f-33c91561d6b9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:45.856478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed182fe-0595-4674-899f-2cffc5bf69fc None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:45.868061 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde00157-174b-4d05-bf7f-45489a5c73ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:45.868917 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde00157-174b-4d05-bf7f-45489a5c73ea None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:45.869195 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde00157-174b-4d05-bf7f-45489a5c73ea None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:45.869468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde00157-174b-4d05-bf7f-45489a5c73ea None admin] PATH_INFO: `/v3/projects/6ef6874e447f44d6b362f38a5c0c7882` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:45.870668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde00157-174b-4d05-bf7f-45489a5c73ea None admin] RBAC: Authorizing `identity:get_project(project_id=6ef6874e447f44d6b362f38a5c0c7882)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:45.872129 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde00157-174b-4d05-bf7f-45489a5c73ea None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:45.873831 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 89/190] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:45 2022] GET /identity/v3/projects/6ef6874e447f44d6b362f38a5c0c7882 => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:45.874905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde00157-174b-4d05-bf7f-45489a5c73ea None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:45.891504 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74020bc5-e50d-4469-ab3e-b9a2476fd6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:45.892207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74020bc5-e50d-4469-ab3e-b9a2476fd6bf None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:45.892515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74020bc5-e50d-4469-ab3e-b9a2476fd6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:45.892927 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74020bc5-e50d-4469-ab3e-b9a2476fd6bf None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:45.894073 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74020bc5-e50d-4469-ab3e-b9a2476fd6bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:45.895330 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74020bc5-e50d-4469-ab3e-b9a2476fd6bf None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:45.915530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 102/191] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:03:45 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:03:45.916409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74020bc5-e50d-4469-ab3e-b9a2476fd6bf None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:45.928095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:45.986988 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde00157-174b-4d05-bf7f-45489a5c73ea None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:46.024803 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f224bf-c8f9-40c3-a732-007d7ec02119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:46.025679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f224bf-c8f9-40c3-a732-007d7ec02119 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:46.025963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f224bf-c8f9-40c3-a732-007d7ec02119 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:46.026238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f224bf-c8f9-40c3-a732-007d7ec02119 None admin] PATH_INFO: `/v3/users/7e311e71ebef40328202746fe2b131de` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:46.042539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f224bf-c8f9-40c3-a732-007d7ec02119 None admin] RBAC: Authorizing `identity:get_user(user_id=7e311e71ebef40328202746fe2b131de)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:46.044060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f224bf-c8f9-40c3-a732-007d7ec02119 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:46.045821 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 90/192] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:45 2022] GET /identity/v3/users/7e311e71ebef40328202746fe2b131de => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:46.047135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8b07a-da6c-4ace-8139-58216ee48991 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:46.047424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8b07a-da6c-4ace-8139-58216ee48991 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:46.047705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8b07a-da6c-4ace-8139-58216ee48991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:46.064494 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74020bc5-e50d-4469-ab3e-b9a2476fd6bf None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:46.070867 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-60a8b07a-da6c-4ace-8139-58216ee48991 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:46.072091 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-60a8b07a-da6c-4ace-8139-58216ee48991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:46.074699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:46.106767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4a600-8606-472c-aa35-f43321638a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:46.107439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a600-8606-472c-aa35-f43321638a44 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:46.107720 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a600-8606-472c-aa35-f43321638a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:46.107997 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a600-8606-472c-aa35-f43321638a44 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:46.108768 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4a600-8606-472c-aa35-f43321638a44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:46.109083 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4a600-8606-472c-aa35-f43321638a44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:46.111125 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4a600-8606-472c-aa35-f43321638a44 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:46.119092 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 103/193] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:03:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:46.126323 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4a600-8606-472c-aa35-f43321638a44 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:46.162510 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 91/194] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:46.163380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8b07a-da6c-4ace-8139-58216ee48991 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:46.212146 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:46.247127 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4a600-8606-472c-aa35-f43321638a44 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:46.283194 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8b07a-da6c-4ace-8139-58216ee48991 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:46.288374 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b906ac-0c69-4049-a0cd-0d0eb807adbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:46.289045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b906ac-0c69-4049-a0cd-0d0eb807adbb None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:46.289327 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b906ac-0c69-4049-a0cd-0d0eb807adbb None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:46.289607 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b906ac-0c69-4049-a0cd-0d0eb807adbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:46.291473 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b906ac-0c69-4049-a0cd-0d0eb807adbb None admin] RBAC: Adding query filter params (role.id=9e92f0503b5c47a4a7368e618f37c6ae, scope.project.id=6ef6874e447f44d6b362f38a5c0c7882, user.id=9a6745d8d2ca460e887dba39a4d91854) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:46.291473 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b906ac-0c69-4049-a0cd-0d0eb807adbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:46.292230 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b906ac-0c69-4049-a0cd-0d0eb807adbb None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:46.299408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 104/195] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:46 2022] GET /identity/v3/role_assignments?user.id=9a6745d8d2ca460e887dba39a4d91854&scope.project.id=6ef6874e447f44d6b362f38a5c0c7882&role.id=9e92f0503b5c47a4a7368e618f37c6ae => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:46.300233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b906ac-0c69-4049-a0cd-0d0eb807adbb None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:46.334487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c1bcb-abc8-46ab-8c7e-3094de89040b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:46.335177 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c1bcb-abc8-46ab-8c7e-3094de89040b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:46.335464 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c1bcb-abc8-46ab-8c7e-3094de89040b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:46.335740 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c1bcb-abc8-46ab-8c7e-3094de89040b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:46.341668 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:46.418210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b906ac-0c69-4049-a0cd-0d0eb807adbb None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:46.444984 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c1bcb-abc8-46ab-8c7e-3094de89040b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:46.446516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c1bcb-abc8-46ab-8c7e-3094de89040b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:46.456112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61803f1-54a2-451a-8c12-cc9a2ada68f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:46.457000 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61803f1-54a2-451a-8c12-cc9a2ada68f7 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:46.457283 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61803f1-54a2-451a-8c12-cc9a2ada68f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:46.458175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61803f1-54a2-451a-8c12-cc9a2ada68f7 None admin] PATH_INFO: `/v3/users/7e311e71ebef40328202746fe2b131de` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:46.458948 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61803f1-54a2-451a-8c12-cc9a2ada68f7 None admin] RBAC: Authorizing `identity:get_user(user_id=7e311e71ebef40328202746fe2b131de)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:46.460565 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61803f1-54a2-451a-8c12-cc9a2ada68f7 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:46.462834 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 105/196] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:46 2022] GET /identity/v3/users/7e311e71ebef40328202746fe2b131de => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:46.463792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61803f1-54a2-451a-8c12-cc9a2ada68f7 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:46.510962 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:46.582699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61803f1-54a2-451a-8c12-cc9a2ada68f7 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:46.585601 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:46.593004 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 92/197] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:46.593995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c1bcb-abc8-46ab-8c7e-3094de89040b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:46.631640 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89d6f6-7a96-4e9d-aacc-3b8e9a7ba319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:46.632995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89d6f6-7a96-4e9d-aacc-3b8e9a7ba319 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:46.633461 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89d6f6-7a96-4e9d-aacc-3b8e9a7ba319 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:46.634332 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89d6f6-7a96-4e9d-aacc-3b8e9a7ba319 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:46.649403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89d6f6-7a96-4e9d-aacc-3b8e9a7ba319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:46.661174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-1b89d6f6-7a96-4e9d-aacc-3b8e9a7ba319 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:03:46.661174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:46.661174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:46.661174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:46.661174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:46.661174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:46.661174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:46.661174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:46.661174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:46.661174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:46.661174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:46.661174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:46.661174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:46.661174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:46.661174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:46.661174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:46.662078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:46.662078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:46.662078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:46.662078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:46.662078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:46.662078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:46.662078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:46.662078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:46.662078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:46.662078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:46.662078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:46.662078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:46.662078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:46.662078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:46.662078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:46.662078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:46.662906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:46.662906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:46.662906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:46.662906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:46.662906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:46.662906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:46.662906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:46.662906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:46.662906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:46.662906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:46.662906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:03:46.662906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:03:46.665236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 106/198] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:46.666242 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89d6f6-7a96-4e9d-aacc-3b8e9a7ba319 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:46.728071 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c1bcb-abc8-46ab-8c7e-3094de89040b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:46.772453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a65fe-97cf-4a16-956d-cf97e3233e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:46.773255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a65fe-97cf-4a16-956d-cf97e3233e18 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:46.773676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a65fe-97cf-4a16-956d-cf97e3233e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:46.774015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a65fe-97cf-4a16-956d-cf97e3233e18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:46.779773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:46.794937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89d6f6-7a96-4e9d-aacc-3b8e9a7ba319 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:46.841099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73873e35-fb86-4bcf-a7ed-69dc435dd35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:46.842499 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73873e35-fb86-4bcf-a7ed-69dc435dd35f None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:46.842923 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73873e35-fb86-4bcf-a7ed-69dc435dd35f None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:46.843363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73873e35-fb86-4bcf-a7ed-69dc435dd35f None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:46.845865 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73873e35-fb86-4bcf-a7ed-69dc435dd35f None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:46.848183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73873e35-fb86-4bcf-a7ed-69dc435dd35f None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:46.851325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 107/199] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:46 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:46.852327 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73873e35-fb86-4bcf-a7ed-69dc435dd35f None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:46.862546 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a65fe-97cf-4a16-956d-cf97e3233e18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:46.864326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7a65fe-97cf-4a16-956d-cf97e3233e18 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:46.893022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:46.978855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73873e35-fb86-4bcf-a7ed-69dc435dd35f None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:46.989338 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 93/200] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:46.990912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a65fe-97cf-4a16-956d-cf97e3233e18 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:47.020640 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e4014-9410-48aa-9985-317570b8812e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:47.021310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e4014-9410-48aa-9985-317570b8812e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:47.021590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e4014-9410-48aa-9985-317570b8812e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:47.021866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e4014-9410-48aa-9985-317570b8812e None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:47.022655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e4014-9410-48aa-9985-317570b8812e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:47.022961 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e4014-9410-48aa-9985-317570b8812e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:47.024349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e4014-9410-48aa-9985-317570b8812e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:47.033044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 108/201] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:03:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:47.033978 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e4014-9410-48aa-9985-317570b8812e None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:47.046510 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:47.136878 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a65fe-97cf-4a16-956d-cf97e3233e18 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:47.141903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:47.159084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e4014-9410-48aa-9985-317570b8812e None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:47.184453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c69f76-e32b-41ba-bd65-ffe9ef65a57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:47.185227 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c69f76-e32b-41ba-bd65-ffe9ef65a57c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:47.185603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c69f76-e32b-41ba-bd65-ffe9ef65a57c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:47.185970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c69f76-e32b-41ba-bd65-ffe9ef65a57c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:47.187053 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c69f76-e32b-41ba-bd65-ffe9ef65a57c None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b, user.id=7e311e71ebef40328202746fe2b131de) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:47.187469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c69f76-e32b-41ba-bd65-ffe9ef65a57c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:47.187892 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f291f99-6296-448d-b381-7ea5ac1e8ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:47.188823 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f291f99-6296-448d-b381-7ea5ac1e8ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:47.188925 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c69f76-e32b-41ba-bd65-ffe9ef65a57c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:47.189169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f291f99-6296-448d-b381-7ea5ac1e8ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:47.189510 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f291f99-6296-448d-b381-7ea5ac1e8ac3 None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:47.191069 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f291f99-6296-448d-b381-7ea5ac1e8ac3 None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:47.192705 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f291f99-6296-448d-b381-7ea5ac1e8ac3 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:47.194530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 109/202] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:47 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:47.200274 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f291f99-6296-448d-b381-7ea5ac1e8ac3 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:47.201246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 94/203] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:46 2022] GET /identity/v3/role_assignments?user.id=7e311e71ebef40328202746fe2b131de&scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:47.202203 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c69f76-e32b-41ba-bd65-ffe9ef65a57c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:47.392044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f291f99-6296-448d-b381-7ea5ac1e8ac3 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:47.415279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c69f76-e32b-41ba-bd65-ffe9ef65a57c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:47.419097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:47.440791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54cdfc-1b87-4a37-ae4c-3b6d0612ec27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:47.441728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54cdfc-1b87-4a37-ae4c-3b6d0612ec27 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:47.442028 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54cdfc-1b87-4a37-ae4c-3b6d0612ec27 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:47.442293 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54cdfc-1b87-4a37-ae4c-3b6d0612ec27 None admin] PATH_INFO: `/v3/users/1d7ed5cfa594485589783f9872f16c01` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:47.447224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54cdfc-1b87-4a37-ae4c-3b6d0612ec27 None admin] RBAC: Authorizing `identity:get_user(user_id=1d7ed5cfa594485589783f9872f16c01)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:47.448863 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54cdfc-1b87-4a37-ae4c-3b6d0612ec27 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:47.451016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 110/204] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:47 2022] GET /identity/v3/users/1d7ed5cfa594485589783f9872f16c01 => generated 289 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:47.459047 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54cdfc-1b87-4a37-ae4c-3b6d0612ec27 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:47.464171 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a98318-fb88-4e1a-8348-1f033c05ccd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:47.465213 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a98318-fb88-4e1a-8348-1f033c05ccd3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:47.465793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a98318-fb88-4e1a-8348-1f033c05ccd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:47.466266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a98318-fb88-4e1a-8348-1f033c05ccd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:47.467360 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a98318-fb88-4e1a-8348-1f033c05ccd3 None admin] RBAC: Adding query filter params (role.id=2e761f6eaaa94f9e85d77734e01ac393, scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b, user.id=7e311e71ebef40328202746fe2b131de) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:47.467995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a98318-fb88-4e1a-8348-1f033c05ccd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:47.470353 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a98318-fb88-4e1a-8348-1f033c05ccd3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:47.484822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 95/205] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:47 2022] GET /identity/v3/role_assignments?user.id=7e311e71ebef40328202746fe2b131de&scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b&role.id=2e761f6eaaa94f9e85d77734e01ac393 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:47.509180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:47.623912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54cdfc-1b87-4a37-ae4c-3b6d0612ec27 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:47.669925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94ac8c-ccd3-435d-bcc7-90a408d2fc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:47.670550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94ac8c-ccd3-435d-bcc7-90a408d2fc25 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:47.670836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94ac8c-ccd3-435d-bcc7-90a408d2fc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:47.671113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94ac8c-ccd3-435d-bcc7-90a408d2fc25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:47.741922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94ac8c-ccd3-435d-bcc7-90a408d2fc25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:47.743490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94ac8c-ccd3-435d-bcc7-90a408d2fc25 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:47.772314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:47.849802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 111/206] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:47.855886 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a98318-fb88-4e1a-8348-1f033c05ccd3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:47.984426 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a98318-fb88-4e1a-8348-1f033c05ccd3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:48.027070 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b58116-564e-46f2-86fb-598cac8d458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:48.027948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b58116-564e-46f2-86fb-598cac8d458b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:48.028229 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b58116-564e-46f2-86fb-598cac8d458b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:48.028507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b58116-564e-46f2-86fb-598cac8d458b None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:48.035170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b58116-564e-46f2-86fb-598cac8d458b None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:48.036659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b58116-564e-46f2-86fb-598cac8d458b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:48.038763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 96/207] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:47 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:48.044758 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94ac8c-ccd3-435d-bcc7-90a408d2fc25 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:48.178889 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94ac8c-ccd3-435d-bcc7-90a408d2fc25 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:48.206585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:48.221926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2d764-a1c6-4445-b96e-53545fa179d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:48.222689 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2d764-a1c6-4445-b96e-53545fa179d1 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:48.222976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2d764-a1c6-4445-b96e-53545fa179d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:48.223259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2d764-a1c6-4445-b96e-53545fa179d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:48.224116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2d764-a1c6-4445-b96e-53545fa179d1 None admin] RBAC: Adding query filter params (role.id=9b47e9314a0349539ef025e68cb2569a, scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05, user.id=1d7ed5cfa594485589783f9872f16c01) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:48.224431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2d764-a1c6-4445-b96e-53545fa179d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:48.225891 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2d764-a1c6-4445-b96e-53545fa179d1 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:48.236878 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 112/208] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:48 2022] GET /identity/v3/role_assignments?user.id=1d7ed5cfa594485589783f9872f16c01&scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05&role.id=9b47e9314a0349539ef025e68cb2569a => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:48.358070 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffa9b5-50b4-42b2-932c-36e1c37aa784 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:48.358648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffa9b5-50b4-42b2-932c-36e1c37aa784 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:48.358648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffa9b5-50b4-42b2-932c-36e1c37aa784 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:48.360211 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 97/209] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:48.366150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb927194-fcf4-40ba-b2a6-8b751f6f034f None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:48.366463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb927194-fcf4-40ba-b2a6-8b751f6f034f None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:48.366752 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb927194-fcf4-40ba-b2a6-8b751f6f034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:48.391660 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-bb927194-fcf4-40ba-b2a6-8b751f6f034f None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:48.392910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-bb927194-fcf4-40ba-b2a6-8b751f6f034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:48.488964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 113/210] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:03:48.515509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52feb7-f88c-4fd7-88a2-0fc98b11f2a8 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:48.516145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52feb7-f88c-4fd7-88a2-0fc98b11f2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:48.516648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52feb7-f88c-4fd7-88a2-0fc98b11f2a8 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:48.518557 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 98/211] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:48.524116 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52feb7-f88c-4fd7-88a2-0fc98b11f2a8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:48.524631 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdf840-78e5-4fea-ba0a-77c7427ee59c None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:48.524983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdf840-78e5-4fea-ba0a-77c7427ee59c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:48.525196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdf840-78e5-4fea-ba0a-77c7427ee59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:48.548791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-81cdf840-78e5-4fea-ba0a-77c7427ee59c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:48.550285 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-81cdf840-78e5-4fea-ba0a-77c7427ee59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:48.561056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:48.648545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52feb7-f88c-4fd7-88a2-0fc98b11f2a8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:48.676409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 114/212] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:48.691770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4782cb-3458-43ca-b4b8-5e956643cd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:48.692621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4782cb-3458-43ca-b4b8-5e956643cd4c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:48.692910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4782cb-3458-43ca-b4b8-5e956643cd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:48.693192 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4782cb-3458-43ca-b4b8-5e956643cd4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:48.703401 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdf840-78e5-4fea-ba0a-77c7427ee59c None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:48.704156 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4782cb-3458-43ca-b4b8-5e956643cd4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:48.712507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-bd4782cb-3458-43ca-b4b8-5e956643cd4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:48.712507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:48.712507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:48.712507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:48.712507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:48.712507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:48.712507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:48.712507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:48.712507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:48.712507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:48.712507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:48.712507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:48.712507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:48.712507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:48.712507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:48.712507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:48.713386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:48.713386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:48.713386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:48.713386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:48.713386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:48.713386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:48.713386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:48.713386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:48.713386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:48.713386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:48.713386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:48.713386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:48.713386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:48.713386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:48.713386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:48.713386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:48.714152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:48.714152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:48.714152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:48.714152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:48.714152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:48.714152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:48.714152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:48.714152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:48.714152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:48.714152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:48.714152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:48.714152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:03:48.714152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 99/213] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:48.719859 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4782cb-3458-43ca-b4b8-5e956643cd4c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:48.760738 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:48.820031 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdf840-78e5-4fea-ba0a-77c7427ee59c None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:48.824467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:48.836479 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4782cb-3458-43ca-b4b8-5e956643cd4c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:48.864253 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486543f-2cf3-43db-9458-9bde1f54ab12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:48.866237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486543f-2cf3-43db-9458-9bde1f54ab12 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:48.866869 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486543f-2cf3-43db-9458-9bde1f54ab12 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:48.867334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486543f-2cf3-43db-9458-9bde1f54ab12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:48.869026 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486543f-2cf3-43db-9458-9bde1f54ab12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:48.871384 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486543f-2cf3-43db-9458-9bde1f54ab12 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:48.873752 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 115/214] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:03:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:48.882647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486543f-2cf3-43db-9458-9bde1f54ab12 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:48.888933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac6ea9-bbe1-4e51-84ab-7284582ffcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:48.889625 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac6ea9-bbe1-4e51-84ab-7284582ffcb9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:48.889909 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac6ea9-bbe1-4e51-84ab-7284582ffcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:48.890185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac6ea9-bbe1-4e51-84ab-7284582ffcb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:48.890979 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac6ea9-bbe1-4e51-84ab-7284582ffcb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:48.891284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac6ea9-bbe1-4e51-84ab-7284582ffcb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:48.892691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac6ea9-bbe1-4e51-84ab-7284582ffcb9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:48.907212 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 100/215] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:03:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:48.913073 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac6ea9-bbe1-4e51-84ab-7284582ffcb9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:49.003932 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486543f-2cf3-43db-9458-9bde1f54ab12 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:49.026791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:49.043389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44be49b-12dc-4fac-83b4-cad03d4cefc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:49.044465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44be49b-12dc-4fac-83b4-cad03d4cefc5 None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:49.044971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44be49b-12dc-4fac-83b4-cad03d4cefc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:49.045444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44be49b-12dc-4fac-83b4-cad03d4cefc5 None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:49.046857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44be49b-12dc-4fac-83b4-cad03d4cefc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:49.048795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44be49b-12dc-4fac-83b4-cad03d4cefc5 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:49.050408 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac6ea9-bbe1-4e51-84ab-7284582ffcb9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:49.075443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 116/216] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:03:48 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:03:49.097688 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65f2f8-9598-4af1-ac2d-a2320e122d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:49.098656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65f2f8-9598-4af1-ac2d-a2320e122d07 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:49.098944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65f2f8-9598-4af1-ac2d-a2320e122d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:49.099221 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65f2f8-9598-4af1-ac2d-a2320e122d07 None admin] PATH_INFO: `/v3/users/47973c228f8b4f3eb106aed0e93a6dee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:49.115391 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65f2f8-9598-4af1-ac2d-a2320e122d07 None admin] RBAC: Authorizing `identity:get_user(user_id=47973c228f8b4f3eb106aed0e93a6dee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:49.116940 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65f2f8-9598-4af1-ac2d-a2320e122d07 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:49.119164 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 101/217] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:48 2022] GET /identity/v3/users/47973c228f8b4f3eb106aed0e93a6dee => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:49.126790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44be49b-12dc-4fac-83b4-cad03d4cefc5 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:49.243901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44be49b-12dc-4fac-83b4-cad03d4cefc5 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:49.280233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f809bd2-8f86-48d6-a9f3-9c182c093ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:49.280836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f809bd2-8f86-48d6-a9f3-9c182c093ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:49.281122 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f809bd2-8f86-48d6-a9f3-9c182c093ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:49.281402 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f809bd2-8f86-48d6-a9f3-9c182c093ea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:49.327368 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:49.354767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f809bd2-8f86-48d6-a9f3-9c182c093ea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:49.356240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f809bd2-8f86-48d6-a9f3-9c182c093ea5 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:49.467872 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 117/218] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:49.474280 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65f2f8-9598-4af1-ac2d-a2320e122d07 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:49.494727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:49.594910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55f52d-4848-49f9-aca4-874bcee813e9 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:49.595328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55f52d-4848-49f9-aca4-874bcee813e9 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:49.595780 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55f52d-4848-49f9-aca4-874bcee813e9 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:49.598319 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 118/219] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:49.600720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65f2f8-9598-4af1-ac2d-a2320e122d07 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:49.606692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43291a24-b9b7-4e93-817e-e73f7a101f6b None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:49.607143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43291a24-b9b7-4e93-817e-e73f7a101f6b None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:49.607597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43291a24-b9b7-4e93-817e-e73f7a101f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:49.665734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-43291a24-b9b7-4e93-817e-e73f7a101f6b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:49.667701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-43291a24-b9b7-4e93-817e-e73f7a101f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:49.672200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a599804-eb3e-45ae-91b0-f30ca978c76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:49.673692 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a599804-eb3e-45ae-91b0-f30ca978c76c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:49.674173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a599804-eb3e-45ae-91b0-f30ca978c76c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:49.675081 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a599804-eb3e-45ae-91b0-f30ca978c76c None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:49.677145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a599804-eb3e-45ae-91b0-f30ca978c76c None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:49.679811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a599804-eb3e-45ae-91b0-f30ca978c76c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:49.682925 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 102/220] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:49 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:49.690868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a599804-eb3e-45ae-91b0-f30ca978c76c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:49.814053 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 119/221] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:49.815714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd524c-7e2c-4f1f-9c82-b882d46066ce None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:49.816247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd524c-7e2c-4f1f-9c82-b882d46066ce None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:49.816537 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd524c-7e2c-4f1f-9c82-b882d46066ce None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:49.825943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 120/222] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:49.825943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b8195-18f9-4522-abd5-67ba470f9d3e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:49.825943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b8195-18f9-4522-abd5-67ba470f9d3e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:49.825943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b8195-18f9-4522-abd5-67ba470f9d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:49.841037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:49.853596 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-da0b8195-18f9-4522-abd5-67ba470f9d3e None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:49.854757 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-da0b8195-18f9-4522-abd5-67ba470f9d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:49.862305 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:49.896734 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a599804-eb3e-45ae-91b0-f30ca978c76c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:49.936412 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 121/223] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:03:49.937432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b8195-18f9-4522-abd5-67ba470f9d3e None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:49.958129 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce3727-cf17-428a-8778-7930114ad70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:49.959246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce3727-cf17-428a-8778-7930114ad70e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:49.959719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce3727-cf17-428a-8778-7930114ad70e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:49.960202 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce3727-cf17-428a-8778-7930114ad70e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:49.961904 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce3727-cf17-428a-8778-7930114ad70e None admin] RBAC: Adding query filter params (role.id=9e92f0503b5c47a4a7368e618f37c6ae, scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b, user.id=47973c228f8b4f3eb106aed0e93a6dee) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:49.962455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce3727-cf17-428a-8778-7930114ad70e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:49.965380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce3727-cf17-428a-8778-7930114ad70e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:49.975896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 103/224] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:49 2022] GET /identity/v3/role_assignments?user.id=47973c228f8b4f3eb106aed0e93a6dee&scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b&role.id=9e92f0503b5c47a4a7368e618f37c6ae => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:49.977266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce3727-cf17-428a-8778-7930114ad70e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:50.140036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b8195-18f9-4522-abd5-67ba470f9d3e None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:50.228896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce3727-cf17-428a-8778-7930114ad70e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:50.231776 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3668978-d3e2-4b30-9b5a-f9256e7fae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:50.232742 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3668978-d3e2-4b30-9b5a-f9256e7fae43 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:50.233025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3668978-d3e2-4b30-9b5a-f9256e7fae43 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:50.233298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3668978-d3e2-4b30-9b5a-f9256e7fae43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:50.241462 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:50.261981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3668978-d3e2-4b30-9b5a-f9256e7fae43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:50.275503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-e3668978-d3e2-4b30-9b5a-f9256e7fae43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:50.275503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:50.275503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:50.275503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:50.275503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:50.275503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:50.275503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:50.275503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:50.275503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:50.275503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:50.275503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:50.275503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:50.275503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:50.275503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:50.275503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:50.275503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:50.276426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:50.276426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:50.276426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:50.276426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:50.276426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:50.276426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:50.276426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:50.276426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:50.276426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:50.276426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:50.276426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:50.276426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:50.276426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:50.276426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:50.276426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:50.276426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:50.277261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:50.277261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:50.277261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:50.277261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:50.277261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:50.277261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:50.277261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:50.277261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:50.277261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:50.277261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:50.277261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:50.277261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:03:50.277261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 122/225] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:03:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:50.286693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3668978-d3e2-4b30-9b5a-f9256e7fae43 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:50.300286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8ce20-183d-4f7e-b217-17439ca8c4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:50.301631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8ce20-183d-4f7e-b217-17439ca8c4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:50.302186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8ce20-183d-4f7e-b217-17439ca8c4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:50.302704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8ce20-183d-4f7e-b217-17439ca8c4a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:50.332864 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8ce20-183d-4f7e-b217-17439ca8c4a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:50.348646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-fee8ce20-183d-4f7e-b217-17439ca8c4a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:03:50.348646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:50.348646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:50.348646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:50.348646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:50.348646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:50.348646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:50.348646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:50.348646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:50.348646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:50.348646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:50.348646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:50.348646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:50.348646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:50.348646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:50.348646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:50.349590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:50.349590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:50.349590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:50.349590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:50.349590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:50.349590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:50.349590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:50.349590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:50.349590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:50.349590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:50.349590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:50.349590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:50.349590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:50.349590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:50.349590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:50.349590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:50.350362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:50.350362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:50.350362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:50.350362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:50.350362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:50.350362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:50.350362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:50.350362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:50.350362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:50.350362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:50.350362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:03:50.350362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:03:50.351103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 104/226] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:03:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:50.365153 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8ce20-183d-4f7e-b217-17439ca8c4a0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:50.375031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:50.434869 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3668978-d3e2-4b30-9b5a-f9256e7fae43 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:50.472310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3ce4f-1188-4310-88dc-d03a49ced984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:50.473251 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3ce4f-1188-4310-88dc-d03a49ced984 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:50.473625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3ce4f-1188-4310-88dc-d03a49ced984 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:50.474013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3ce4f-1188-4310-88dc-d03a49ced984 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:50.474953 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3ce4f-1188-4310-88dc-d03a49ced984 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:50.475361 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3ce4f-1188-4310-88dc-d03a49ced984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:50.476972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3ce4f-1188-4310-88dc-d03a49ced984 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:50.486584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 123/227] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:50.495021 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3ce4f-1188-4310-88dc-d03a49ced984 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:50.614647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:50.628128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8ce20-183d-4f7e-b217-17439ca8c4a0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:50.698006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657addb-bda2-48a5-892e-31694becb8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:50.699029 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657addb-bda2-48a5-892e-31694becb8fa None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:50.699471 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657addb-bda2-48a5-892e-31694becb8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:50.699944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657addb-bda2-48a5-892e-31694becb8fa None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:50.701307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657addb-bda2-48a5-892e-31694becb8fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:50.701839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657addb-bda2-48a5-892e-31694becb8fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:50.704423 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657addb-bda2-48a5-892e-31694becb8fa None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:50.732667 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 105/228] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:03:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:50.737379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3ce4f-1188-4310-88dc-d03a49ced984 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:50.741139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657addb-bda2-48a5-892e-31694becb8fa None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:50.814498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580994b-b058-469f-8918-34dc4b3facf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:50.815942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580994b-b058-469f-8918-34dc4b3facf7 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:50.816433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580994b-b058-469f-8918-34dc4b3facf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:50.816903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580994b-b058-469f-8918-34dc4b3facf7 None admin] PATH_INFO: `/v3/users/7e311e71ebef40328202746fe2b131de` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:50.827377 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580994b-b058-469f-8918-34dc4b3facf7 None admin] RBAC: Authorizing `identity:get_user(user_id=7e311e71ebef40328202746fe2b131de)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:50.829258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580994b-b058-469f-8918-34dc4b3facf7 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:50.831531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 124/229] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:50 2022] GET /identity/v3/users/7e311e71ebef40328202746fe2b131de => generated 283 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:50.845630 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580994b-b058-469f-8918-34dc4b3facf7 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:50.854798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:50.885166 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657addb-bda2-48a5-892e-31694becb8fa None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:50.920243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737d02b-0311-4a29-97d9-841e690a9320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:50.921211 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737d02b-0311-4a29-97d9-841e690a9320 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:50.921498 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737d02b-0311-4a29-97d9-841e690a9320 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:50.921771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737d02b-0311-4a29-97d9-841e690a9320 None admin] PATH_INFO: `/v3/users/7e311e71ebef40328202746fe2b131de` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:50.923008 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737d02b-0311-4a29-97d9-841e690a9320 None admin] RBAC: Authorizing `identity:get_user(user_id=7e311e71ebef40328202746fe2b131de)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:50.924501 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737d02b-0311-4a29-97d9-841e690a9320 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:50.926144 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 106/230] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:50 2022] GET /identity/v3/users/7e311e71ebef40328202746fe2b131de => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:50.936678 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737d02b-0311-4a29-97d9-841e690a9320 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:51.058595 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580994b-b058-469f-8918-34dc4b3facf7 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:51.111614 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:51.131670 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737d02b-0311-4a29-97d9-841e690a9320 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:51.135275 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cc737-6b4e-4992-a137-a81b5ad0c84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:51.136150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cc737-6b4e-4992-a137-a81b5ad0c84a None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:51.136434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cc737-6b4e-4992-a137-a81b5ad0c84a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:51.136703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cc737-6b4e-4992-a137-a81b5ad0c84a None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:51.139270 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cc737-6b4e-4992-a137-a81b5ad0c84a None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:51.140787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7cc737-6b4e-4992-a137-a81b5ad0c84a None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:51.152534 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 125/231] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:50 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:51.163224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cc737-6b4e-4992-a137-a81b5ad0c84a None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:51.210644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f08cd-ac06-403f-8570-77a4d7616868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:51.211510 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f08cd-ac06-403f-8570-77a4d7616868 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:51.211788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f08cd-ac06-403f-8570-77a4d7616868 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:51.212060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f08cd-ac06-403f-8570-77a4d7616868 None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:51.213913 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f08cd-ac06-403f-8570-77a4d7616868 None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:51.215391 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f08cd-ac06-403f-8570-77a4d7616868 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:51.217089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 107/232] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:50 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:51.223984 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f08cd-ac06-403f-8570-77a4d7616868 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:51.229797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:51.341980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f08cd-ac06-403f-8570-77a4d7616868 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:51.376454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4c9c2-ebb0-406e-82da-bdd46b25ddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:51.377554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4c9c2-ebb0-406e-82da-bdd46b25ddcc None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:51.377934 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4c9c2-ebb0-406e-82da-bdd46b25ddcc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:51.378279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4c9c2-ebb0-406e-82da-bdd46b25ddcc None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b/users/7e311e71ebef40328202746fe2b131de/roles/2e761f6eaaa94f9e85d77734e01ac393` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:51.385864 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4c9c2-ebb0-406e-82da-bdd46b25ddcc None admin] RBAC: Authorizing `identity:create_grant(project_id=ca571ac5ee4f4ce99041231e60f5c76b, user_id=7e311e71ebef40328202746fe2b131de, role_id=2e761f6eaaa94f9e85d77734e01ac393)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:51.387387 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4c9c2-ebb0-406e-82da-bdd46b25ddcc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:51.399729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7cc737-6b4e-4992-a137-a81b5ad0c84a None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:51.405164 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 108/233] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:03:51 2022] PUT /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b/users/7e311e71ebef40328202746fe2b131de/roles/2e761f6eaaa94f9e85d77734e01ac393 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:03:51.455181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9bce0-9691-4116-9277-0639823e206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:51.456234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9bce0-9691-4116-9277-0639823e206c None admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:51.456559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9bce0-9691-4116-9277-0639823e206c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:51.456840 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9bce0-9691-4116-9277-0639823e206c None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b/users/7e311e71ebef40328202746fe2b131de/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:51.459822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9bce0-9691-4116-9277-0639823e206c None admin] RBAC: Authorizing `identity:create_grant(project_id=ca571ac5ee4f4ce99041231e60f5c76b, user_id=7e311e71ebef40328202746fe2b131de, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:51.461494 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9bce0-9691-4116-9277-0639823e206c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:51.483812 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 126/234] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:03:51 2022] PUT /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b/users/7e311e71ebef40328202746fe2b131de/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:03:51.908687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bba8cb-b32c-4483-b233-655fe80f24a6 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:51.909348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bba8cb-b32c-4483-b233-655fe80f24a6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:51.909348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bba8cb-b32c-4483-b233-655fe80f24a6 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:51.910705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 109/235] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:51.916551 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49917dae-8237-4958-8415-d13ec2360be3 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:51.916844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49917dae-8237-4958-8415-d13ec2360be3 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:51.917115 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49917dae-8237-4958-8415-d13ec2360be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:51.935458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-49917dae-8237-4958-8415-d13ec2360be3 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:51.936678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-49917dae-8237-4958-8415-d13ec2360be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:52.004103 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:52.028078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 127/236] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:52.068227 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bba8cb-b32c-4483-b233-655fe80f24a6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:52.160246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:52.166182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50232d95-1d33-4266-ac4e-d465eb1e0c27 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:52.166830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50232d95-1d33-4266-ac4e-d465eb1e0c27 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:52.166830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50232d95-1d33-4266-ac4e-d465eb1e0c27 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:52.169256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 128/237] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:52.183811 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b9d1a-2d48-4f62-9332-d480691fb1b5 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:52.184700 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b9d1a-2d48-4f62-9332-d480691fb1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:52.184980 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b9d1a-2d48-4f62-9332-d480691fb1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:52.213961 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-6b8b9d1a-2d48-4f62-9332-d480691fb1b5 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:52.215200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6b8b9d1a-2d48-4f62-9332-d480691fb1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:52.229952 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bba8cb-b32c-4483-b233-655fe80f24a6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:52.295916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e249a2-b854-4f64-ada4-c8ee28cdefca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:52.296773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e249a2-b854-4f64-ada4-c8ee28cdefca None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:52.297058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e249a2-b854-4f64-ada4-c8ee28cdefca None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:52.297331 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e249a2-b854-4f64-ada4-c8ee28cdefca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:52.321511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e249a2-b854-4f64-ada4-c8ee28cdefca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:52.334634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f2e249a2-b854-4f64-ada4-c8ee28cdefca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:03:52.334634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:52.334634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:52.334634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:52.334634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:52.334634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:52.334634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:52.334634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:52.334634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:52.334634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:52.334634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:52.334634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:52.334634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:52.334634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:52.334634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:52.334634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:52.336738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:52.336738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:52.336738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:52.336738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:52.336738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:52.336738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:52.336738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:52.336738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:52.336738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:52.336738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:52.336738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:52.336738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:52.336738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:52.336738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:52.336738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:52.336738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:52.338713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:52.338713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:52.338713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:52.338713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:52.338713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:52.338713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:52.338713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:52.338713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:52.338713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:52.338713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:52.338713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:03:52.338713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:03:52.344487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 110/238] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:52.349351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 129/239] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:52.350245 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e249a2-b854-4f64-ada4-c8ee28cdefca None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:52.378217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127f55-27fe-4150-a6dd-2e9251f04e49 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:52.378867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127f55-27fe-4150-a6dd-2e9251f04e49 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:52.379345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127f55-27fe-4150-a6dd-2e9251f04e49 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:52.380966 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 130/240] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:03:52.386633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23e80b-d6a7-4fe2-9beb-2a0fbd5aac69 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:52.387188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23e80b-d6a7-4fe2-9beb-2a0fbd5aac69 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:52.387669 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23e80b-d6a7-4fe2-9beb-2a0fbd5aac69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:52.405791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-9d23e80b-d6a7-4fe2-9beb-2a0fbd5aac69 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:52.407344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9d23e80b-d6a7-4fe2-9beb-2a0fbd5aac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:52.481601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e249a2-b854-4f64-ada4-c8ee28cdefca None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:52.510553 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 131/241] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:52.512040 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:52.512218 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23e80b-d6a7-4fe2-9beb-2a0fbd5aac69 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:52.533287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078f9df-9708-44bb-b06d-f1aafef7f7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:52.534051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078f9df-9708-44bb-b06d-f1aafef7f7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:52.534358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078f9df-9708-44bb-b06d-f1aafef7f7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:52.534809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078f9df-9708-44bb-b06d-f1aafef7f7d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:52.535588 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078f9df-9708-44bb-b06d-f1aafef7f7d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:52.535973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078f9df-9708-44bb-b06d-f1aafef7f7d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:52.537317 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078f9df-9708-44bb-b06d-f1aafef7f7d2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:52.547992 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 111/242] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:03:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:52.547992 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078f9df-9708-44bb-b06d-f1aafef7f7d2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:52.581103 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:52.651212 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23e80b-d6a7-4fe2-9beb-2a0fbd5aac69 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:52.662358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078f9df-9708-44bb-b06d-f1aafef7f7d2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:52.697921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da69b3d-bc81-459a-a3bc-6554d089c24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:52.699465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da69b3d-bc81-459a-a3bc-6554d089c24f None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:52.699818 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945648b-6eba-40d7-8339-35435e9fc893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:52.700129 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da69b3d-bc81-459a-a3bc-6554d089c24f None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:52.700576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da69b3d-bc81-459a-a3bc-6554d089c24f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:52.700754 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945648b-6eba-40d7-8339-35435e9fc893 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:52.701152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945648b-6eba-40d7-8339-35435e9fc893 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:52.701494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945648b-6eba-40d7-8339-35435e9fc893 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:52.702477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da69b3d-bc81-459a-a3bc-6554d089c24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:52.704790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da69b3d-bc81-459a-a3bc-6554d089c24f None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:52.707352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 132/243] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:03:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:52.708419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da69b3d-bc81-459a-a3bc-6554d089c24f None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:52.713002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945648b-6eba-40d7-8339-35435e9fc893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:52.721313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-9945648b-6eba-40d7-8339-35435e9fc893 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:52.721313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:52.721313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:52.721313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:52.721313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:52.721313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:52.721313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:52.721313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:52.721313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:52.721313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:52.721313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:52.721313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:52.721313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:52.721313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:52.721313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:52.721313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:52.722206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:52.722206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:52.722206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:52.722206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:52.722206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:52.722206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:52.722206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:52.722206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:52.722206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:52.722206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:52.722206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:52.722206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:52.722206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:52.722206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:52.722206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:52.722206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:52.723031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:52.723031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:52.723031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:52.723031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:52.723031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:52.723031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:52.723031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:52.723031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:52.723031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:52.723031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:52.723031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:52.723031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:03:52.723031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 112/244] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:52.723694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945648b-6eba-40d7-8339-35435e9fc893 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:52.778940 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:52.840646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945648b-6eba-40d7-8339-35435e9fc893 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:52.846316 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da69b3d-bc81-459a-a3bc-6554d089c24f None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:52.860067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:52.879029 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5723f6-2484-4363-9379-636c1d66a2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:52.879716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5723f6-2484-4363-9379-636c1d66a2df None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:52.880000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5723f6-2484-4363-9379-636c1d66a2df None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:52.880276 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5723f6-2484-4363-9379-636c1d66a2df None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:52.881038 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5723f6-2484-4363-9379-636c1d66a2df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:52.882552 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5723f6-2484-4363-9379-636c1d66a2df None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:52.884346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415e0e0-6ded-4097-b3cb-b1b5400afa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:52.885466 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415e0e0-6ded-4097-b3cb-b1b5400afa8f None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:52.885895 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415e0e0-6ded-4097-b3cb-b1b5400afa8f None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:52.886313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415e0e0-6ded-4097-b3cb-b1b5400afa8f None admin] PATH_INFO: `/v3/users/9bed6a53ab964865b43a6dd51f12dc5b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:52.902990 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415e0e0-6ded-4097-b3cb-b1b5400afa8f None admin] RBAC: Authorizing `identity:get_user(user_id=9bed6a53ab964865b43a6dd51f12dc5b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:52.904713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415e0e0-6ded-4097-b3cb-b1b5400afa8f None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:52.905505 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 113/245] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:03:52 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:03:52.907707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 133/246] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:52 2022] GET /identity/v3/users/9bed6a53ab964865b43a6dd51f12dc5b => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:52.911453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5723f6-2484-4363-9379-636c1d66a2df None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:52.913150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415e0e0-6ded-4097-b3cb-b1b5400afa8f None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:53.095830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:53.103855 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5723f6-2484-4363-9379-636c1d66a2df None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:53.132042 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415e0e0-6ded-4097-b3cb-b1b5400afa8f None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:53.153965 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbfb4e-8cd1-411a-90e0-e43135814e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:53.154824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbfb4e-8cd1-411a-90e0-e43135814e8a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:53.155468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbfb4e-8cd1-411a-90e0-e43135814e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:53.155843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbfb4e-8cd1-411a-90e0-e43135814e8a None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:53.157126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbfb4e-8cd1-411a-90e0-e43135814e8a None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:53.157545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbfb4e-8cd1-411a-90e0-e43135814e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:53.159204 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbfb4e-8cd1-411a-90e0-e43135814e8a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:53.174520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 114/247] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:03:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:53.178309 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbfb4e-8cd1-411a-90e0-e43135814e8a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:53.184589 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586afb8-e327-4562-aca4-de8f13aede71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:53.185811 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586afb8-e327-4562-aca4-de8f13aede71 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:53.186238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586afb8-e327-4562-aca4-de8f13aede71 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:53.186681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586afb8-e327-4562-aca4-de8f13aede71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:53.237896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:53.272246 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586afb8-e327-4562-aca4-de8f13aede71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:53.274237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586afb8-e327-4562-aca4-de8f13aede71 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:53.293262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbfb4e-8cd1-411a-90e0-e43135814e8a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:53.331615 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48962a57-7762-4d05-acb8-dce47fc6d4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:53.332750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48962a57-7762-4d05-acb8-dce47fc6d4db None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:53.333220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48962a57-7762-4d05-acb8-dce47fc6d4db None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:53.333666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48962a57-7762-4d05-acb8-dce47fc6d4db None admin] PATH_INFO: `/v3/users/47973c228f8b4f3eb106aed0e93a6dee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:53.335211 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48962a57-7762-4d05-acb8-dce47fc6d4db None admin] RBAC: Authorizing `identity:get_user(user_id=47973c228f8b4f3eb106aed0e93a6dee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:53.336893 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48962a57-7762-4d05-acb8-dce47fc6d4db None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:53.339134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 115/248] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:53 2022] GET /identity/v3/users/47973c228f8b4f3eb106aed0e93a6dee => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:53.346704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48962a57-7762-4d05-acb8-dce47fc6d4db None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:53.384461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:53.404087 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 134/249] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:53.409691 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586afb8-e327-4562-aca4-de8f13aede71 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:53.470282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48962a57-7762-4d05-acb8-dce47fc6d4db None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:53.509947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:53.510834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933dc05-20ad-4ee9-858e-c6bf24dd5915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:53.511892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933dc05-20ad-4ee9-858e-c6bf24dd5915 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:53.512302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933dc05-20ad-4ee9-858e-c6bf24dd5915 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:53.512807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933dc05-20ad-4ee9-858e-c6bf24dd5915 None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:53.514198 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933dc05-20ad-4ee9-858e-c6bf24dd5915 None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:53.515852 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933dc05-20ad-4ee9-858e-c6bf24dd5915 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:53.518079 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 116/250] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:53 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:53.523587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933dc05-20ad-4ee9-858e-c6bf24dd5915 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:53.594648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586afb8-e327-4562-aca4-de8f13aede71 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:53.644851 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:53.650238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933dc05-20ad-4ee9-858e-c6bf24dd5915 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:53.679498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b65d5-3783-4c2b-a5a9-93bec3dccf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:53.680735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b65d5-3783-4c2b-a5a9-93bec3dccf6f None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:53.681026 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b65d5-3783-4c2b-a5a9-93bec3dccf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:53.681310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b65d5-3783-4c2b-a5a9-93bec3dccf6f None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:53.682651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b65d5-3783-4c2b-a5a9-93bec3dccf6f None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:53.684131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b65d5-3783-4c2b-a5a9-93bec3dccf6f None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:53.686891 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 135/251] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:53 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:53.687612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1ac2b-00d3-4e45-8241-1f6b44630a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:53.688659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1ac2b-00d3-4e45-8241-1f6b44630a16 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:53.689076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1ac2b-00d3-4e45-8241-1f6b44630a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:53.689484 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1ac2b-00d3-4e45-8241-1f6b44630a16 None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b/users/47973c228f8b4f3eb106aed0e93a6dee/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:53.691592 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b65d5-3783-4c2b-a5a9-93bec3dccf6f None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:53.691994 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1ac2b-00d3-4e45-8241-1f6b44630a16 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca571ac5ee4f4ce99041231e60f5c76b, user_id=47973c228f8b4f3eb106aed0e93a6dee, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:53.693582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1ac2b-00d3-4e45-8241-1f6b44630a16 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:53.712492 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 117/252] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:03:53 2022] PUT /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b/users/47973c228f8b4f3eb106aed0e93a6dee/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:03:53.814070 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b65d5-3783-4c2b-a5a9-93bec3dccf6f None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:53.851731 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442aa211-31ee-4f70-aeb8-0712d651cbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:53.852647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442aa211-31ee-4f70-aeb8-0712d651cbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:53.853073 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442aa211-31ee-4f70-aeb8-0712d651cbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:53.853486 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442aa211-31ee-4f70-aeb8-0712d651cbe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:53.854553 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442aa211-31ee-4f70-aeb8-0712d651cbe7 None admin] RBAC: Adding query filter params (role.id=9b47e9314a0349539ef025e68cb2569a, scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b, user.id=9bed6a53ab964865b43a6dd51f12dc5b) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:53.855030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442aa211-31ee-4f70-aeb8-0712d651cbe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:53.856680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442aa211-31ee-4f70-aeb8-0712d651cbe7 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:53.863520 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 136/253] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:53 2022] GET /identity/v3/role_assignments?user.id=9bed6a53ab964865b43a6dd51f12dc5b&scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b&role.id=9b47e9314a0349539ef025e68cb2569a => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:53.929790 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa83a2b-b193-4512-9931-5ad9facc17af None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:53.930669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa83a2b-b193-4512-9931-5ad9facc17af None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:53.931133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa83a2b-b193-4512-9931-5ad9facc17af None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:53.933008 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 118/254] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:53.940779 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88ecfd-59da-4ec3-9788-2ab06e482dae None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:53.941290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88ecfd-59da-4ec3-9788-2ab06e482dae None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:53.941733 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88ecfd-59da-4ec3-9788-2ab06e482dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:53.956120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:53.970952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-9f88ecfd-59da-4ec3-9788-2ab06e482dae None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:53.972518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9f88ecfd-59da-4ec3-9788-2ab06e482dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:54.050946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 137/255] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:03:54.057563 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d702159-8ed4-40fd-89e0-dfe0d345929a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:54.058049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d702159-8ed4-40fd-89e0-dfe0d345929a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:54.058506 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d702159-8ed4-40fd-89e0-dfe0d345929a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:54.060317 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 119/256] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:54.065615 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b6f46-8a26-4dfc-8543-2327e74e7e9b None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:54.065900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b6f46-8a26-4dfc-8543-2327e74e7e9b None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:54.066175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b6f46-8a26-4dfc-8543-2327e74e7e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:54.084106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-158b6f46-8a26-4dfc-8543-2327e74e7e9b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:54.086079 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d702159-8ed4-40fd-89e0-dfe0d345929a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:54.087461 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-158b6f46-8a26-4dfc-8543-2327e74e7e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:54.175158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 138/257] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:54.252093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d702159-8ed4-40fd-89e0-dfe0d345929a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:54.255739 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b6f46-8a26-4dfc-8543-2327e74e7e9b None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:54.325118 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfeb3a-6569-45a1-ad59-80112b2d2e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:54.326161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfeb3a-6569-45a1-ad59-80112b2d2e1c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:54.329181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfeb3a-6569-45a1-ad59-80112b2d2e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:54.329605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bfeb3a-6569-45a1-ad59-80112b2d2e1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:54.354375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bfeb3a-6569-45a1-ad59-80112b2d2e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:54.363287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f2bfeb3a-6569-45a1-ad59-80112b2d2e1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:54.363287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:54.363287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:54.363287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:54.363287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:54.363287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:54.363287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:54.363287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:54.363287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:54.363287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:54.363287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:54.363287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:54.363287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:54.363287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:54.363287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:54.363287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:54.364193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:54.364193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:54.364193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:54.364193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:54.364193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:54.364193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:54.364193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:54.364193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:54.364193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:54.364193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:54.364193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:54.364193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:54.364193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:54.364193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:54.364193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:54.364193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:54.364996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:54.364996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:54.364996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:54.364996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:54.364996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:54.364996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:54.364996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:54.364996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:54.364996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:54.364996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:54.364996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:03:54.364996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:03:54.367536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 120/258] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:03:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:54.372865 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfeb3a-6569-45a1-ad59-80112b2d2e1c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:54.376995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:54.407709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:54.450803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b6f46-8a26-4dfc-8543-2327e74e7e9b None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:54.505165 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51747d55-48ec-458c-828f-f90af849ab85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:54.505896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51747d55-48ec-458c-828f-f90af849ab85 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:54.506183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51747d55-48ec-458c-828f-f90af849ab85 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:54.506485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51747d55-48ec-458c-828f-f90af849ab85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:54.527523 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51747d55-48ec-458c-828f-f90af849ab85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:54.540871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-51747d55-48ec-458c-828f-f90af849ab85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:03:54.540871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:54.540871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:54.540871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:54.540871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:54.540871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:54.540871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:54.540871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:54.540871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:54.540871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:54.540871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:54.540871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:54.540871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:54.540871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:54.540871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:54.540871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:54.541790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:54.541790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:54.541790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:54.541790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:54.541790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:54.541790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:54.541790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:54.541790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:54.541790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:54.541790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:54.541790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:54.541790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:54.541790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:54.541790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:54.541790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:54.541790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:54.542597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:54.542597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:54.542597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:54.542597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:54.542597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:54.542597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:54.542597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:54.542597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:54.542597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:54.542597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:54.542597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:03:54.542597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:03:54.542597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 139/259] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:03:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:54.551913 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51747d55-48ec-458c-828f-f90af849ab85 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:54.594999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bfeb3a-6569-45a1-ad59-80112b2d2e1c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:54.658144 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2b249-a07d-4053-a27b-07e2b1082657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:54.658913 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2b249-a07d-4053-a27b-07e2b1082657 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:54.659200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2b249-a07d-4053-a27b-07e2b1082657 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:54.659480 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2b249-a07d-4053-a27b-07e2b1082657 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:54.660353 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2b249-a07d-4053-a27b-07e2b1082657 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:54.660667 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2b249-a07d-4053-a27b-07e2b1082657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:54.662183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2b249-a07d-4053-a27b-07e2b1082657 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:54.681262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 121/260] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:54.682278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2b249-a07d-4053-a27b-07e2b1082657 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:54.700336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51747d55-48ec-458c-828f-f90af849ab85 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:54.723644 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:54.736581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766c383-c961-4802-a42a-d910f2e1b411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:54.737319 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766c383-c961-4802-a42a-d910f2e1b411 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:54.737608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766c383-c961-4802-a42a-d910f2e1b411 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:54.737888 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766c383-c961-4802-a42a-d910f2e1b411 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:54.738695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766c383-c961-4802-a42a-d910f2e1b411 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:54.739009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766c383-c961-4802-a42a-d910f2e1b411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:54.740423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766c383-c961-4802-a42a-d910f2e1b411 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:54.758573 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 140/261] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:03:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:54.776390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766c383-c961-4802-a42a-d910f2e1b411 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:54.792137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:54.816072 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2b249-a07d-4053-a27b-07e2b1082657 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:54.870545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32737ec9-f57a-480d-98d3-333fc19c4853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:54.871798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32737ec9-f57a-480d-98d3-333fc19c4853 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:54.872255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32737ec9-f57a-480d-98d3-333fc19c4853 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:54.872674 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32737ec9-f57a-480d-98d3-333fc19c4853 None admin] PATH_INFO: `/v3/users/7e311e71ebef40328202746fe2b131de` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:54.880108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32737ec9-f57a-480d-98d3-333fc19c4853 None admin] RBAC: Authorizing `identity:get_user(user_id=7e311e71ebef40328202746fe2b131de)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:54.883665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32737ec9-f57a-480d-98d3-333fc19c4853 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:54.894485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 122/262] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:54 2022] GET /identity/v3/users/7e311e71ebef40328202746fe2b131de => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:54.895504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32737ec9-f57a-480d-98d3-333fc19c4853 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:54.992090 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766c383-c961-4802-a42a-d910f2e1b411 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:55.059413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e3938-e58c-4d4a-8348-18617fab46e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:55.060555 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e3938-e58c-4d4a-8348-18617fab46e8 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:55.060986 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e3938-e58c-4d4a-8348-18617fab46e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:55.061408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e3938-e58c-4d4a-8348-18617fab46e8 None admin] PATH_INFO: `/v3/users/7e311e71ebef40328202746fe2b131de` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:55.063196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e3938-e58c-4d4a-8348-18617fab46e8 None admin] RBAC: Authorizing `identity:get_user(user_id=7e311e71ebef40328202746fe2b131de)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:55.065577 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e3938-e58c-4d4a-8348-18617fab46e8 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:55.067507 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 141/263] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:54 2022] GET /identity/v3/users/7e311e71ebef40328202746fe2b131de => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:55.073699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e3938-e58c-4d4a-8348-18617fab46e8 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:55.160557 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32737ec9-f57a-480d-98d3-333fc19c4853 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:55.176688 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:55.239697 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e3938-e58c-4d4a-8348-18617fab46e8 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:55.278053 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093e5f3-613b-47de-8cce-af7f838e4212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:55.278734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093e5f3-613b-47de-8cce-af7f838e4212 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:55.279115 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093e5f3-613b-47de-8cce-af7f838e4212 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:55.279398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093e5f3-613b-47de-8cce-af7f838e4212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:55.291688 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26da2d3-afad-4207-a9fe-ea91fe3e2d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:55.292366 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da2d3-afad-4207-a9fe-ea91fe3e2d93 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:55.292654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da2d3-afad-4207-a9fe-ea91fe3e2d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:55.292939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da2d3-afad-4207-a9fe-ea91fe3e2d93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:55.340657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:55.375704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093e5f3-613b-47de-8cce-af7f838e4212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:55.377233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093e5f3-613b-47de-8cce-af7f838e4212 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:55.440020 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:55.464515 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26da2d3-afad-4207-a9fe-ea91fe3e2d93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:55.466026 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26da2d3-afad-4207-a9fe-ea91fe3e2d93 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:55.511510 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 142/264] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:55.517501 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093e5f3-613b-47de-8cce-af7f838e4212 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:55.657664 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 123/265] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 762 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:03:55.665525 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26da2d3-afad-4207-a9fe-ea91fe3e2d93 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:55.692561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093e5f3-613b-47de-8cce-af7f838e4212 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:55.724849 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:55.757844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56201ee5-9bab-45ca-b3af-b37d8ea31c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:55.759168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56201ee5-9bab-45ca-b3af-b37d8ea31c10 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:55.759677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56201ee5-9bab-45ca-b3af-b37d8ea31c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:55.760152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56201ee5-9bab-45ca-b3af-b37d8ea31c10 None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:55.765143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56201ee5-9bab-45ca-b3af-b37d8ea31c10 None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:55.766638 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56201ee5-9bab-45ca-b3af-b37d8ea31c10 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:55.768639 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 143/266] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:55 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:55.774664 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56201ee5-9bab-45ca-b3af-b37d8ea31c10 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:55.789378 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26da2d3-afad-4207-a9fe-ea91fe3e2d93 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:55.808830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:55.830100 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f7044-5210-4b06-943b-c381c4823f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:55.831061 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f7044-5210-4b06-943b-c381c4823f1b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:55.831347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f7044-5210-4b06-943b-c381c4823f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:55.831621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f7044-5210-4b06-943b-c381c4823f1b None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:55.833511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f7044-5210-4b06-943b-c381c4823f1b None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:55.839341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f7044-5210-4b06-943b-c381c4823f1b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:55.841376 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 124/267] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:55 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:03:55.850508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f7044-5210-4b06-943b-c381c4823f1b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:55.956681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56201ee5-9bab-45ca-b3af-b37d8ea31c10 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:56.000829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6be1c3-5da8-4ab0-8d2d-4cc4c517ad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:56.001872 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6be1c3-5da8-4ab0-8d2d-4cc4c517ad14 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:56.002477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6be1c3-5da8-4ab0-8d2d-4cc4c517ad14 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:56.002896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f7044-5210-4b06-943b-c381c4823f1b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:56.003165 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6be1c3-5da8-4ab0-8d2d-4cc4c517ad14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:56.004218 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6be1c3-5da8-4ab0-8d2d-4cc4c517ad14 None admin] RBAC: Adding query filter params (role.id=2e761f6eaaa94f9e85d77734e01ac393, scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b, user.id=7e311e71ebef40328202746fe2b131de) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:56.004802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6be1c3-5da8-4ab0-8d2d-4cc4c517ad14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:56.006596 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6be1c3-5da8-4ab0-8d2d-4cc4c517ad14 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:56.020298 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:56.021857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 144/268] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:55 2022] GET /identity/v3/role_assignments?user.id=7e311e71ebef40328202746fe2b131de&scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b&role.id=2e761f6eaaa94f9e85d77734e01ac393 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:56.039919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36b9e6-23e3-4379-926b-6b40b6f9a916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:56.040573 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36b9e6-23e3-4379-926b-6b40b6f9a916 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:56.040852 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36b9e6-23e3-4379-926b-6b40b6f9a916 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:56.041121 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36b9e6-23e3-4379-926b-6b40b6f9a916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:56.042089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36b9e6-23e3-4379-926b-6b40b6f9a916 None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b, user.id=7e311e71ebef40328202746fe2b131de) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:56.042274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36b9e6-23e3-4379-926b-6b40b6f9a916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:56.043805 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36b9e6-23e3-4379-926b-6b40b6f9a916 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:56.050666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 125/269] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:55 2022] GET /identity/v3/role_assignments?user.id=7e311e71ebef40328202746fe2b131de&scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:56.258093 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c0c3-11d4-4945-bf31-58c1fbecf624 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:56.258335 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c0c3-11d4-4945-bf31-58c1fbecf624 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:56.258702 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c0c3-11d4-4945-bf31-58c1fbecf624 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:56.260104 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 145/270] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:56.269583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88255a1-7ffa-4a16-bfcc-840db3d4a078 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:56.270113 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88255a1-7ffa-4a16-bfcc-840db3d4a078 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:56.270377 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88255a1-7ffa-4a16-bfcc-840db3d4a078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:56.294151 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f88255a1-7ffa-4a16-bfcc-840db3d4a078 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:56.295577 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f88255a1-7ffa-4a16-bfcc-840db3d4a078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:56.371510 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 126/271] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:56.398692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489c0c3-11d4-4945-bf31-58c1fbecf624 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:56.506982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:56.529516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489c0c3-11d4-4945-bf31-58c1fbecf624 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:56.575650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78b802-61c6-42b0-9235-74a877a34247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:56.576731 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78b802-61c6-42b0-9235-74a877a34247 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:56.577151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78b802-61c6-42b0-9235-74a877a34247 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:56.577552 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78b802-61c6-42b0-9235-74a877a34247 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:56.588924 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78b802-61c6-42b0-9235-74a877a34247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:56.599610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-4a78b802-61c6-42b0-9235-74a877a34247 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:56.599610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:56.599610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:56.599610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:56.599610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:56.599610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:56.599610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:56.599610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:56.599610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:56.599610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:56.599610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:56.599610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:56.599610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:56.599610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:56.599610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:56.599610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:56.600729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:56.600729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:56.600729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:56.600729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:56.600729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:56.600729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:56.600729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:56.600729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:56.600729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:56.600729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:56.600729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:56.600729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:56.600729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:56.600729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:56.600729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:56.600729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:56.601699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:56.601699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:56.601699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:56.601699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:56.601699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:56.601699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:56.601699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:56.601699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:56.601699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:56.601699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:56.601699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:56.601699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:03:56.603794 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 146/272] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:56.610984 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88255a1-7ffa-4a16-bfcc-840db3d4a078 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:56.669025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121d1c1-7129-4e76-a531-97ca2d927c99 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:56.669533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121d1c1-7129-4e76-a531-97ca2d927c99 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:56.669958 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121d1c1-7129-4e76-a531-97ca2d927c99 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:56.671497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 147/273] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:03:56.677740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ff77e-19b0-46bd-a84d-1eda05a4e2a0 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:56.678302 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ff77e-19b0-46bd-a84d-1eda05a4e2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:56.678783 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ff77e-19b0-46bd-a84d-1eda05a4e2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:56.700454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-db5ff77e-19b0-46bd-a84d-1eda05a4e2a0 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:56.702358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-db5ff77e-19b0-46bd-a84d-1eda05a4e2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:56.752452 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88255a1-7ffa-4a16-bfcc-840db3d4a078 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:56.765266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:56.778983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 148/274] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:03:56.787880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03da8a7-bdfc-42c7-9ec1-1ae129329630 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:56.788092 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03da8a7-bdfc-42c7-9ec1-1ae129329630 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:56.788365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03da8a7-bdfc-42c7-9ec1-1ae129329630 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:56.789316 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197059dd-12a3-41ee-92b3-cce2e322472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:56.789695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 149/275] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:56.789997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197059dd-12a3-41ee-92b3-cce2e322472c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:56.790283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197059dd-12a3-41ee-92b3-cce2e322472c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:56.790662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197059dd-12a3-41ee-92b3-cce2e322472c None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:56.790756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53881625-5547-4a43-96a2-c74b6be100ff None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:56.791015 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53881625-5547-4a43-96a2-c74b6be100ff None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:56.791284 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53881625-5547-4a43-96a2-c74b6be100ff None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:56.791525 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197059dd-12a3-41ee-92b3-cce2e322472c None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:56.791790 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197059dd-12a3-41ee-92b3-cce2e322472c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:56.792593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 150/276] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:56.795176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197059dd-12a3-41ee-92b3-cce2e322472c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:56.795598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01298674-01eb-4c74-89f0-84dd5795756b None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:56.795959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01298674-01eb-4c74-89f0-84dd5795756b None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:56.796238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01298674-01eb-4c74-89f0-84dd5795756b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:56.810474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 127/277] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:03:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:56.810474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71540c1-61dd-4303-9891-7554055b9c9b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:56.810474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71540c1-61dd-4303-9891-7554055b9c9b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:56.810474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71540c1-61dd-4303-9891-7554055b9c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:56.813240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-01298674-01eb-4c74-89f0-84dd5795756b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:56.814497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-01298674-01eb-4c74-89f0-84dd5795756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:56.825660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b71540c1-61dd-4303-9891-7554055b9c9b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:56.826859 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b71540c1-61dd-4303-9891-7554055b9c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:56.880276 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 151/278] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:56.881112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01298674-01eb-4c74-89f0-84dd5795756b None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:56.891562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 128/279] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:56.892210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71540c1-61dd-4303-9891-7554055b9c9b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:56.893872 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:56.989792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01298674-01eb-4c74-89f0-84dd5795756b None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:56.996960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71540c1-61dd-4303-9891-7554055b9c9b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:56.999264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:57.022704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62f662-5678-4f96-8a5c-96e143c02ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:57.023498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62f662-5678-4f96-8a5c-96e143c02ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:57.023774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62f662-5678-4f96-8a5c-96e143c02ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:57.024043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62f662-5678-4f96-8a5c-96e143c02ed5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:57.031103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d91cb-c688-4649-8e3c-57876404be96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:57.031981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d91cb-c688-4649-8e3c-57876404be96 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:57.032262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d91cb-c688-4649-8e3c-57876404be96 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:57.032534 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d91cb-c688-4649-8e3c-57876404be96 None admin] PATH_INFO: `/v3/users/b4f2850c10b54fa6ab8b81bf388607b4` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:57.034093 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62f662-5678-4f96-8a5c-96e143c02ed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:57.041867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-ea62f662-5678-4f96-8a5c-96e143c02ed5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:03:57.041867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:57.041867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:57.041867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:57.041867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:57.041867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:57.041867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:57.041867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:57.041867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:57.041867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:57.041867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:57.041867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:57.041867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:57.041867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:57.041867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:57.041867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:57.042808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:57.042808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:57.042808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:57.042808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:57.042808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:57.042808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:57.042808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:57.042808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:57.042808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:57.042808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:57.042808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:57.042808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:57.042808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:57.042808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:57.042808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:57.042808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:57.048709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:57.048709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:57.048709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:57.048709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:57.048709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:57.048709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:57.048709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:57.048709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:57.048709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:57.048709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:57.048709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:03:57.048709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:03:57.048709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 152/280] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:57.048709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62f662-5678-4f96-8a5c-96e143c02ed5 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:57.049474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d91cb-c688-4649-8e3c-57876404be96 None admin] RBAC: Authorizing `identity:get_user(user_id=b4f2850c10b54fa6ab8b81bf388607b4)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:57.050271 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d91cb-c688-4649-8e3c-57876404be96 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:57.057466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 129/281] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:56 2022] GET /identity/v3/users/b4f2850c10b54fa6ab8b81bf388607b4 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:57.057466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d91cb-c688-4649-8e3c-57876404be96 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:57.113163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:57.152653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62f662-5678-4f96-8a5c-96e143c02ed5 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:57.154711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d91cb-c688-4649-8e3c-57876404be96 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:57.185613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591d829-c244-46b9-9287-d19777eeb684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:57.186415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591d829-c244-46b9-9287-d19777eeb684 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:57.186712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591d829-c244-46b9-9287-d19777eeb684 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:57.186983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591d829-c244-46b9-9287-d19777eeb684 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:57.188124 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591d829-c244-46b9-9287-d19777eeb684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:57.188815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c84cc-c8fd-40a7-8a39-c51730e5d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:57.189577 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591d829-c244-46b9-9287-d19777eeb684 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:57.189677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c84cc-c8fd-40a7-8a39-c51730e5d20f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:57.189890 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c84cc-c8fd-40a7-8a39-c51730e5d20f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:57.190169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c84cc-c8fd-40a7-8a39-c51730e5d20f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:57.191254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 153/282] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:03:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:57.192008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591d829-c244-46b9-9287-d19777eeb684 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:57.204105 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c84cc-c8fd-40a7-8a39-c51730e5d20f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:03:57.212078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-616c84cc-c8fd-40a7-8a39-c51730e5d20f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:57.212078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:03:57.212078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:03:57.212078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:03:57.212078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:03:57.212078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:03:57.212078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:03:57.212078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:03:57.212078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:03:57.212078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:03:57.212078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:03:57.212078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:03:57.212078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:03:57.212078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:03:57.212078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:03:57.212078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:03:57.212960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:03:57.212960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:03:57.212960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:03:57.212960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:03:57.212960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:03:57.212960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:03:57.212960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:03:57.212960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:03:57.212960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:03:57.212960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:03:57.212960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:03:57.212960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:03:57.212960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:03:57.212960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:03:57.212960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:03:57.212960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:03:57.213759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:03:57.213759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:03:57.213759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:03:57.213759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:03:57.213759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:03:57.213759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:03:57.213759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:03:57.213759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:03:57.213759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:03:57.213759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:03:57.213759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:03:57.213759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:03:57.213759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 130/283] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:03:57.214439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c84cc-c8fd-40a7-8a39-c51730e5d20f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:57.235080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:57.295288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591d829-c244-46b9-9287-d19777eeb684 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:57.314935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c84cc-c8fd-40a7-8a39-c51730e5d20f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:57.324163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:57.329715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55e18f-a496-4225-9926-7d63b8757515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:57.330422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55e18f-a496-4225-9926-7d63b8757515 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:57.330752 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55e18f-a496-4225-9926-7d63b8757515 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:57.331029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55e18f-a496-4225-9926-7d63b8757515 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:57.331784 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55e18f-a496-4225-9926-7d63b8757515 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:57.332085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55e18f-a496-4225-9926-7d63b8757515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:57.333461 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55e18f-a496-4225-9926-7d63b8757515 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:57.341578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 154/284] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:03:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:57.342337 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55e18f-a496-4225-9926-7d63b8757515 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:57.350119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbdb02-bd2d-4478-bef8-eb60f36e7b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:57.350803 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbdb02-bd2d-4478-bef8-eb60f36e7b8c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:57.351099 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbdb02-bd2d-4478-bef8-eb60f36e7b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:57.351381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbdb02-bd2d-4478-bef8-eb60f36e7b8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:57.352219 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbdb02-bd2d-4478-bef8-eb60f36e7b8c None admin] RBAC: Adding query filter params (role.id=9e92f0503b5c47a4a7368e618f37c6ae, user.id=b4f2850c10b54fa6ab8b81bf388607b4, scope.system=all) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:57.352531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbdb02-bd2d-4478-bef8-eb60f36e7b8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:57.353979 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbdb02-bd2d-4478-bef8-eb60f36e7b8c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:57.358950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 131/285] 10.222.0.99 () {56 vars in 1308 bytes} [Mon Jul 18 14:03:57 2022] GET /identity/v3/role_assignments?user.id=b4f2850c10b54fa6ab8b81bf388607b4&scope.system=all&role.id=9e92f0503b5c47a4a7368e618f37c6ae => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:57.359705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbdb02-bd2d-4478-bef8-eb60f36e7b8c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:57.452174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55e18f-a496-4225-9926-7d63b8757515 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:57.456795 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:57.474489 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbdb02-bd2d-4478-bef8-eb60f36e7b8c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:57.492892 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d7259-fe3b-403f-93e8-f750f6eb244c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:57.493976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7259-fe3b-403f-93e8-f750f6eb244c None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:57.494491 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7259-fe3b-403f-93e8-f750f6eb244c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:57.494971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7259-fe3b-403f-93e8-f750f6eb244c None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:57.496014 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d7259-fe3b-403f-93e8-f750f6eb244c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:57.497706 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d7259-fe3b-403f-93e8-f750f6eb244c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:57.512239 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de087ed0-8fd1-43e4-aa09-32569e2d3899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:57.512967 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de087ed0-8fd1-43e4-aa09-32569e2d3899 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:57.513275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de087ed0-8fd1-43e4-aa09-32569e2d3899 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:57.513575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de087ed0-8fd1-43e4-aa09-32569e2d3899 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:57.514413 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de087ed0-8fd1-43e4-aa09-32569e2d3899 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:57.514759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de087ed0-8fd1-43e4-aa09-32569e2d3899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:57.516229 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de087ed0-8fd1-43e4-aa09-32569e2d3899 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:57.524061 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 155/286] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:03:57 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:03:57.525137 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d7259-fe3b-403f-93e8-f750f6eb244c None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:57.536189 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 132/287] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:03:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:57.537326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de087ed0-8fd1-43e4-aa09-32569e2d3899 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:57.584991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:57.643319 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d7259-fe3b-403f-93e8-f750f6eb244c None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:57.690709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd85f7-44e5-4c40-bcb2-766a671ad021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:57.690913 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de087ed0-8fd1-43e4-aa09-32569e2d3899 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:57.692010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd85f7-44e5-4c40-bcb2-766a671ad021 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:57.692505 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd85f7-44e5-4c40-bcb2-766a671ad021 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:57.693050 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd85f7-44e5-4c40-bcb2-766a671ad021 None admin] PATH_INFO: `/v3/users/9bed6a53ab964865b43a6dd51f12dc5b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:57.696116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd85f7-44e5-4c40-bcb2-766a671ad021 None admin] RBAC: Authorizing `identity:get_user(user_id=9bed6a53ab964865b43a6dd51f12dc5b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:57.700171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd85f7-44e5-4c40-bcb2-766a671ad021 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:57.703294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 156/288] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:57 2022] GET /identity/v3/users/9bed6a53ab964865b43a6dd51f12dc5b => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:57.710759 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd85f7-44e5-4c40-bcb2-766a671ad021 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:57.735702 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca5f80-e2b7-40a7-b563-cf303bcff733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:57.736565 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca5f80-e2b7-40a7-b563-cf303bcff733 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:57.736910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca5f80-e2b7-40a7-b563-cf303bcff733 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:57.737192 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca5f80-e2b7-40a7-b563-cf303bcff733 None admin] PATH_INFO: `/v3/users/47973c228f8b4f3eb106aed0e93a6dee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:57.738438 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca5f80-e2b7-40a7-b563-cf303bcff733 None admin] RBAC: Authorizing `identity:get_user(user_id=47973c228f8b4f3eb106aed0e93a6dee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:57.740073 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca5f80-e2b7-40a7-b563-cf303bcff733 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:57.741914 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 133/289] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:03:57 2022] GET /identity/v3/users/47973c228f8b4f3eb106aed0e93a6dee => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:57.747851 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca5f80-e2b7-40a7-b563-cf303bcff733 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:57.768201 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:57.848981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd85f7-44e5-4c40-bcb2-766a671ad021 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:57.872813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:57.889512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca5f80-e2b7-40a7-b563-cf303bcff733 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:57.900114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae4363-5f19-480b-8ea6-58fe135c1ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:57.900989 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae4363-5f19-480b-8ea6-58fe135c1ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:57.901645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae4363-5f19-480b-8ea6-58fe135c1ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:57.901926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae4363-5f19-480b-8ea6-58fe135c1ec4 None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:57.903564 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae4363-5f19-480b-8ea6-58fe135c1ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:57.905359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae4363-5f19-480b-8ea6-58fe135c1ec4 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:57.907935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 157/290] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:57 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:57.913774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae4363-5f19-480b-8ea6-58fe135c1ec4 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:57.927906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46219dd1-734f-4757-ab80-88c9aed1b11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:57.928551 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46219dd1-734f-4757-ab80-88c9aed1b11e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:57.928835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46219dd1-734f-4757-ab80-88c9aed1b11e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:57.929112 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46219dd1-734f-4757-ab80-88c9aed1b11e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:58.019748 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46219dd1-734f-4757-ab80-88c9aed1b11e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:58.021744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46219dd1-734f-4757-ab80-88c9aed1b11e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:58.042949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:58.053128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae4363-5f19-480b-8ea6-58fe135c1ec4 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:58.087914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1823b-38a5-46ee-bb1f-3941fe05faad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:58.088810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1823b-38a5-46ee-bb1f-3941fe05faad None admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:58.089098 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1823b-38a5-46ee-bb1f-3941fe05faad None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:58.089466 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1823b-38a5-46ee-bb1f-3941fe05faad None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b/users/9bed6a53ab964865b43a6dd51f12dc5b/roles/9b47e9314a0349539ef025e68cb2569a` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:58.091901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1823b-38a5-46ee-bb1f-3941fe05faad None admin] RBAC: Authorizing `identity:create_grant(project_id=ca571ac5ee4f4ce99041231e60f5c76b, user_id=9bed6a53ab964865b43a6dd51f12dc5b, role_id=9b47e9314a0349539ef025e68cb2569a)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:58.093121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1823b-38a5-46ee-bb1f-3941fe05faad None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:58.109622 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 158/291] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:03:57 2022] PUT /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b/users/9bed6a53ab964865b43a6dd51f12dc5b/roles/9b47e9314a0349539ef025e68cb2569a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:03:58.194833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 134/292] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:03:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 14:03:58.200518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1823b-38a5-46ee-bb1f-3941fe05faad None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:58.271841 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:58.339524 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1823b-38a5-46ee-bb1f-3941fe05faad None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:58.378621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ba08a-d85b-4857-bd2d-b052bada7c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:58.379488 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ba08a-d85b-4857-bd2d-b052bada7c7d None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:58.379769 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ba08a-d85b-4857-bd2d-b052bada7c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:58.380044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ba08a-d85b-4857-bd2d-b052bada7c7d None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:58.381301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ba08a-d85b-4857-bd2d-b052bada7c7d None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:58.382842 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ba08a-d85b-4857-bd2d-b052bada7c7d None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:58.384915 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 159/293] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:03:58 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:58.390697 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46219dd1-734f-4757-ab80-88c9aed1b11e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:58.526160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46219dd1-734f-4757-ab80-88c9aed1b11e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:58.540737 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:58.561037 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c32216-5e0d-405c-9c61-14d7ff77f206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:58.561696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c32216-5e0d-405c-9c61-14d7ff77f206 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:58.562038 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c32216-5e0d-405c-9c61-14d7ff77f206 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:58.562319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c32216-5e0d-405c-9c61-14d7ff77f206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:58.563245 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c32216-5e0d-405c-9c61-14d7ff77f206 None admin] RBAC: Adding query filter params (role.id=9e92f0503b5c47a4a7368e618f37c6ae, scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b, user.id=47973c228f8b4f3eb106aed0e93a6dee) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:03:58.563561 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c32216-5e0d-405c-9c61-14d7ff77f206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:03:58.565074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c32216-5e0d-405c-9c61-14d7ff77f206 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:03:58.571835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 135/294] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:03:58 2022] GET /identity/v3/role_assignments?user.id=47973c228f8b4f3eb106aed0e93a6dee&scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b&role.id=9e92f0503b5c47a4a7368e618f37c6ae => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:03:59.725960 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3400945-eed1-4863-ba24-6459d4dc365c None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:59.726542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3400945-eed1-4863-ba24-6459d4dc365c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:59.726622 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3400945-eed1-4863-ba24-6459d4dc365c None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:59.728338 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 160/295] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:59.733857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54f80d-4b6b-4543-9f37-2218b333071b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:59.734282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54f80d-4b6b-4543-9f37-2218b333071b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:59.734440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54f80d-4b6b-4543-9f37-2218b333071b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:59.751943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1f54f80d-4b6b-4543-9f37-2218b333071b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:59.753197 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1f54f80d-4b6b-4543-9f37-2218b333071b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:59.823299 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 136/296] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:03:59.845454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3400945-eed1-4863-ba24-6459d4dc365c None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:03:59.927395 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d2939-77f9-4f4e-8da4-c2b7a74c0f36 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:59.927739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d2939-77f9-4f4e-8da4-c2b7a74c0f36 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:59.927955 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d2939-77f9-4f4e-8da4-c2b7a74c0f36 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:59.930335 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 137/297] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:03:59.938706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23877cd0-f076-4ae7-8943-eeb3fa44cb29 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:59.939019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23877cd0-f076-4ae7-8943-eeb3fa44cb29 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:59.939326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23877cd0-f076-4ae7-8943-eeb3fa44cb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:03:59.955900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3400945-eed1-4863-ba24-6459d4dc365c None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:03:59.957352 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-23877cd0-f076-4ae7-8943-eeb3fa44cb29 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:03:59.958831 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-23877cd0-f076-4ae7-8943-eeb3fa44cb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:03:59.970582 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:03:59.992425 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ceeaa-d65c-41fb-a308-c569099ca5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:03:59.993312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ceeaa-d65c-41fb-a308-c569099ca5db None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:03:59.993600 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ceeaa-d65c-41fb-a308-c569099ca5db None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:03:59.993877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ceeaa-d65c-41fb-a308-c569099ca5db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:00.005253 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ceeaa-d65c-41fb-a308-c569099ca5db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:00.013530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-826ceeaa-d65c-41fb-a308-c569099ca5db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:04:00.013530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:00.013530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:00.013530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:00.013530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:00.013530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:00.013530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:00.013530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:00.013530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:00.013530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:00.013530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:00.013530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:00.013530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:00.013530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:00.013530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:00.013530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:00.015645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:00.015645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:00.015645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:00.015645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:00.015645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:00.015645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:00.015645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:00.015645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:00.015645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:00.015645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:00.015645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:00.015645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:00.015645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:00.015645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:00.015645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:00.015645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:00.017567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:00.017567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:00.017567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:00.017567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:00.017567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:00.017567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:00.017567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:00.017567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:00.017567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:00.017567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:00.017567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:04:00.017567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:00.017567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 161/298] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:03:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:00.027601 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ceeaa-d65c-41fb-a308-c569099ca5db None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:00.033275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 138/299] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:04:00.057518 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23877cd0-f076-4ae7-8943-eeb3fa44cb29 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:00.100654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:00.129998 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ceeaa-d65c-41fb-a308-c569099ca5db None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:00.167532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bf0b1-ebcd-460c-ac41-5373488ad46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:00.168205 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bf0b1-ebcd-460c-ac41-5373488ad46e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:00.168487 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bf0b1-ebcd-460c-ac41-5373488ad46e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:00.168762 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bf0b1-ebcd-460c-ac41-5373488ad46e None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:00.169513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bf0b1-ebcd-460c-ac41-5373488ad46e None admin] RBAC: Adding query filter params (name=member) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:00.169815 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bf0b1-ebcd-460c-ac41-5373488ad46e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:00.171427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bf0b1-ebcd-460c-ac41-5373488ad46e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:00.172911 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23877cd0-f076-4ae7-8943-eeb3fa44cb29 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:00.184399 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 162/300] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:04:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:00.184399 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4eeec-c237-4492-b1e6-03ca16a1fa29 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:00.184399 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4eeec-c237-4492-b1e6-03ca16a1fa29 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:00.184399 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4eeec-c237-4492-b1e6-03ca16a1fa29 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:00.184399 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 163/301] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:00.187308 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4eeec-c237-4492-b1e6-03ca16a1fa29 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:00.217015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0837afa-c09e-4be7-a3b6-d457a5570645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:00.217226 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0837afa-c09e-4be7-a3b6-d457a5570645 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:00.217580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0837afa-c09e-4be7-a3b6-d457a5570645 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:00.217703 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0837afa-c09e-4be7-a3b6-d457a5570645 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:00.229131 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0837afa-c09e-4be7-a3b6-d457a5570645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:00.231781 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:00.237447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b0837afa-c09e-4be7-a3b6-d457a5570645 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:04:00.237447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:00.237447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:00.237447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:00.237447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:00.237447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:00.237447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:00.237447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:00.237447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:00.237447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:00.237447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:00.237447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:00.237447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:00.237447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:00.237447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:00.237447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:00.238318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:00.238318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:00.238318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:00.238318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:00.238318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:00.238318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:00.238318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:00.238318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:00.238318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:00.238318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:00.238318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:00.238318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:00.238318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:00.238318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:00.238318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:00.238318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:00.239706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:00.239706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:00.239706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:00.239706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:00.239706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:00.239706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:00.239706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:00.239706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:00.239706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:00.239706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:00.239706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:04:00.239706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:00.239706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 139/302] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:00.240362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fbeee-0639-4a3c-9018-fa2f51211504 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:00.240742 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fbeee-0639-4a3c-9018-fa2f51211504 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:00.240914 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fbeee-0639-4a3c-9018-fa2f51211504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:00.259422 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-751fbeee-0639-4a3c-9018-fa2f51211504 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:00.260509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-751fbeee-0639-4a3c-9018-fa2f51211504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:00.303909 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4eeec-c237-4492-b1e6-03ca16a1fa29 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:00.330447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 140/303] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:00.330780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fbeee-0639-4a3c-9018-fa2f51211504 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:00.345265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df45a5-7c2f-4540-a7ea-b1baa2f60446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:00.346732 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df45a5-7c2f-4540-a7ea-b1baa2f60446 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:00.347016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df45a5-7c2f-4540-a7ea-b1baa2f60446 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:00.347289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df45a5-7c2f-4540-a7ea-b1baa2f60446 None admin] PATH_INFO: `/v3/users/b4f2850c10b54fa6ab8b81bf388607b4` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:00.348547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df45a5-7c2f-4540-a7ea-b1baa2f60446 None admin] RBAC: Authorizing `identity:get_user(user_id=b4f2850c10b54fa6ab8b81bf388607b4)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:00.349985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df45a5-7c2f-4540-a7ea-b1baa2f60446 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:00.351648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 164/304] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:04:00 2022] GET /identity/v3/users/b4f2850c10b54fa6ab8b81bf388607b4 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:00.356294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31774e1-c239-4c78-9315-2527458966c3 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:00.356294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31774e1-c239-4c78-9315-2527458966c3 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:00.356294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31774e1-c239-4c78-9315-2527458966c3 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:00.356294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 165/305] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:00.356294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31774e1-c239-4c78-9315-2527458966c3 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:00.367024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:00.439787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fbeee-0639-4a3c-9018-fa2f51211504 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:00.453373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31774e1-c239-4c78-9315-2527458966c3 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:00.455685 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:00.473648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a82a8-e7a7-45b3-a7e1-f8aa4a1be159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:00.474313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a82a8-e7a7-45b3-a7e1-f8aa4a1be159 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:00.474622 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a82a8-e7a7-45b3-a7e1-f8aa4a1be159 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:00.474896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a82a8-e7a7-45b3-a7e1-f8aa4a1be159 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:00.475640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a82a8-e7a7-45b3-a7e1-f8aa4a1be159 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:00.475943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a82a8-e7a7-45b3-a7e1-f8aa4a1be159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:00.477340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a82a8-e7a7-45b3-a7e1-f8aa4a1be159 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:00.485512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 141/306] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:04:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:00.485512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a82a8-e7a7-45b3-a7e1-f8aa4a1be159 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:00.488119 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a767cb6-8135-4395-9de7-1106269b0481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:00.489034 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767cb6-8135-4395-9de7-1106269b0481 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:00.489326 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767cb6-8135-4395-9de7-1106269b0481 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:00.489604 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767cb6-8135-4395-9de7-1106269b0481 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:00.490919 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a767cb6-8135-4395-9de7-1106269b0481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:00.492364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a767cb6-8135-4395-9de7-1106269b0481 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:00.496603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 166/307] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:00.496603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072deea-2ca7-48d6-bfb8-11fc351c1e1e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:00.496603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072deea-2ca7-48d6-bfb8-11fc351c1e1e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:00.496603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072deea-2ca7-48d6-bfb8-11fc351c1e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:00.512411 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-9072deea-2ca7-48d6-bfb8-11fc351c1e1e None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:00.513541 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9072deea-2ca7-48d6-bfb8-11fc351c1e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:00.576280 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:00.577946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 167/308] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:00.579266 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072deea-2ca7-48d6-bfb8-11fc351c1e1e None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:00.587459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a82a8-e7a7-45b3-a7e1-f8aa4a1be159 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:00.621701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8045c-bf3d-48b8-a0b8-ad7269be92c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:00.622625 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8045c-bf3d-48b8-a0b8-ad7269be92c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:00.622907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8045c-bf3d-48b8-a0b8-ad7269be92c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:00.623181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8045c-bf3d-48b8-a0b8-ad7269be92c2 None admin] PATH_INFO: `/v3/system/users/b4f2850c10b54fa6ab8b81bf388607b4/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:00.624976 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8045c-bf3d-48b8-a0b8-ad7269be92c2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b4f2850c10b54fa6ab8b81bf388607b4, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:00.626369 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8045c-bf3d-48b8-a0b8-ad7269be92c2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:00.636307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 142/309] 10.222.0.99 () {58 vars in 1334 bytes} [Mon Jul 18 14:04:00 2022] PUT /identity/v3/system/users/b4f2850c10b54fa6ab8b81bf388607b4/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:04:00.637295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8045c-bf3d-48b8-a0b8-ad7269be92c2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:00.696413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072deea-2ca7-48d6-bfb8-11fc351c1e1e None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:00.699153 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:00.739176 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c04457-60fa-4a63-b9b1-9307b7d9e94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:00.740363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c04457-60fa-4a63-b9b1-9307b7d9e94b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:00.740707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c04457-60fa-4a63-b9b1-9307b7d9e94b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:00.741346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c04457-60fa-4a63-b9b1-9307b7d9e94b None admin] PATH_INFO: `/v3/users/4aa70cb3aa53458daba3e874d9c4461f` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:00.758654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8045c-bf3d-48b8-a0b8-ad7269be92c2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:00.759213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c04457-60fa-4a63-b9b1-9307b7d9e94b None admin] RBAC: Authorizing `identity:get_user(user_id=4aa70cb3aa53458daba3e874d9c4461f)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:00.760667 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c04457-60fa-4a63-b9b1-9307b7d9e94b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:00.762814 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 168/310] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:04:00 2022] GET /identity/v3/users/4aa70cb3aa53458daba3e874d9c4461f => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:00.763410 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c04457-60fa-4a63-b9b1-9307b7d9e94b None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:00.798503 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9288422-7c6f-4f3c-ba5c-5c370d32fbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:00.799481 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9288422-7c6f-4f3c-ba5c-5c370d32fbd6 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:00.799899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9288422-7c6f-4f3c-ba5c-5c370d32fbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:00.800339 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9288422-7c6f-4f3c-ba5c-5c370d32fbd6 None admin] PATH_INFO: `/v3/groups` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:00.801169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9288422-7c6f-4f3c-ba5c-5c370d32fbd6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:00.802793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9288422-7c6f-4f3c-ba5c-5c370d32fbd6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:00.822120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 143/311] 10.222.0.99 () {60 vars in 1134 bytes} [Mon Jul 18 14:04:00 2022] POST /identity/v3/groups => generated 229 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:04:00.823225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9288422-7c6f-4f3c-ba5c-5c370d32fbd6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:00.858787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:00.906233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c04457-60fa-4a63-b9b1-9307b7d9e94b None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:00.948924 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9288422-7c6f-4f3c-ba5c-5c370d32fbd6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:00.952787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203d1b8-42dc-4ee3-a74e-ac7657abbf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:00.953822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d1b8-42dc-4ee3-a74e-ac7657abbf3b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:00.954205 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d1b8-42dc-4ee3-a74e-ac7657abbf3b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:00.954613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d1b8-42dc-4ee3-a74e-ac7657abbf3b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:00.969537 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203d1b8-42dc-4ee3-a74e-ac7657abbf3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:00.980045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-b203d1b8-42dc-4ee3-a74e-ac7657abbf3b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:04:00.980045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:00.980045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:00.980045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:00.980045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:00.980045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:00.980045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:00.980045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:00.980045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:00.980045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:00.980045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:00.980045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:00.980045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:00.980045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:00.980045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:00.980045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:00.981214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:00.981214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:00.981214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:00.981214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:00.981214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:00.981214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:00.981214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:00.981214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:00.981214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:00.981214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:00.981214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:00.981214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:00.981214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:00.981214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:00.981214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:00.981214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:00.982081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:00.982081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:00.982081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:00.982081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:00.982081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:00.982081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:00.982081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:00.982081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:00.982081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:00.982081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:00.982081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:04:00.982081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:00.984041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 169/312] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:00.990011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203d1b8-42dc-4ee3-a74e-ac7657abbf3b None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:00.994444 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e429e7-5613-4d27-b7b6-446759955f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:00.995575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e429e7-5613-4d27-b7b6-446759955f04 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:00.995939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e429e7-5613-4d27-b7b6-446759955f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:00.996267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e429e7-5613-4d27-b7b6-446759955f04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:00.999958 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e429e7-5613-4d27-b7b6-446759955f04 None admin] RBAC: Adding query filter params (role.id=9b47e9314a0349539ef025e68cb2569a, user.id=4aa70cb3aa53458daba3e874d9c4461f, scope.system=all) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:00.999958 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e429e7-5613-4d27-b7b6-446759955f04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:01.000376 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e429e7-5613-4d27-b7b6-446759955f04 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:01.007440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 144/313] 10.222.0.99 () {56 vars in 1308 bytes} [Mon Jul 18 14:04:00 2022] GET /identity/v3/role_assignments?user.id=4aa70cb3aa53458daba3e874d9c4461f&scope.system=all&role.id=9b47e9314a0349539ef025e68cb2569a => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:01.018593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:01.116377 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203d1b8-42dc-4ee3-a74e-ac7657abbf3b None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:01.157830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2286cb-5de8-4fe4-ba18-ff1ddc5eed08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:01.158870 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2286cb-5de8-4fe4-ba18-ff1ddc5eed08 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:01.159325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2286cb-5de8-4fe4-ba18-ff1ddc5eed08 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:01.159744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2286cb-5de8-4fe4-ba18-ff1ddc5eed08 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:01.160661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2286cb-5de8-4fe4-ba18-ff1ddc5eed08 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:01.161121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2286cb-5de8-4fe4-ba18-ff1ddc5eed08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:01.162727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2286cb-5de8-4fe4-ba18-ff1ddc5eed08 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:01.173158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 170/314] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:04:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:01.180294 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e429e7-5613-4d27-b7b6-446759955f04 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:01.269537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:01.285624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e429e7-5613-4d27-b7b6-446759955f04 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:01.320403 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a5542-787b-4249-be1e-2bb8668bee17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:01.321555 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a5542-787b-4249-be1e-2bb8668bee17 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:01.321994 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a5542-787b-4249-be1e-2bb8668bee17 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:01.322431 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a5542-787b-4249-be1e-2bb8668bee17 None admin] PATH_INFO: `/v3/users/9bed6a53ab964865b43a6dd51f12dc5b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:01.323780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a5542-787b-4249-be1e-2bb8668bee17 None admin] RBAC: Authorizing `identity:get_user(user_id=9bed6a53ab964865b43a6dd51f12dc5b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:01.325383 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a5542-787b-4249-be1e-2bb8668bee17 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:01.327582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 145/315] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:04:01 2022] GET /identity/v3/users/9bed6a53ab964865b43a6dd51f12dc5b => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:01.333389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2286cb-5de8-4fe4-ba18-ff1ddc5eed08 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:01.423737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:01.444575 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2286cb-5de8-4fe4-ba18-ff1ddc5eed08 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:01.479315 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897c348-c8bb-4ec1-8dd3-2f4f64ff3ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:01.479969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897c348-c8bb-4ec1-8dd3-2f4f64ff3ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:01.480249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897c348-c8bb-4ec1-8dd3-2f4f64ff3ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:01.480526 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897c348-c8bb-4ec1-8dd3-2f4f64ff3ca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:01.552665 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897c348-c8bb-4ec1-8dd3-2f4f64ff3ca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:01.554049 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897c348-c8bb-4ec1-8dd3-2f4f64ff3ca6 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:01.636841 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:01.658127 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 171/316] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:01.664289 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a5542-787b-4249-be1e-2bb8668bee17 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:01.769250 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a5542-787b-4249-be1e-2bb8668bee17 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:01.806727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521cafb-f995-46fa-8a8b-13d2fcefd64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:01.807920 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521cafb-f995-46fa-8a8b-13d2fcefd64e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:01.808397 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521cafb-f995-46fa-8a8b-13d2fcefd64e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:01.808884 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521cafb-f995-46fa-8a8b-13d2fcefd64e None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:01.810273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521cafb-f995-46fa-8a8b-13d2fcefd64e None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:01.811996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521cafb-f995-46fa-8a8b-13d2fcefd64e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:01.814206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 146/317] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:04:01 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:01.826409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897c348-c8bb-4ec1-8dd3-2f4f64ff3ca6 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:01.924834 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897c348-c8bb-4ec1-8dd3-2f4f64ff3ca6 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:01.958942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e42db-22dc-45e3-920b-82a403fdf8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:01.959599 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e42db-22dc-45e3-920b-82a403fdf8fb None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:01.959880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e42db-22dc-45e3-920b-82a403fdf8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:01.960156 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e42db-22dc-45e3-920b-82a403fdf8fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:01.960989 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e42db-22dc-45e3-920b-82a403fdf8fb None admin] RBAC: Adding query filter params (role.id=9b47e9314a0349539ef025e68cb2569a, scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b, user.id=9bed6a53ab964865b43a6dd51f12dc5b) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:01.961298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e42db-22dc-45e3-920b-82a403fdf8fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:01.962760 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e42db-22dc-45e3-920b-82a403fdf8fb None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:01.969038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 172/318] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:04:01 2022] GET /identity/v3/role_assignments?user.id=9bed6a53ab964865b43a6dd51f12dc5b&scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b&role.id=9b47e9314a0349539ef025e68cb2569a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:02.661624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce575d-bb3b-4749-9270-4f8dd4f64893 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:02.662011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce575d-bb3b-4749-9270-4f8dd4f64893 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:02.662182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce575d-bb3b-4749-9270-4f8dd4f64893 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:02.663574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 147/319] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:02.668815 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca4edb-fc04-47a7-aebf-bfc5c48c6476 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:02.669105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca4edb-fc04-47a7-aebf-bfc5c48c6476 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:02.669382 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca4edb-fc04-47a7-aebf-bfc5c48c6476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:02.686531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-0fca4edb-fc04-47a7-aebf-bfc5c48c6476 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:02.687708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-0fca4edb-fc04-47a7-aebf-bfc5c48c6476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:02.733527 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:02.760404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 173/320] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:02.782733 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce575d-bb3b-4749-9270-4f8dd4f64893 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:02.800147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:02.888403 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce575d-bb3b-4749-9270-4f8dd4f64893 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:02.921289 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0514d3-bd34-43da-ac98-6a603476a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:02.922009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0514d3-bd34-43da-ac98-6a603476a881 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:02.922287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0514d3-bd34-43da-ac98-6a603476a881 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:02.922587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0514d3-bd34-43da-ac98-6a603476a881 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:02.933078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0514d3-bd34-43da-ac98-6a603476a881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:02.940894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-1b0514d3-bd34-43da-ac98-6a603476a881 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:04:02.940894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:02.940894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:02.940894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:02.940894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:02.940894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:02.940894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:02.940894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:02.940894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:02.940894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:02.940894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:02.940894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:02.940894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:02.940894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:02.940894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:02.940894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:02.941834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:02.941834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:02.941834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:02.941834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:02.941834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:02.941834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:02.941834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:02.941834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:02.941834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:02.941834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:02.941834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:02.941834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:02.941834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:02.941834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:02.941834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:02.941834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:02.942655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:02.942655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:02.942655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:02.942655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:02.942655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:02.942655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:02.942655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:02.942655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:02.942655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:02.942655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:02.942655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:04:02.942655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:02.947255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 148/321] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:02.948307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca4edb-fc04-47a7-aebf-bfc5c48c6476 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:02.971530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b096c68-fc2f-40bc-a8f6-22a9b90b0ce2 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:02.971822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b096c68-fc2f-40bc-a8f6-22a9b90b0ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:02.972102 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b096c68-fc2f-40bc-a8f6-22a9b90b0ce2 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:02.973961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 149/322] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:02.978886 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143c950-c4c5-4d77-9b8f-c1c5cb095063 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:02.979178 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143c950-c4c5-4d77-9b8f-c1c5cb095063 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:02.979456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143c950-c4c5-4d77-9b8f-c1c5cb095063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:02.997402 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9143c950-c4c5-4d77-9b8f-c1c5cb095063 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:02.998633 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9143c950-c4c5-4d77-9b8f-c1c5cb095063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:03.053327 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca4edb-fc04-47a7-aebf-bfc5c48c6476 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:03.070922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 150/323] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:03.075860 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc0d5d-3bae-48c7-8d77-bcf440fd5cdb None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:03.076151 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc0d5d-3bae-48c7-8d77-bcf440fd5cdb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:03.076425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc0d5d-3bae-48c7-8d77-bcf440fd5cdb None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:03.077844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 151/324] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:03.082519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b4bef-97a3-4719-b0ad-185e694fcb44 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:03.082808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b4bef-97a3-4719-b0ad-185e694fcb44 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:03.083084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b4bef-97a3-4719-b0ad-185e694fcb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:03.087729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4564cd-9ace-408e-88aa-46c3e5c7023d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:03.088465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4564cd-9ace-408e-88aa-46c3e5c7023d None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:03.088749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4564cd-9ace-408e-88aa-46c3e5c7023d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:03.088908 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:03.089000 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4564cd-9ace-408e-88aa-46c3e5c7023d None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:03.089746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4564cd-9ace-408e-88aa-46c3e5c7023d None admin] RBAC: Adding query filter params (name=member) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:03.090099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4564cd-9ace-408e-88aa-46c3e5c7023d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:03.091495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4564cd-9ace-408e-88aa-46c3e5c7023d None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:03.100125 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 174/325] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:04:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:03.101211 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c72b4bef-97a3-4719-b0ad-185e694fcb44 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:03.101989 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4564cd-9ace-408e-88aa-46c3e5c7023d None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:03.102375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c72b4bef-97a3-4719-b0ad-185e694fcb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:03.141854 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:03.172808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 152/326] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:04:03.173827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b4bef-97a3-4719-b0ad-185e694fcb44 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:03.203077 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4564cd-9ace-408e-88aa-46c3e5c7023d None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:03.236193 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05765c1f-691c-41e3-84f3-ceebfe484a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:03.237067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05765c1f-691c-41e3-84f3-ceebfe484a17 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:03.237320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05765c1f-691c-41e3-84f3-ceebfe484a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:03.237593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05765c1f-691c-41e3-84f3-ceebfe484a17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:03.238785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05765c1f-691c-41e3-84f3-ceebfe484a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:03.240244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05765c1f-691c-41e3-84f3-ceebfe484a17 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:03.241849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 175/327] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:03.242624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05765c1f-691c-41e3-84f3-ceebfe484a17 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:03.283306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b4bef-97a3-4719-b0ad-185e694fcb44 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:03.317404 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1739818-a1d3-45c5-961d-7fd97450e973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:03.318277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1739818-a1d3-45c5-961d-7fd97450e973 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:03.318588 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1739818-a1d3-45c5-961d-7fd97450e973 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:03.318864 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1739818-a1d3-45c5-961d-7fd97450e973 None admin] PATH_INFO: `/v3/users/b4f2850c10b54fa6ab8b81bf388607b4` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:03.320058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1739818-a1d3-45c5-961d-7fd97450e973 None admin] RBAC: Authorizing `identity:get_user(user_id=b4f2850c10b54fa6ab8b81bf388607b4)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:03.321527 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1739818-a1d3-45c5-961d-7fd97450e973 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:03.323192 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 153/328] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:04:03 2022] GET /identity/v3/users/b4f2850c10b54fa6ab8b81bf388607b4 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:03.323930 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1739818-a1d3-45c5-961d-7fd97450e973 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:03.326496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:03.349013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05765c1f-691c-41e3-84f3-ceebfe484a17 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:03.356175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:03.383655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc6239-bbc2-4f37-b285-4cb1fd969354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:03.384448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc6239-bbc2-4f37-b285-4cb1fd969354 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:03.384730 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc6239-bbc2-4f37-b285-4cb1fd969354 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:03.385000 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc6239-bbc2-4f37-b285-4cb1fd969354 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:03.395046 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc6239-bbc2-4f37-b285-4cb1fd969354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:03.402696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-83bc6239-bbc2-4f37-b285-4cb1fd969354 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:04:03.402696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:03.402696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:03.402696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:03.402696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:03.402696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:03.402696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:03.402696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:03.402696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:03.402696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:03.402696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:03.402696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:03.402696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:03.402696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:03.402696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:03.402696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:03.403703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:03.403703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:03.403703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:03.403703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:03.403703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:03.403703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:03.403703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:03.403703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:03.403703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:03.403703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:03.403703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:03.403703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:03.403703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:03.403703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:03.403703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:03.403703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:03.404522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:03.404522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:03.404522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:03.404522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:03.404522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:03.404522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:03.404522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:03.404522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:03.404522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:03.404522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:03.404522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:04:03.404522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:03.404522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 176/329] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:03.405166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc6239-bbc2-4f37-b285-4cb1fd969354 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:03.423650 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1739818-a1d3-45c5-961d-7fd97450e973 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:03.457024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba329740-e60c-409f-ad63-8ea56fe2b2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:03.457677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba329740-e60c-409f-ad63-8ea56fe2b2bf None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:03.457955 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba329740-e60c-409f-ad63-8ea56fe2b2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:03.458230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba329740-e60c-409f-ad63-8ea56fe2b2bf None admin] PATH_INFO: `/v3/groups` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:03.458952 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba329740-e60c-409f-ad63-8ea56fe2b2bf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:03.460415 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba329740-e60c-409f-ad63-8ea56fe2b2bf None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:03.474083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 154/330] 10.222.0.99 () {60 vars in 1134 bytes} [Mon Jul 18 14:04:03 2022] POST /identity/v3/groups => generated 226 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:04:03.474906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba329740-e60c-409f-ad63-8ea56fe2b2bf None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:03.525024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc6239-bbc2-4f37-b285-4cb1fd969354 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:03.544986 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:03.565857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2627da-5bf4-40ae-aa8a-41f39b558439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:03.566608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2627da-5bf4-40ae-aa8a-41f39b558439 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:03.566892 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2627da-5bf4-40ae-aa8a-41f39b558439 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:03.567167 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2627da-5bf4-40ae-aa8a-41f39b558439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:03.568009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2627da-5bf4-40ae-aa8a-41f39b558439 None admin] RBAC: Adding query filter params (role.id=9e92f0503b5c47a4a7368e618f37c6ae, user.id=b4f2850c10b54fa6ab8b81bf388607b4, scope.system=all) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:03.568318 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2627da-5bf4-40ae-aa8a-41f39b558439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:03.569791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2627da-5bf4-40ae-aa8a-41f39b558439 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:03.594433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 177/331] 10.222.0.99 () {56 vars in 1308 bytes} [Mon Jul 18 14:04:03 2022] GET /identity/v3/role_assignments?user.id=b4f2850c10b54fa6ab8b81bf388607b4&scope.system=all&role.id=9e92f0503b5c47a4a7368e618f37c6ae => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:03.606307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba329740-e60c-409f-ad63-8ea56fe2b2bf None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:03.647306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33b855-49fd-4000-a3f8-5fcabad52034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:03.648335 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33b855-49fd-4000-a3f8-5fcabad52034 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:03.648335 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33b855-49fd-4000-a3f8-5fcabad52034 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:03.648510 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33b855-49fd-4000-a3f8-5fcabad52034 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:03.649555 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33b855-49fd-4000-a3f8-5fcabad52034 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:03.649555 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33b855-49fd-4000-a3f8-5fcabad52034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:03.651110 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33b855-49fd-4000-a3f8-5fcabad52034 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:03.661611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 155/332] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:04:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:03.667348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2627da-5bf4-40ae-aa8a-41f39b558439 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:03.695975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:03.781346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2627da-5bf4-40ae-aa8a-41f39b558439 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:03.820286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf232e7-a8a9-44e5-ac1d-3dde403629b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:03.821171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf232e7-a8a9-44e5-ac1d-3dde403629b4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:03.821450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf232e7-a8a9-44e5-ac1d-3dde403629b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:03.821727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf232e7-a8a9-44e5-ac1d-3dde403629b4 None admin] PATH_INFO: `/v3/users/4aa70cb3aa53458daba3e874d9c4461f` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:03.822965 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf232e7-a8a9-44e5-ac1d-3dde403629b4 None admin] RBAC: Authorizing `identity:get_user(user_id=4aa70cb3aa53458daba3e874d9c4461f)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:03.824408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf232e7-a8a9-44e5-ac1d-3dde403629b4 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:03.826323 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 178/333] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:04:03 2022] GET /identity/v3/users/4aa70cb3aa53458daba3e874d9c4461f => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:03.831825 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33b855-49fd-4000-a3f8-5fcabad52034 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:03.951275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33b855-49fd-4000-a3f8-5fcabad52034 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:03.976265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:03.987643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b522c-ad59-42fd-9341-d221cd36c44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:03.988517 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b522c-ad59-42fd-9341-d221cd36c44a None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:03.988802 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b522c-ad59-42fd-9341-d221cd36c44a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:03.989086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b522c-ad59-42fd-9341-d221cd36c44a None admin] PATH_INFO: `/v3/system/users/4aa70cb3aa53458daba3e874d9c4461f/roles/9b47e9314a0349539ef025e68cb2569a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:03.990663 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b522c-ad59-42fd-9341-d221cd36c44a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4aa70cb3aa53458daba3e874d9c4461f, role_id=9b47e9314a0349539ef025e68cb2569a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:03.992147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b522c-ad59-42fd-9341-d221cd36c44a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:04.001479 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 156/334] 10.222.0.99 () {58 vars in 1334 bytes} [Mon Jul 18 14:04:03 2022] PUT /identity/v3/system/users/4aa70cb3aa53458daba3e874d9c4461f/roles/9b47e9314a0349539ef025e68cb2569a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:04:05.779129 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42de8d-ec9e-4d10-ab4d-c65b0ad78d75 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:05.779842 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42de8d-ec9e-4d10-ab4d-c65b0ad78d75 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:05.779842 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42de8d-ec9e-4d10-ab4d-c65b0ad78d75 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:05.781059 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 179/335] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:05.788034 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec0da3-a820-4b3c-ae02-7a21c86b703c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:05.788509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec0da3-a820-4b3c-ae02-7a21c86b703c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:05.788581 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec0da3-a820-4b3c-ae02-7a21c86b703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:05.815110 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-15ec0da3-a820-4b3c-ae02-7a21c86b703c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:05.816399 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-15ec0da3-a820-4b3c-ae02-7a21c86b703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:05.900278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 157/336] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:05.936749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42de8d-ec9e-4d10-ab4d-c65b0ad78d75 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:05.952972 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1849bd-8b0c-4aaf-88ab-e1dc03ab4699 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:05.953291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1849bd-8b0c-4aaf-88ab-e1dc03ab4699 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:05.953574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1849bd-8b0c-4aaf-88ab-e1dc03ab4699 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:05.955460 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 158/337] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:04:05.960561 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215844f-5ac1-4faf-82e2-4505d27db7b7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:05.960960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215844f-5ac1-4faf-82e2-4505d27db7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:05.961246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215844f-5ac1-4faf-82e2-4505d27db7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:05.990105 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b215844f-5ac1-4faf-82e2-4505d27db7b7 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:05.991475 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b215844f-5ac1-4faf-82e2-4505d27db7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:06.069358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:06.088840 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42de8d-ec9e-4d10-ab4d-c65b0ad78d75 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:06.108480 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 159/338] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:04:06.146320 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215844f-5ac1-4faf-82e2-4505d27db7b7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:06.166133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2ccd5-b7d0-4e18-b492-2fcdc62b50f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:06.166984 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2ccd5-b7d0-4e18-b492-2fcdc62b50f9 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:06.167274 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2ccd5-b7d0-4e18-b492-2fcdc62b50f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:06.167546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2ccd5-b7d0-4e18-b492-2fcdc62b50f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:06.195588 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2ccd5-b7d0-4e18-b492-2fcdc62b50f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:06.211419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-40c2ccd5-b7d0-4e18-b492-2fcdc62b50f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:04:06.211419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:06.211419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:06.211419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:06.211419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:06.211419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:06.211419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:06.211419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:06.211419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:06.211419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:06.211419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:06.211419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:06.211419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:06.211419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:06.211419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:06.211419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:06.212372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:06.212372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:06.212372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:06.212372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:06.212372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:06.212372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:06.212372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:06.212372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:06.212372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:06.212372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:06.212372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:06.212372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:06.212372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:06.212372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:06.212372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:06.212372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:06.213151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:06.213151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:06.213151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:06.213151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:06.213151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:06.213151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:06.213151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:06.213151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:06.213151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:06.213151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:06.213151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:04:06.213151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:06.213765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 180/339] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:06.227543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2ccd5-b7d0-4e18-b492-2fcdc62b50f9 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:06.253679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:06.363783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215844f-5ac1-4faf-82e2-4505d27db7b7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:06.439931 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf2237-9490-449c-be5f-79c2198f6d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:06.440841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf2237-9490-449c-be5f-79c2198f6d3b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:06.441125 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf2237-9490-449c-be5f-79c2198f6d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:06.441398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf2237-9490-449c-be5f-79c2198f6d3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:06.442127 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2ccd5-b7d0-4e18-b492-2fcdc62b50f9 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:06.472655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf2237-9490-449c-be5f-79c2198f6d3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:06.488124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-3faf2237-9490-449c-be5f-79c2198f6d3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:04:06.488124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:06.488124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:06.488124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:06.488124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:06.488124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:06.488124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:06.488124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:06.488124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:06.488124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:06.488124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:06.488124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:06.488124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:06.488124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:06.488124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:06.488124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:06.490286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:06.490286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:06.490286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:06.490286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:06.490286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:06.490286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:06.490286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:06.490286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:06.490286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:06.490286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:06.490286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:06.490286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:06.490286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:06.490286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:06.490286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:06.490286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:06.492244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:06.492244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:06.492244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:06.492244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:06.492244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:06.492244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:06.492244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:06.492244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:06.492244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:06.492244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:06.492244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:04:06.492244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:06.498225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 160/340] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:04:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:06.501205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf2237-9490-449c-be5f-79c2198f6d3b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:06.526478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e66bd-9c21-4520-ace6-7f7bc1e98b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:06.527221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e66bd-9c21-4520-ace6-7f7bc1e98b1b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:06.527890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e66bd-9c21-4520-ace6-7f7bc1e98b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:06.528172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e66bd-9c21-4520-ace6-7f7bc1e98b1b None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:06.528950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e66bd-9c21-4520-ace6-7f7bc1e98b1b None admin] RBAC: Adding query filter params (name=member) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:06.529257 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e66bd-9c21-4520-ace6-7f7bc1e98b1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:06.531157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e66bd-9c21-4520-ace6-7f7bc1e98b1b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:06.545482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 181/341] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:04:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:06.547926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e48a26-43f8-4628-bb21-beac116138e8 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:06.548218 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e48a26-43f8-4628-bb21-beac116138e8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:06.548497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e48a26-43f8-4628-bb21-beac116138e8 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:06.550258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 182/342] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:06.554976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e48a26-43f8-4628-bb21-beac116138e8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:06.590767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:06.657939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf2237-9490-449c-be5f-79c2198f6d3b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:06.673508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:06.712126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183ed80-e922-4ff7-aa7a-9032bb2f9e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:06.712126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183ed80-e922-4ff7-aa7a-9032bb2f9e09 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:06.712126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183ed80-e922-4ff7-aa7a-9032bb2f9e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:06.712126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183ed80-e922-4ff7-aa7a-9032bb2f9e09 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:06.713644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183ed80-e922-4ff7-aa7a-9032bb2f9e09 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:06.713644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183ed80-e922-4ff7-aa7a-9032bb2f9e09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:06.715269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183ed80-e922-4ff7-aa7a-9032bb2f9e09 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:06.720601 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e48a26-43f8-4628-bb21-beac116138e8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:06.732178 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 161/343] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:06.733487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb81a1-5ca1-44a6-ad4b-2382913a2a2c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:06.733778 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb81a1-5ca1-44a6-ad4b-2382913a2a2c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:06.734058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb81a1-5ca1-44a6-ad4b-2382913a2a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:06.765440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4aeb81a1-5ca1-44a6-ad4b-2382913a2a2c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:06.767792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4aeb81a1-5ca1-44a6-ad4b-2382913a2a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:06.799387 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f049b35-7120-45a0-a86a-816aa1379a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:06.802198 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f049b35-7120-45a0-a86a-816aa1379a17 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:06.802711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f049b35-7120-45a0-a86a-816aa1379a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:06.803189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f049b35-7120-45a0-a86a-816aa1379a17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:06.890064 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f049b35-7120-45a0-a86a-816aa1379a17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:06.891930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f049b35-7120-45a0-a86a-816aa1379a17 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:06.909621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:06.948725 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 162/344] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:06.949767 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb81a1-5ca1-44a6-ad4b-2382913a2a2c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:07.057941 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 183/345] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:07.058835 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f049b35-7120-45a0-a86a-816aa1379a17 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:07.140010 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:07.144305 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb81a1-5ca1-44a6-ad4b-2382913a2a2c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:07.197367 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35601ce1-984b-44c5-b8c3-9f81b2e178d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:07.198189 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35601ce1-984b-44c5-b8c3-9f81b2e178d9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:07.199035 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35601ce1-984b-44c5-b8c3-9f81b2e178d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:07.199456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35601ce1-984b-44c5-b8c3-9f81b2e178d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:07.204629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f049b35-7120-45a0-a86a-816aa1379a17 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:07.221146 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:07.244658 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b68ba-6075-4516-b17c-b81421e2cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:07.245866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b68ba-6075-4516-b17c-b81421e2cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:07.246296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b68ba-6075-4516-b17c-b81421e2cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:07.246756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b68ba-6075-4516-b17c-b81421e2cfe9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:07.258346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b68ba-6075-4516-b17c-b81421e2cfe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:07.266593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-b12b68ba-6075-4516-b17c-b81421e2cfe9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:04:07.266593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:07.266593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:07.266593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:07.266593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:07.266593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:07.266593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:07.266593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:07.266593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:07.266593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:07.266593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:07.266593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:07.266593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:07.266593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:07.266593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:07.266593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:07.267727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:07.267727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:07.267727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:07.267727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:07.267727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:07.267727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:07.267727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:07.267727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:07.267727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:07.267727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:07.267727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:07.267727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:07.267727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:07.267727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:07.267727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:07.267727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:07.268737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:07.268737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:07.268737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:07.268737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:07.268737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:07.268737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:07.268737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:07.268737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:07.268737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:07.268737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:07.268737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:04:07.268737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:07.271342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 184/346] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:07.272436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b68ba-6075-4516-b17c-b81421e2cfe9 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:07.282967 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35601ce1-984b-44c5-b8c3-9f81b2e178d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:07.284691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35601ce1-984b-44c5-b8c3-9f81b2e178d9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:07.393017 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b68ba-6075-4516-b17c-b81421e2cfe9 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:07.401253 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:07.406208 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 163/347] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:07.407736 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c0705-8f1b-419c-8cbe-be30eec1fadc None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:07.408087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c0705-8f1b-419c-8cbe-be30eec1fadc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:07.408529 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c0705-8f1b-419c-8cbe-be30eec1fadc None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:07.409987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 164/348] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:07.410749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c0705-8f1b-419c-8cbe-be30eec1fadc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:07.438567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05f730-caed-4aa1-8670-566bb451bffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:07.439962 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05f730-caed-4aa1-8670-566bb451bffb None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:07.440389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05f730-caed-4aa1-8670-566bb451bffb None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:07.441153 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05f730-caed-4aa1-8670-566bb451bffb None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:07.442863 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05f730-caed-4aa1-8670-566bb451bffb None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:07.445289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05f730-caed-4aa1-8670-566bb451bffb None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:07.447723 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 185/349] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:04:07 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:07.449059 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05f730-caed-4aa1-8670-566bb451bffb None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:07.500228 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:07.540514 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c0705-8f1b-419c-8cbe-be30eec1fadc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:07.567654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05f730-caed-4aa1-8670-566bb451bffb None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:07.579363 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a238c-0b06-4edd-9b7c-360e83421b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:07.580362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a238c-0b06-4edd-9b7c-360e83421b52 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:07.580738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a238c-0b06-4edd-9b7c-360e83421b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:07.581178 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a238c-0b06-4edd-9b7c-360e83421b52 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:07.582158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a238c-0b06-4edd-9b7c-360e83421b52 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:07.582537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a238c-0b06-4edd-9b7c-360e83421b52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:07.584388 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a238c-0b06-4edd-9b7c-360e83421b52 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:07.595462 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 165/350] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:04:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:07.597309 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c5545-6d24-42c1-b007-bda32fae0e2a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:07.597555 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c5545-6d24-42c1-b007-bda32fae0e2a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:07.597919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c5545-6d24-42c1-b007-bda32fae0e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:07.615187 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cf16c-5a5d-49ae-83cf-37a16a75e139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:07.616305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cf16c-5a5d-49ae-83cf-37a16a75e139 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:07.616747 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cf16c-5a5d-49ae-83cf-37a16a75e139 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:07.617029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cf16c-5a5d-49ae-83cf-37a16a75e139 None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:07.618236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cf16c-5a5d-49ae-83cf-37a16a75e139 None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:07.619202 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1c3c5545-6d24-42c1-b007-bda32fae0e2a None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:07.619789 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cf16c-5a5d-49ae-83cf-37a16a75e139 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:07.620433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1c3c5545-6d24-42c1-b007-bda32fae0e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:07.621808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 186/351] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:04:07 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:07.622825 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cf16c-5a5d-49ae-83cf-37a16a75e139 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:07.693447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:07.707145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 166/352] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:07.708439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991deb48-a933-4a6c-906a-5f0e7a818b3d None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:07.708770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991deb48-a933-4a6c-906a-5f0e7a818b3d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:07.709053 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991deb48-a933-4a6c-906a-5f0e7a818b3d None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:07.714461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 167/353] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:07.715734 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991deb48-a933-4a6c-906a-5f0e7a818b3d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:07.767933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cf16c-5a5d-49ae-83cf-37a16a75e139 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:07.782934 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:07.818306 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdec86-ab98-4ceb-9833-e9f885e50675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:07.819725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdec86-ab98-4ceb-9833-e9f885e50675 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:07.820011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdec86-ab98-4ceb-9833-e9f885e50675 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:07.820285 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdec86-ab98-4ceb-9833-e9f885e50675 None admin] PATH_INFO: `/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:07.827291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdec86-ab98-4ceb-9833-e9f885e50675 None admin] RBAC: Authorizing `identity:get_group(group_id=0195fc159fa94ff9950bc9b63ba52bdc)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:07.828744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdec86-ab98-4ceb-9833-e9f885e50675 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:07.830740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 187/354] 10.222.0.99 () {56 vars in 1180 bytes} [Mon Jul 18 14:04:07 2022] GET /identity/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:07.834412 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdec86-ab98-4ceb-9833-e9f885e50675 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:07.848238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991deb48-a933-4a6c-906a-5f0e7a818b3d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:07.887913 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda04c4a-f13a-4447-83a0-fcf7da5dd411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:07.888567 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda04c4a-f13a-4447-83a0-fcf7da5dd411 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:07.888851 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda04c4a-f13a-4447-83a0-fcf7da5dd411 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:07.889306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda04c4a-f13a-4447-83a0-fcf7da5dd411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:07.953563 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:07.969708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdec86-ab98-4ceb-9833-e9f885e50675 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:07.974534 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda04c4a-f13a-4447-83a0-fcf7da5dd411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:07.976251 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda04c4a-f13a-4447-83a0-fcf7da5dd411 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:08.010050 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87a72e-992b-4d78-a4db-a89d6aa65029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:08.011195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87a72e-992b-4d78-a4db-a89d6aa65029 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:08.011631 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87a72e-992b-4d78-a4db-a89d6aa65029 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:08.011912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87a72e-992b-4d78-a4db-a89d6aa65029 None admin] PATH_INFO: `/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:08.013115 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87a72e-992b-4d78-a4db-a89d6aa65029 None admin] RBAC: Authorizing `identity:get_group(group_id=0195fc159fa94ff9950bc9b63ba52bdc)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:08.014640 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87a72e-992b-4d78-a4db-a89d6aa65029 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:08.016279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 188/355] 10.222.0.99 () {56 vars in 1180 bytes} [Mon Jul 18 14:04:07 2022] GET /identity/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:08.017422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cc692-38b5-4f18-945a-2582c78b5bcf None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:08.017749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cc692-38b5-4f18-945a-2582c78b5bcf None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:08.018029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cc692-38b5-4f18-945a-2582c78b5bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:08.036264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-cc9cc692-38b5-4f18-945a-2582c78b5bcf None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:08.037469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-cc9cc692-38b5-4f18-945a-2582c78b5bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:08.076789 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:08.099712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 168/356] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:08.101077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda04c4a-f13a-4447-83a0-fcf7da5dd411 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:08.120089 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 189/357] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:08.120916 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cc692-38b5-4f18-945a-2582c78b5bcf None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:08.218703 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:08.232672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda04c4a-f13a-4447-83a0-fcf7da5dd411 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:08.246555 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cc692-38b5-4f18-945a-2582c78b5bcf None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:08.274324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7915a6-96ca-4f24-b685-32eb2b7d0368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:08.275146 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7915a6-96ca-4f24-b685-32eb2b7d0368 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:08.275425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7915a6-96ca-4f24-b685-32eb2b7d0368 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:08.275715 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7915a6-96ca-4f24-b685-32eb2b7d0368 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:08.283859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e0884-427f-4237-a5d1-81698a818699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:08.284521 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e0884-427f-4237-a5d1-81698a818699 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:08.284810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e0884-427f-4237-a5d1-81698a818699 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:08.285215 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e0884-427f-4237-a5d1-81698a818699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:08.286444 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7915a6-96ca-4f24-b685-32eb2b7d0368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:08.286564 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e0884-427f-4237-a5d1-81698a818699 None admin] RBAC: Adding query filter params (group.id=0195fc159fa94ff9950bc9b63ba52bdc, role.id=9e92f0503b5c47a4a7368e618f37c6ae, scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:08.286564 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e0884-427f-4237-a5d1-81698a818699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:08.287828 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e0884-427f-4237-a5d1-81698a818699 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:08.293801 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 190/358] 10.222.0.99 () {56 vars in 1376 bytes} [Mon Jul 18 14:04:08 2022] GET /identity/v3/role_assignments?group.id=0195fc159fa94ff9950bc9b63ba52bdc&scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05&role.id=9e92f0503b5c47a4a7368e618f37c6ae => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:08.293943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-8c7915a6-96ca-4f24-b685-32eb2b7d0368 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:04:08.293943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:08.293943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:08.293943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:08.293943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:08.293943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:08.293943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:08.293943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:08.293943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:08.293943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:08.293943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:08.293943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:08.293943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:08.293943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:08.293943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:08.293943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:08.294997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:08.294997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:08.294997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:08.294997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:08.294997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:08.294997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:08.294997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:08.294997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:08.294997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:08.294997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:08.294997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:08.294997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:08.294997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:08.294997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:08.294997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:08.294997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:08.295936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:08.295936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:08.295936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:08.295936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:08.295936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:08.295936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:08.295936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:08.295936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:08.295936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:08.295936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:08.295936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 14:04:08.295936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:08.295936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 169/359] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:08.296739 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de17c5-ec81-41da-8efa-b362b97e0ec6 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:08.296813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7915a6-96ca-4f24-b685-32eb2b7d0368 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:08.296878 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de17c5-ec81-41da-8efa-b362b97e0ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:08.296878 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de17c5-ec81-41da-8efa-b362b97e0ec6 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:08.298438 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 191/360] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:08.303667 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de17c5-ec81-41da-8efa-b362b97e0ec6 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:08.364374 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:08.444291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7915a6-96ca-4f24-b685-32eb2b7d0368 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:08.460459 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de17c5-ec81-41da-8efa-b362b97e0ec6 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:08.487490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718eb693-4a2a-4c3e-b337-79440c9f85bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:08.488501 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eb693-4a2a-4c3e-b337-79440c9f85bb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:08.488987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eb693-4a2a-4c3e-b337-79440c9f85bb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:08.489432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eb693-4a2a-4c3e-b337-79440c9f85bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:08.490561 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718eb693-4a2a-4c3e-b337-79440c9f85bb None admin] RBAC: Adding query filter params (group.id=0195fc159fa94ff9950bc9b63ba52bdc, role.id=2e761f6eaaa94f9e85d77734e01ac393, scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:08.491044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718eb693-4a2a-4c3e-b337-79440c9f85bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:08.492689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718eb693-4a2a-4c3e-b337-79440c9f85bb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:08.497684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9a0ed-2f2d-41c6-9598-a9b6847cfdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:08.498585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9a0ed-2f2d-41c6-9598-a9b6847cfdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:08.498866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9a0ed-2f2d-41c6-9598-a9b6847cfdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:08.499259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9a0ed-2f2d-41c6-9598-a9b6847cfdd3 None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:08.500758 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9a0ed-2f2d-41c6-9598-a9b6847cfdd3 None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:08.501415 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 170/361] 10.222.0.99 () {56 vars in 1376 bytes} [Mon Jul 18 14:04:08 2022] GET /identity/v3/role_assignments?group.id=0195fc159fa94ff9950bc9b63ba52bdc&scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05&role.id=2e761f6eaaa94f9e85d77734e01ac393 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:08.506695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9a0ed-2f2d-41c6-9598-a9b6847cfdd3 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:08.506695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 192/362] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:04:08 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:08.506695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9a0ed-2f2d-41c6-9598-a9b6847cfdd3 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:08.510644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20e02e-fa3e-4318-b467-5a219607530d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:08.510644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20e02e-fa3e-4318-b467-5a219607530d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:08.510644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20e02e-fa3e-4318-b467-5a219607530d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:08.530958 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4a20e02e-fa3e-4318-b467-5a219607530d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:08.532260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4a20e02e-fa3e-4318-b467-5a219607530d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:08.548011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:08.617571 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 171/363] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:08.618467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20e02e-fa3e-4318-b467-5a219607530d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:08.654144 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9a0ed-2f2d-41c6-9598-a9b6847cfdd3 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:08.657884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:08.704962 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d92fb0-2698-486f-a643-c181e171675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:08.706155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d92fb0-2698-486f-a643-c181e171675d None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:08.706414 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d92fb0-2698-486f-a643-c181e171675d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:08.707567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d92fb0-2698-486f-a643-c181e171675d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:08.724092 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d92fb0-2698-486f-a643-c181e171675d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:08.732221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-81d92fb0-2698-486f-a643-c181e171675d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:04:08.732221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:08.732221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:08.732221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:08.732221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:08.732221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:08.732221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:08.732221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:08.732221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:08.732221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:08.732221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:08.732221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:08.732221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:08.732221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:08.732221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:08.732221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:08.733121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:08.733121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:08.733121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:08.733121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:08.733121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:08.733121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:08.733121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:08.733121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:08.733121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:08.733121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:08.733121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:08.733121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:08.733121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:08.733121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:08.733121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:08.733121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:08.733910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:08.733910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:08.733910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:08.733910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:08.733910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:08.733910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:08.733910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:08.733910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:08.733910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:08.733910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:08.733910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:04:08.733910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:08.738591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 193/364] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:04:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:08.739473 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d92fb0-2698-486f-a643-c181e171675d None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:08.761500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20e02e-fa3e-4318-b467-5a219607530d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:08.816917 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fd157-2bf7-473f-875b-99ca8335196d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:08.817593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fd157-2bf7-473f-875b-99ca8335196d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:08.817877 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fd157-2bf7-473f-875b-99ca8335196d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:08.818158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fd157-2bf7-473f-875b-99ca8335196d None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:08.819075 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fd157-2bf7-473f-875b-99ca8335196d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:08.819491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fd157-2bf7-473f-875b-99ca8335196d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:08.820955 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fd157-2bf7-473f-875b-99ca8335196d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:08.832637 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 172/365] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:04:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:08.833553 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fd157-2bf7-473f-875b-99ca8335196d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:08.849411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:08.879327 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d92fb0-2698-486f-a643-c181e171675d None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:08.923914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae13b3a-04d7-4488-832a-c87b9579af50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:08.925029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae13b3a-04d7-4488-832a-c87b9579af50 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:08.926118 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae13b3a-04d7-4488-832a-c87b9579af50 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:08.926812 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae13b3a-04d7-4488-832a-c87b9579af50 None admin] PATH_INFO: `/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:08.928747 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae13b3a-04d7-4488-832a-c87b9579af50 None admin] RBAC: Authorizing `identity:get_group(group_id=0195fc159fa94ff9950bc9b63ba52bdc)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:08.931300 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae13b3a-04d7-4488-832a-c87b9579af50 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:08.935612 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 194/366] 10.222.0.99 () {56 vars in 1180 bytes} [Mon Jul 18 14:04:08 2022] GET /identity/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:08.936605 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae13b3a-04d7-4488-832a-c87b9579af50 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:08.966354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fd157-2bf7-473f-875b-99ca8335196d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:08.981622 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:09.010115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95598ed5-e619-4bd1-b814-57cf10f1fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:09.010978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95598ed5-e619-4bd1-b814-57cf10f1fde1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:09.011335 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95598ed5-e619-4bd1-b814-57cf10f1fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:09.011712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95598ed5-e619-4bd1-b814-57cf10f1fde1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:09.024502 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95598ed5-e619-4bd1-b814-57cf10f1fde1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:09.032522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-95598ed5-e619-4bd1-b814-57cf10f1fde1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:04:09.032522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:09.032522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:09.032522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:09.032522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:09.032522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:09.032522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:09.032522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:09.032522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:09.032522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:09.032522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:09.032522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:09.032522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:09.032522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:09.032522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:09.032522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:09.033648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:09.033648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:09.033648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:09.033648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:09.033648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:09.033648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:09.033648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:09.033648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:09.033648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:09.033648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:09.033648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:09.033648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:09.033648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:09.033648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:09.033648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:09.033648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:09.034701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:09.034701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:09.034701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:09.034701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:09.034701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:09.034701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:09.034701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:09.034701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:09.034701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:09.034701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:09.034701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:04:09.034701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:09.034701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 173/367] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:04:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:09.036300 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95598ed5-e619-4bd1-b814-57cf10f1fde1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:09.080424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae13b3a-04d7-4488-832a-c87b9579af50 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:09.127508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c19ca-6560-4d0e-9965-507aee10f5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:09.128221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c19ca-6560-4d0e-9965-507aee10f5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:09.128501 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c19ca-6560-4d0e-9965-507aee10f5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:09.128773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c19ca-6560-4d0e-9965-507aee10f5c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:09.129527 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c19ca-6560-4d0e-9965-507aee10f5c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:09.129831 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c19ca-6560-4d0e-9965-507aee10f5c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:09.131309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c19ca-6560-4d0e-9965-507aee10f5c9 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:09.141106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:09.141280 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 195/368] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:09.142030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c19ca-6560-4d0e-9965-507aee10f5c9 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:09.198260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95598ed5-e619-4bd1-b814-57cf10f1fde1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:09.238049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956f265-6234-4261-84b6-39f1ad390dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:09.239985 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956f265-6234-4261-84b6-39f1ad390dfb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:09.240776 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956f265-6234-4261-84b6-39f1ad390dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:09.241454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956f265-6234-4261-84b6-39f1ad390dfb None admin] PATH_INFO: `/v3/users/4aa70cb3aa53458daba3e874d9c4461f` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:09.243421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956f265-6234-4261-84b6-39f1ad390dfb None admin] RBAC: Authorizing `identity:get_user(user_id=4aa70cb3aa53458daba3e874d9c4461f)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:09.245706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956f265-6234-4261-84b6-39f1ad390dfb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:09.248886 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 174/369] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:04:09 2022] GET /identity/v3/users/4aa70cb3aa53458daba3e874d9c4461f => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:09.250284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956f265-6234-4261-84b6-39f1ad390dfb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:09.253164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:09.261721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c19ca-6560-4d0e-9965-507aee10f5c9 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:09.299215 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4625ee-556e-40e2-9313-45bac756ebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:09.299872 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4625ee-556e-40e2-9313-45bac756ebbb None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:09.300152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4625ee-556e-40e2-9313-45bac756ebbb None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:09.300425 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4625ee-556e-40e2-9313-45bac756ebbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:09.301321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4625ee-556e-40e2-9313-45bac756ebbb None admin] RBAC: Adding query filter params (group.id=0195fc159fa94ff9950bc9b63ba52bdc, role.id=9e92f0503b5c47a4a7368e618f37c6ae, scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:09.301985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4625ee-556e-40e2-9313-45bac756ebbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:09.303245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4625ee-556e-40e2-9313-45bac756ebbb None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:09.311018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 196/370] 10.222.0.99 () {56 vars in 1376 bytes} [Mon Jul 18 14:04:09 2022] GET /identity/v3/role_assignments?group.id=0195fc159fa94ff9950bc9b63ba52bdc&scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b&role.id=9e92f0503b5c47a4a7368e618f37c6ae => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:09.311374 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4625ee-556e-40e2-9313-45bac756ebbb None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:09.370200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956f265-6234-4261-84b6-39f1ad390dfb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:09.407512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bb91e-1ad0-4eee-b70a-f4c196e4a35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:09.408659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bb91e-1ad0-4eee-b70a-f4c196e4a35c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:09.409141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bb91e-1ad0-4eee-b70a-f4c196e4a35c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:09.409612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bb91e-1ad0-4eee-b70a-f4c196e4a35c None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:09.410586 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bb91e-1ad0-4eee-b70a-f4c196e4a35c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:09.411111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bb91e-1ad0-4eee-b70a-f4c196e4a35c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:09.412782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bb91e-1ad0-4eee-b70a-f4c196e4a35c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:09.415647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:09.423321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 175/371] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:09.424367 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bb91e-1ad0-4eee-b70a-f4c196e4a35c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:09.431416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4625ee-556e-40e2-9313-45bac756ebbb None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:09.472078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006db5b8-328c-4bc0-b568-1661b8dfb975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:09.473113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006db5b8-328c-4bc0-b568-1661b8dfb975 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:09.473598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006db5b8-328c-4bc0-b568-1661b8dfb975 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:09.474077 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006db5b8-328c-4bc0-b568-1661b8dfb975 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:09.514871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:09.541612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bb91e-1ad0-4eee-b70a-f4c196e4a35c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:09.555818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006db5b8-328c-4bc0-b568-1661b8dfb975 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:09.557447 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006db5b8-328c-4bc0-b568-1661b8dfb975 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:09.609966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18cfef-cdc7-4e08-b02f-1e6d599f1151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:09.610688 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18cfef-cdc7-4e08-b02f-1e6d599f1151 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:09.610979 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18cfef-cdc7-4e08-b02f-1e6d599f1151 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:09.611257 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18cfef-cdc7-4e08-b02f-1e6d599f1151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:09.612178 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18cfef-cdc7-4e08-b02f-1e6d599f1151 None admin] RBAC: Adding query filter params (role.id=9b47e9314a0349539ef025e68cb2569a, user.id=4aa70cb3aa53458daba3e874d9c4461f, scope.system=all) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:09.612493 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18cfef-cdc7-4e08-b02f-1e6d599f1151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:09.613961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18cfef-cdc7-4e08-b02f-1e6d599f1151 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:09.636156 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 176/372] 10.222.0.99 () {56 vars in 1308 bytes} [Mon Jul 18 14:04:09 2022] GET /identity/v3/role_assignments?user.id=4aa70cb3aa53458daba3e874d9c4461f&scope.system=all&role.id=9b47e9314a0349539ef025e68cb2569a => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:09.637060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18cfef-cdc7-4e08-b02f-1e6d599f1151 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:09.671856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 197/373] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:09.678152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006db5b8-328c-4bc0-b568-1661b8dfb975 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:09.715698 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:09.771428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18cfef-cdc7-4e08-b02f-1e6d599f1151 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:09.794853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:09.809909 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c310d6-524a-4356-8ba7-27acd55eedbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:09.810627 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c310d6-524a-4356-8ba7-27acd55eedbf None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:09.810933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c310d6-524a-4356-8ba7-27acd55eedbf None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:09.811199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c310d6-524a-4356-8ba7-27acd55eedbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:09.847320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006db5b8-328c-4bc0-b568-1661b8dfb975 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:09.889396 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c310d6-524a-4356-8ba7-27acd55eedbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:09.892519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c310d6-524a-4356-8ba7-27acd55eedbf None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:09.908259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77f166-f11d-47ff-ad51-e11d8a911f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:09.908987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77f166-f11d-47ff-ad51-e11d8a911f16 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:09.909214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77f166-f11d-47ff-ad51-e11d8a911f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:09.909595 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77f166-f11d-47ff-ad51-e11d8a911f16 None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:09.911050 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77f166-f11d-47ff-ad51-e11d8a911f16 None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:09.912630 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77f166-f11d-47ff-ad51-e11d8a911f16 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:09.914839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 198/374] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:04:09 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:09.923400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77f166-f11d-47ff-ad51-e11d8a911f16 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:09.957076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:10.008594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 177/375] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:10.014713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c310d6-524a-4356-8ba7-27acd55eedbf None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:10.125459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c310d6-524a-4356-8ba7-27acd55eedbf None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:10.165856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f6b89-079b-46b4-bf77-dbf9a82ac8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:10.166764 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f6b89-079b-46b4-bf77-dbf9a82ac8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:10.167049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f6b89-079b-46b4-bf77-dbf9a82ac8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:10.167319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f6b89-079b-46b4-bf77-dbf9a82ac8a1 None admin] PATH_INFO: `/v3/projects/268276b3ee674678ab5061125ae1a657` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:10.168539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f6b89-079b-46b4-bf77-dbf9a82ac8a1 None admin] RBAC: Authorizing `identity:get_project(project_id=268276b3ee674678ab5061125ae1a657)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:10.170082 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f6b89-079b-46b4-bf77-dbf9a82ac8a1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:10.172246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 178/376] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:04:10 2022] GET /identity/v3/projects/268276b3ee674678ab5061125ae1a657 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:10.178286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f6b89-079b-46b4-bf77-dbf9a82ac8a1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:10.221246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:10.231481 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77f166-f11d-47ff-ad51-e11d8a911f16 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:10.269315 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:10.287249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d925508-50fb-4573-963e-bf0add7aca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:10.288883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d925508-50fb-4573-963e-bf0add7aca1a None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:10.289470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d925508-50fb-4573-963e-bf0add7aca1a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:10.290066 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d925508-50fb-4573-963e-bf0add7aca1a None admin] PATH_INFO: `/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:10.295282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d925508-50fb-4573-963e-bf0add7aca1a None admin] RBAC: Authorizing `identity:get_group(group_id=0195fc159fa94ff9950bc9b63ba52bdc)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:10.297008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d925508-50fb-4573-963e-bf0add7aca1a None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:10.299414 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 199/377] 10.222.0.99 () {56 vars in 1180 bytes} [Mon Jul 18 14:04:09 2022] GET /identity/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc => generated 226 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:10.305200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d925508-50fb-4573-963e-bf0add7aca1a None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:10.310822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f6b89-079b-46b4-bf77-dbf9a82ac8a1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:10.348242 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38444374-b9db-4d20-9399-0c21bb716299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:10.349118 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38444374-b9db-4d20-9399-0c21bb716299 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:10.349402 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38444374-b9db-4d20-9399-0c21bb716299 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:10.349678 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38444374-b9db-4d20-9399-0c21bb716299 None admin] PATH_INFO: `/v3/groups/9f1e70710f604ff0bc63d6bec43f4e7b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:10.358424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38444374-b9db-4d20-9399-0c21bb716299 None admin] RBAC: Authorizing `identity:get_group(group_id=9f1e70710f604ff0bc63d6bec43f4e7b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:10.358424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38444374-b9db-4d20-9399-0c21bb716299 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:10.359543 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 179/378] 10.222.0.99 () {56 vars in 1180 bytes} [Mon Jul 18 14:04:10 2022] GET /identity/v3/groups/9f1e70710f604ff0bc63d6bec43f4e7b => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:10.366476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38444374-b9db-4d20-9399-0c21bb716299 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:10.471048 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:10.481674 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38444374-b9db-4d20-9399-0c21bb716299 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:10.496130 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d925508-50fb-4573-963e-bf0add7aca1a None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:10.523897 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae62b3a-b021-4a93-8f07-7edd5724e7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:10.524803 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae62b3a-b021-4a93-8f07-7edd5724e7cb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:10.525159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae62b3a-b021-4a93-8f07-7edd5724e7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:10.525509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae62b3a-b021-4a93-8f07-7edd5724e7cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:10.526625 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae62b3a-b021-4a93-8f07-7edd5724e7cb None admin] RBAC: Adding query filter params (group.id=9f1e70710f604ff0bc63d6bec43f4e7b, role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=268276b3ee674678ab5061125ae1a657) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:10.527017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae62b3a-b021-4a93-8f07-7edd5724e7cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:10.528999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae62b3a-b021-4a93-8f07-7edd5724e7cb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:10.538030 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 180/379] 10.222.0.99 () {56 vars in 1376 bytes} [Mon Jul 18 14:04:10 2022] GET /identity/v3/role_assignments?group.id=9f1e70710f604ff0bc63d6bec43f4e7b&scope.project.id=268276b3ee674678ab5061125ae1a657&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:10.577993 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ae70c-98dd-4cfe-8ea6-750e34e48c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:10.579084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ae70c-98dd-4cfe-8ea6-750e34e48c5d None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:10.579515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ae70c-98dd-4cfe-8ea6-750e34e48c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:10.579936 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ae70c-98dd-4cfe-8ea6-750e34e48c5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:10.581002 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ae70c-98dd-4cfe-8ea6-750e34e48c5d None admin] RBAC: Adding query filter params (group.id=0195fc159fa94ff9950bc9b63ba52bdc, role.id=2e761f6eaaa94f9e85d77734e01ac393, scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:10.581467 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ae70c-98dd-4cfe-8ea6-750e34e48c5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:10.583306 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ae70c-98dd-4cfe-8ea6-750e34e48c5d None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:10.595572 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 200/380] 10.222.0.99 () {56 vars in 1376 bytes} [Mon Jul 18 14:04:10 2022] GET /identity/v3/role_assignments?group.id=0195fc159fa94ff9950bc9b63ba52bdc&scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b&role.id=2e761f6eaaa94f9e85d77734e01ac393 => generated 260 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:10.974918 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d651670-12f1-40a8-8b2e-5cee1e29a36e None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:10.975216 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d651670-12f1-40a8-8b2e-5cee1e29a36e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:10.975493 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d651670-12f1-40a8-8b2e-5cee1e29a36e None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:10.977148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 181/381] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:10.983625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d253a0-2309-45f1-8ae1-08d17eca5149 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:10.984081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d253a0-2309-45f1-8ae1-08d17eca5149 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:10.984225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d253a0-2309-45f1-8ae1-08d17eca5149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:11.003191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-a6d253a0-2309-45f1-8ae1-08d17eca5149 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:11.004394 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a6d253a0-2309-45f1-8ae1-08d17eca5149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:11.029613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce63ac5-2cc0-4bde-aaf5-edb419093490 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:11.030139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce63ac5-2cc0-4bde-aaf5-edb419093490 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:11.030139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce63ac5-2cc0-4bde-aaf5-edb419093490 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:11.031839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 182/382] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:11.040061 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee693b1-5242-422c-9538-1b4b8e3fe69a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:11.040371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee693b1-5242-422c-9538-1b4b8e3fe69a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:11.040629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee693b1-5242-422c-9538-1b4b8e3fe69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:11.059361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-dee693b1-5242-422c-9538-1b4b8e3fe69a None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:11.060767 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dee693b1-5242-422c-9538-1b4b8e3fe69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:11.068423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:11.093399 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 201/383] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:11.121740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d253a0-2309-45f1-8ae1-08d17eca5149 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:11.168605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 183/384] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:04:11.209922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee693b1-5242-422c-9538-1b4b8e3fe69a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:11.233468 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d253a0-2309-45f1-8ae1-08d17eca5149 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:11.279793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf44f9-e5af-48e6-ad5c-4e792e566e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:11.280611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf44f9-e5af-48e6-ad5c-4e792e566e3d None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:11.280888 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf44f9-e5af-48e6-ad5c-4e792e566e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:11.281157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf44f9-e5af-48e6-ad5c-4e792e566e3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:11.292707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf44f9-e5af-48e6-ad5c-4e792e566e3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:11.302911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-1cbf44f9-e5af-48e6-ad5c-4e792e566e3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:04:11.302911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:11.302911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:11.302911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:11.302911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:11.302911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:11.302911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:11.302911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:11.302911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:11.302911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:11.302911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:11.302911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:11.302911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:11.302911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:11.302911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:11.302911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:11.303877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:11.303877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:11.303877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:11.303877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:11.303877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:11.303877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:11.303877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:11.303877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:11.303877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:11.303877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:11.303877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:11.303877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:11.303877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:11.303877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:11.303877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:11.303877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:11.305234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:11.305234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:11.305234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:11.305234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:11.305234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:11.305234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:11.305234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:11.305234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:11.305234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:11.305234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:11.305234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:04:11.305234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:11.305234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 202/385] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:11.310077 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf44f9-e5af-48e6-ad5c-4e792e566e3d None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:11.317185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:11.361687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee693b1-5242-422c-9538-1b4b8e3fe69a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:11.366035 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:11.423677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf44f9-e5af-48e6-ad5c-4e792e566e3d None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:11.464092 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566b9e4-cf7d-4f97-a5ad-f44ce8e713bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:11.464764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566b9e4-cf7d-4f97-a5ad-f44ce8e713bd None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:11.465041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566b9e4-cf7d-4f97-a5ad-f44ce8e713bd None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:11.465314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a566b9e4-cf7d-4f97-a5ad-f44ce8e713bd None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:11.466129 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566b9e4-cf7d-4f97-a5ad-f44ce8e713bd None admin] RBAC: Adding query filter params (name=member) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:11.466456 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566b9e4-cf7d-4f97-a5ad-f44ce8e713bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:11.468199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a566b9e4-cf7d-4f97-a5ad-f44ce8e713bd None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:11.478039 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 203/386] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:04:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:11.483371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566b9e4-cf7d-4f97-a5ad-f44ce8e713bd None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:11.488439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72a116-a555-4246-9889-e8d7deabc96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:11.489187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72a116-a555-4246-9889-e8d7deabc96e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:11.489473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72a116-a555-4246-9889-e8d7deabc96e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:11.489751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72a116-a555-4246-9889-e8d7deabc96e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:11.520177 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72a116-a555-4246-9889-e8d7deabc96e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:11.535183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-2a72a116-a555-4246-9889-e8d7deabc96e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:04:11.535183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:11.535183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:11.535183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:11.535183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:11.535183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:11.535183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:11.535183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:11.535183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:11.535183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:11.535183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:11.535183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:11.535183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:11.535183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:11.535183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:11.535183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:11.537246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:11.537246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:11.537246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:11.537246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:11.537246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:11.537246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:11.537246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:11.537246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:11.537246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:11.537246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:11.537246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:11.537246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:11.537246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:11.537246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:11.537246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:11.537246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:11.539537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:11.539537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:11.539537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:11.539537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:11.539537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:11.539537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:11.539537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:11.539537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:11.539537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:11.539537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:11.539537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:04:11.539537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:11.539537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 184/387] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:04:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:11.548231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72a116-a555-4246-9889-e8d7deabc96e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:11.654539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a566b9e4-cf7d-4f97-a5ad-f44ce8e713bd None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:11.674857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:11.693062 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36388902-2dcc-464e-8d5b-a86177c5965d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:11.693929 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36388902-2dcc-464e-8d5b-a86177c5965d None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:11.694209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36388902-2dcc-464e-8d5b-a86177c5965d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:11.694519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36388902-2dcc-464e-8d5b-a86177c5965d None admin] PATH_INFO: `/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:11.696085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36388902-2dcc-464e-8d5b-a86177c5965d None admin] RBAC: Authorizing `identity:get_group(group_id=0195fc159fa94ff9950bc9b63ba52bdc)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:11.697528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36388902-2dcc-464e-8d5b-a86177c5965d None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:11.699676 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 204/388] 10.222.0.99 () {56 vars in 1180 bytes} [Mon Jul 18 14:04:11 2022] GET /identity/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:11.705321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36388902-2dcc-464e-8d5b-a86177c5965d None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:11.812965 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36388902-2dcc-464e-8d5b-a86177c5965d None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:11.843891 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72a116-a555-4246-9889-e8d7deabc96e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:11.849751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c58ca-d4c5-4545-adc2-c1382a1d24a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:11.850651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c58ca-d4c5-4545-adc2-c1382a1d24a7 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:11.850932 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c58ca-d4c5-4545-adc2-c1382a1d24a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:11.852079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c58ca-d4c5-4545-adc2-c1382a1d24a7 None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:11.852541 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c58ca-d4c5-4545-adc2-c1382a1d24a7 None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:11.853989 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c58ca-d4c5-4545-adc2-c1382a1d24a7 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:11.856033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 205/389] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:04:11 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:11.861625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c58ca-d4c5-4545-adc2-c1382a1d24a7 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:11.926840 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:11.943132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01568f-b459-4261-9ed7-50924a12a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:11.943823 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01568f-b459-4261-9ed7-50924a12a835 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:11.944105 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01568f-b459-4261-9ed7-50924a12a835 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:11.944381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01568f-b459-4261-9ed7-50924a12a835 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:11.945148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01568f-b459-4261-9ed7-50924a12a835 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:11.945457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01568f-b459-4261-9ed7-50924a12a835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:11.946893 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01568f-b459-4261-9ed7-50924a12a835 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:11.968685 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 185/390] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:11.973993 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c58ca-d4c5-4545-adc2-c1382a1d24a7 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:11.974408 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01568f-b459-4261-9ed7-50924a12a835 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:11.984318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:12.012432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3b63c-36ea-41e7-89d1-5e7c7c32f334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:12.013428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3b63c-36ea-41e7-89d1-5e7c7c32f334 None admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:12.013720 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3b63c-36ea-41e7-89d1-5e7c7c32f334 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:12.014001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3b63c-36ea-41e7-89d1-5e7c7c32f334 None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05/groups/0195fc159fa94ff9950bc9b63ba52bdc/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:12.016203 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3b63c-36ea-41e7-89d1-5e7c7c32f334 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5562cd7183a40e6a7b3680cf02f3e05, group_id=0195fc159fa94ff9950bc9b63ba52bdc, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:12.017742 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3b63c-36ea-41e7-89d1-5e7c7c32f334 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:12.034916 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 206/391] 10.222.0.99 () {58 vars in 1442 bytes} [Mon Jul 18 14:04:11 2022] PUT /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05/groups/0195fc159fa94ff9950bc9b63ba52bdc/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:04:12.209118 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01568f-b459-4261-9ed7-50924a12a835 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:12.248287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43afee1-e20a-4516-8aa5-2318cd8a172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:12.249203 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43afee1-e20a-4516-8aa5-2318cd8a172b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:12.249488 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43afee1-e20a-4516-8aa5-2318cd8a172b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:12.250091 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43afee1-e20a-4516-8aa5-2318cd8a172b None admin] PATH_INFO: `/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:12.251314 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43afee1-e20a-4516-8aa5-2318cd8a172b None admin] RBAC: Authorizing `identity:get_group(group_id=0195fc159fa94ff9950bc9b63ba52bdc)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:12.252828 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43afee1-e20a-4516-8aa5-2318cd8a172b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:12.254668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 186/392] 10.222.0.99 () {56 vars in 1180 bytes} [Mon Jul 18 14:04:11 2022] GET /identity/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:12.260187 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3b63c-36ea-41e7-89d1-5e7c7c32f334 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:12.369978 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3b63c-36ea-41e7-89d1-5e7c7c32f334 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:12.378127 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:12.413052 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b2c37-a7be-4f23-a1e1-8ff9b7c8449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:12.413841 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b2c37-a7be-4f23-a1e1-8ff9b7c8449c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:12.414123 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b2c37-a7be-4f23-a1e1-8ff9b7c8449c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:12.414416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b2c37-a7be-4f23-a1e1-8ff9b7c8449c None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:12.415640 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b2c37-a7be-4f23-a1e1-8ff9b7c8449c None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:12.417106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b2c37-a7be-4f23-a1e1-8ff9b7c8449c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:12.418857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 207/393] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:04:12 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:12.424550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43afee1-e20a-4516-8aa5-2318cd8a172b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:12.517975 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:12.561156 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43afee1-e20a-4516-8aa5-2318cd8a172b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:12.608938 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c66d17-a6e4-4e8e-ba9e-5571f1f041a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:12.609831 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c66d17-a6e4-4e8e-ba9e-5571f1f041a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:12.610111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c66d17-a6e4-4e8e-ba9e-5571f1f041a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:12.610409 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c66d17-a6e4-4e8e-ba9e-5571f1f041a2 None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05/groups/0195fc159fa94ff9950bc9b63ba52bdc/roles/2e761f6eaaa94f9e85d77734e01ac393` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:12.612679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c66d17-a6e4-4e8e-ba9e-5571f1f041a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5562cd7183a40e6a7b3680cf02f3e05, group_id=0195fc159fa94ff9950bc9b63ba52bdc, role_id=2e761f6eaaa94f9e85d77734e01ac393)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:12.614124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c66d17-a6e4-4e8e-ba9e-5571f1f041a2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:12.637767 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 187/394] 10.222.0.99 () {58 vars in 1442 bytes} [Mon Jul 18 14:04:12 2022] PUT /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05/groups/0195fc159fa94ff9950bc9b63ba52bdc/roles/2e761f6eaaa94f9e85d77734e01ac393 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:04:12.776345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1488-ab3d-4402-a949-94ec369d3f13 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:12.776644 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1488-ab3d-4402-a949-94ec369d3f13 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:12.776822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc1488-ab3d-4402-a949-94ec369d3f13 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:12.778547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 208/395] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:12.783953 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491945e3-fc7d-406e-8e45-97da3fd042b3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:12.784239 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491945e3-fc7d-406e-8e45-97da3fd042b3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:12.784523 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491945e3-fc7d-406e-8e45-97da3fd042b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:12.808235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-491945e3-fc7d-406e-8e45-97da3fd042b3 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:12.809466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-491945e3-fc7d-406e-8e45-97da3fd042b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:12.888405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 188/396] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:12.917950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc1488-ab3d-4402-a949-94ec369d3f13 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:12.976300 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae7f9-d06e-49e0-8732-c7d0c52990c7 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:12.976919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae7f9-d06e-49e0-8732-c7d0c52990c7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:12.977623 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae7f9-d06e-49e0-8732-c7d0c52990c7 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:12.979717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 189/397] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:12.986035 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9893df4-b847-4045-9bcc-d0d3a8bdce7b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:12.986401 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9893df4-b847-4045-9bcc-d0d3a8bdce7b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:12.986704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9893df4-b847-4045-9bcc-d0d3a8bdce7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:13.005974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d9893df4-b847-4045-9bcc-d0d3a8bdce7b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:13.007348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d9893df4-b847-4045-9bcc-d0d3a8bdce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:13.081603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc1488-ab3d-4402-a949-94ec369d3f13 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:13.082175 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 190/398] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:04:13.082835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:13.106638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9893df4-b847-4045-9bcc-d0d3a8bdce7b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:13.141376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282d6cf-37e2-4b86-acee-ac8b6b40560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:13.142176 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282d6cf-37e2-4b86-acee-ac8b6b40560b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:13.142565 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282d6cf-37e2-4b86-acee-ac8b6b40560b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:13.142849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282d6cf-37e2-4b86-acee-ac8b6b40560b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:13.158413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282d6cf-37e2-4b86-acee-ac8b6b40560b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:13.161821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-c282d6cf-37e2-4b86-acee-ac8b6b40560b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:04:13.161821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:13.161821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:13.161821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:13.161821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:13.161821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:13.161821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:13.161821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:13.161821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:13.161821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:13.161821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:13.161821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:13.161821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:13.161821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:13.161821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:13.161821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:13.162788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:13.162788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:13.162788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:13.162788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:13.162788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:13.162788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:13.162788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:13.162788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:13.162788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:13.162788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:13.162788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:13.162788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:13.162788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:13.162788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:13.162788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:13.162788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:13.163590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:13.163590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:13.163590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:13.163590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:13.163590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:13.163590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:13.163590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:13.163590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:13.163590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:13.163590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:13.163590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:04:13.163590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:13.163590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 209/399] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:13.169234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282d6cf-37e2-4b86-acee-ac8b6b40560b None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:13.217574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:13.257824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9893df4-b847-4045-9bcc-d0d3a8bdce7b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:13.295597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa0fb1-1062-4fbe-90d5-9c20791bf497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:13.296396 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa0fb1-1062-4fbe-90d5-9c20791bf497 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:13.296680 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa0fb1-1062-4fbe-90d5-9c20791bf497 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:13.296954 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa0fb1-1062-4fbe-90d5-9c20791bf497 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:13.306454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282d6cf-37e2-4b86-acee-ac8b6b40560b None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:13.310843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa0fb1-1062-4fbe-90d5-9c20791bf497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:13.319919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-cbaa0fb1-1062-4fbe-90d5-9c20791bf497 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:04:13.319919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:13.319919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:13.319919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:13.319919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:13.319919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:13.319919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:13.319919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:13.319919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:13.319919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:13.319919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:13.319919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:13.319919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:13.319919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:13.319919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:13.319919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:13.320822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:13.320822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:13.320822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:13.320822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:13.320822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:13.320822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:13.320822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:13.320822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:13.320822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:13.320822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:13.320822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:13.320822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:13.320822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:13.320822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:13.320822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:13.320822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:13.321601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:13.321601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:13.321601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:13.321601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:13.321601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:13.321601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:13.321601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:13.321601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:13.321601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:13.321601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:13.321601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:04:13.321601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:13.322730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 191/400] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:04:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:13.323787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd2983-1378-400d-855a-7564231fc551 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:13.324073 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd2983-1378-400d-855a-7564231fc551 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:13.324351 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd2983-1378-400d-855a-7564231fc551 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:13.326094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 192/401] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:13.327309 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd2983-1378-400d-855a-7564231fc551 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:13.360654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624fa94-f9d5-4b2f-b023-0d1f23f099f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:13.361265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624fa94-f9d5-4b2f-b023-0d1f23f099f3 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:13.361549 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624fa94-f9d5-4b2f-b023-0d1f23f099f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:13.361829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624fa94-f9d5-4b2f-b023-0d1f23f099f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:13.362605 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624fa94-f9d5-4b2f-b023-0d1f23f099f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:13.362911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624fa94-f9d5-4b2f-b023-0d1f23f099f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:13.364299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624fa94-f9d5-4b2f-b023-0d1f23f099f3 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:13.375155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 210/402] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:04:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:13.376752 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3217ec9-abf5-4455-b23f-4ce75825c6c8 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:13.377302 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3217ec9-abf5-4455-b23f-4ce75825c6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:13.377794 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3217ec9-abf5-4455-b23f-4ce75825c6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:13.394852 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-f3217ec9-abf5-4455-b23f-4ce75825c6c8 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:13.396283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:13.396973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f3217ec9-abf5-4455-b23f-4ce75825c6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:13.454041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd2983-1378-400d-855a-7564231fc551 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:13.469189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 211/403] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:13.470579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3217ec9-abf5-4455-b23f-4ce75825c6c8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:13.503633 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e20e6-c2cd-4e47-9892-444c2c9d4e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:13.504480 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e20e6-c2cd-4e47-9892-444c2c9d4e1c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:13.504770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e20e6-c2cd-4e47-9892-444c2c9d4e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:13.505048 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e20e6-c2cd-4e47-9892-444c2c9d4e1c None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:13.505817 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e20e6-c2cd-4e47-9892-444c2c9d4e1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:13.506681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e20e6-c2cd-4e47-9892-444c2c9d4e1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:13.508516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e20e6-c2cd-4e47-9892-444c2c9d4e1c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:13.513205 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:13.520718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 193/404] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:13.521563 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e20e6-c2cd-4e47-9892-444c2c9d4e1c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:13.595958 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3217ec9-abf5-4455-b23f-4ce75825c6c8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:13.632085 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e20e6-c2cd-4e47-9892-444c2c9d4e1c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:13.637315 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b91563-6e76-4ae8-9c32-4f0d53b5ce6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:13.638894 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b91563-6e76-4ae8-9c32-4f0d53b5ce6a None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:13.639403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b91563-6e76-4ae8-9c32-4f0d53b5ce6a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:13.640230 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b91563-6e76-4ae8-9c32-4f0d53b5ce6a None admin] PATH_INFO: `/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:13.641798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b91563-6e76-4ae8-9c32-4f0d53b5ce6a None admin] RBAC: Authorizing `identity:get_group(group_id=0195fc159fa94ff9950bc9b63ba52bdc)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:13.643649 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b91563-6e76-4ae8-9c32-4f0d53b5ce6a None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:13.645965 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 212/405] 10.222.0.99 () {56 vars in 1180 bytes} [Mon Jul 18 14:04:13 2022] GET /identity/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:13.647391 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:13.648416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b91563-6e76-4ae8-9c32-4f0d53b5ce6a None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:13.669829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c86b35-9e0c-4db0-9042-e7b0ade5be5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:13.670759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c86b35-9e0c-4db0-9042-e7b0ade5be5b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:13.671042 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c86b35-9e0c-4db0-9042-e7b0ade5be5b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:13.671318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c86b35-9e0c-4db0-9042-e7b0ade5be5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:13.683005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c86b35-9e0c-4db0-9042-e7b0ade5be5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:13.692883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b1c86b35-9e0c-4db0-9042-e7b0ade5be5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:04:13.692883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:13.692883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:13.692883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:13.692883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:13.692883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:13.692883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:13.692883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:13.692883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:13.692883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:13.692883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:13.692883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:13.692883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:13.692883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:13.692883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:13.692883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:13.693788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:13.693788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:13.693788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:13.693788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:13.693788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:13.693788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:13.693788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:13.693788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:13.693788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:13.693788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:13.693788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:13.693788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:13.693788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:13.693788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:13.693788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:13.693788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:13.694638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:13.694638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:13.694638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:13.694638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:13.694638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:13.694638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:13.694638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:13.694638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:13.694638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:13.694638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:13.694638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:04:13.694638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:13.694638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 194/406] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:04:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:13.695332 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c86b35-9e0c-4db0-9042-e7b0ade5be5b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:13.754432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:13.761715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b91563-6e76-4ae8-9c32-4f0d53b5ce6a None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:13.798122 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d47176-872c-4fd0-8e47-f04484a0e188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:13.799547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d47176-872c-4fd0-8e47-f04484a0e188 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:13.800027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d47176-872c-4fd0-8e47-f04484a0e188 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:13.800498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d47176-872c-4fd0-8e47-f04484a0e188 None admin] PATH_INFO: `/v3/groups/9f1e70710f604ff0bc63d6bec43f4e7b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:13.802077 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d47176-872c-4fd0-8e47-f04484a0e188 None admin] RBAC: Authorizing `identity:get_group(group_id=9f1e70710f604ff0bc63d6bec43f4e7b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:13.803775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d47176-872c-4fd0-8e47-f04484a0e188 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:13.804769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c86b35-9e0c-4db0-9042-e7b0ade5be5b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:13.806202 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 213/407] 10.222.0.99 () {56 vars in 1180 bytes} [Mon Jul 18 14:04:13 2022] GET /identity/v3/groups/9f1e70710f604ff0bc63d6bec43f4e7b => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:13.807223 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d47176-872c-4fd0-8e47-f04484a0e188 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:13.848918 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b7dc3-be72-45bd-af18-be4589cd04e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:13.851888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b7dc3-be72-45bd-af18-be4589cd04e4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:13.851888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b7dc3-be72-45bd-af18-be4589cd04e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:13.851888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b7dc3-be72-45bd-af18-be4589cd04e4 None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:13.852143 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b7dc3-be72-45bd-af18-be4589cd04e4 None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:13.853943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b7dc3-be72-45bd-af18-be4589cd04e4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:13.858177 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 195/408] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:04:13 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:13.858177 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b7dc3-be72-45bd-af18-be4589cd04e4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:13.909868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:13.928842 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d47176-872c-4fd0-8e47-f04484a0e188 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:13.964868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226efe11-ce4f-41ca-87b2-4723a08d4499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:13.965681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226efe11-ce4f-41ca-87b2-4723a08d4499 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:13.966063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226efe11-ce4f-41ca-87b2-4723a08d4499 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:13.966478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226efe11-ce4f-41ca-87b2-4723a08d4499 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:13.967331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226efe11-ce4f-41ca-87b2-4723a08d4499 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:13.967737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226efe11-ce4f-41ca-87b2-4723a08d4499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:13.969271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226efe11-ce4f-41ca-87b2-4723a08d4499 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:13.978463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 214/409] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:13.979394 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226efe11-ce4f-41ca-87b2-4723a08d4499 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:13.983892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b7dc3-be72-45bd-af18-be4589cd04e4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:14.005416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:14.028941 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f673b-4937-4899-95dc-873003ec7546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:14.030449 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f673b-4937-4899-95dc-873003ec7546 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:14.031363 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f673b-4937-4899-95dc-873003ec7546 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:14.031822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f673b-4937-4899-95dc-873003ec7546 None admin] PATH_INFO: `/v3/projects/268276b3ee674678ab5061125ae1a657` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:14.033708 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f673b-4937-4899-95dc-873003ec7546 None admin] RBAC: Authorizing `identity:get_project(project_id=268276b3ee674678ab5061125ae1a657)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:14.035873 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f673b-4937-4899-95dc-873003ec7546 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:14.038123 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 196/410] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:04:13 2022] GET /identity/v3/projects/268276b3ee674678ab5061125ae1a657 => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:14.039146 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f673b-4937-4899-95dc-873003ec7546 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:14.108000 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226efe11-ce4f-41ca-87b2-4723a08d4499 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:14.152955 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f673b-4937-4899-95dc-873003ec7546 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:14.154433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6abb1d-9eb7-4c17-84e7-7d4d6c2275bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:14.155589 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6abb1d-9eb7-4c17-84e7-7d4d6c2275bb None admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:14.155874 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6abb1d-9eb7-4c17-84e7-7d4d6c2275bb None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:14.156154 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6abb1d-9eb7-4c17-84e7-7d4d6c2275bb None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b/groups/0195fc159fa94ff9950bc9b63ba52bdc/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:14.159377 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6abb1d-9eb7-4c17-84e7-7d4d6c2275bb None admin] RBAC: Authorizing `identity:create_grant(project_id=ca571ac5ee4f4ce99041231e60f5c76b, group_id=0195fc159fa94ff9950bc9b63ba52bdc, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:14.160709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6abb1d-9eb7-4c17-84e7-7d4d6c2275bb None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:14.167721 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:14.182238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 215/411] 10.222.0.99 () {58 vars in 1442 bytes} [Mon Jul 18 14:04:13 2022] PUT /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b/groups/0195fc159fa94ff9950bc9b63ba52bdc/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:04:14.183304 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6abb1d-9eb7-4c17-84e7-7d4d6c2275bb None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:14.198705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178da16-99a9-4a6c-b06c-9fb27511f6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:14.199832 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178da16-99a9-4a6c-b06c-9fb27511f6ac None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:14.200275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178da16-99a9-4a6c-b06c-9fb27511f6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:14.200644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178da16-99a9-4a6c-b06c-9fb27511f6ac None admin] PATH_INFO: `/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:14.202022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178da16-99a9-4a6c-b06c-9fb27511f6ac None admin] RBAC: Authorizing `identity:get_group(group_id=0195fc159fa94ff9950bc9b63ba52bdc)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:14.203792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178da16-99a9-4a6c-b06c-9fb27511f6ac None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:14.205942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 197/412] 10.222.0.99 () {56 vars in 1180 bytes} [Mon Jul 18 14:04:14 2022] GET /identity/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:14.218882 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178da16-99a9-4a6c-b06c-9fb27511f6ac None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:14.305958 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:14.326531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6abb1d-9eb7-4c17-84e7-7d4d6c2275bb None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:14.368126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629784b-ccf4-4c3b-9448-39b782cb5808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:14.369402 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629784b-ccf4-4c3b-9448-39b782cb5808 None admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:14.369829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629784b-ccf4-4c3b-9448-39b782cb5808 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:14.370239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629784b-ccf4-4c3b-9448-39b782cb5808 None admin] PATH_INFO: `/v3/projects/268276b3ee674678ab5061125ae1a657/groups/9f1e70710f604ff0bc63d6bec43f4e7b/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:14.372517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629784b-ccf4-4c3b-9448-39b782cb5808 None admin] RBAC: Authorizing `identity:create_grant(project_id=268276b3ee674678ab5061125ae1a657, group_id=9f1e70710f604ff0bc63d6bec43f4e7b, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:14.374156 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629784b-ccf4-4c3b-9448-39b782cb5808 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:14.393454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 216/413] 10.222.0.99 () {58 vars in 1442 bytes} [Mon Jul 18 14:04:14 2022] PUT /identity/v3/projects/268276b3ee674678ab5061125ae1a657/groups/9f1e70710f604ff0bc63d6bec43f4e7b/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:04:14.419289 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178da16-99a9-4a6c-b06c-9fb27511f6ac None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:14.456523 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda206cc-0795-4ee9-8a76-ac94cad1a611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:14.457520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda206cc-0795-4ee9-8a76-ac94cad1a611 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:14.457807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda206cc-0795-4ee9-8a76-ac94cad1a611 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:14.458087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda206cc-0795-4ee9-8a76-ac94cad1a611 None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:14.459346 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda206cc-0795-4ee9-8a76-ac94cad1a611 None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:14.460843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda206cc-0795-4ee9-8a76-ac94cad1a611 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:14.462678 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 198/414] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:04:14 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:14.468580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629784b-ccf4-4c3b-9448-39b782cb5808 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:14.616452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629784b-ccf4-4c3b-9448-39b782cb5808 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:14.653346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f88093-1f7c-40be-ab48-4ad50cf07510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:14.654329 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f88093-1f7c-40be-ab48-4ad50cf07510 None admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:14.654616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f88093-1f7c-40be-ab48-4ad50cf07510 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:14.654884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f88093-1f7c-40be-ab48-4ad50cf07510 None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b/groups/0195fc159fa94ff9950bc9b63ba52bdc/roles/2e761f6eaaa94f9e85d77734e01ac393` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:14.655942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc1932-7c5c-4850-9f16-87ac96f827fd None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:14.656237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc1932-7c5c-4850-9f16-87ac96f827fd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:14.656570 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc1932-7c5c-4850-9f16-87ac96f827fd None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:14.657558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f88093-1f7c-40be-ab48-4ad50cf07510 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca571ac5ee4f4ce99041231e60f5c76b, group_id=0195fc159fa94ff9950bc9b63ba52bdc, role_id=2e761f6eaaa94f9e85d77734e01ac393)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:14.658005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 199/415] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:14.659442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f88093-1f7c-40be-ab48-4ad50cf07510 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:14.664605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70684bb3-3cab-4e75-8882-145f919d5dda None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:14.664976 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70684bb3-3cab-4e75-8882-145f919d5dda None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:14.665242 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70684bb3-3cab-4e75-8882-145f919d5dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:14.673675 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 217/416] 10.222.0.99 () {58 vars in 1442 bytes} [Mon Jul 18 14:04:14 2022] PUT /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b/groups/0195fc159fa94ff9950bc9b63ba52bdc/roles/2e761f6eaaa94f9e85d77734e01ac393 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:04:14.698549 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-70684bb3-3cab-4e75-8882-145f919d5dda None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:14.699846 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-70684bb3-3cab-4e75-8882-145f919d5dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:14.758413 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:14.786505 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 200/417] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:04:14.809368 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f88093-1f7c-40be-ab48-4ad50cf07510 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:14.813867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:14.930832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f88093-1f7c-40be-ab48-4ad50cf07510 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:14.967752 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988e71a-6d77-4bd9-9456-09eedbaf5eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:14.968585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988e71a-6d77-4bd9-9456-09eedbaf5eec None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:14.968870 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988e71a-6d77-4bd9-9456-09eedbaf5eec None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:14.969143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988e71a-6d77-4bd9-9456-09eedbaf5eec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:14.979441 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988e71a-6d77-4bd9-9456-09eedbaf5eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:14.987324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-b988e71a-6d77-4bd9-9456-09eedbaf5eec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:04:14.987324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:14.987324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:14.987324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:14.987324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:14.987324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:14.987324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:14.987324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:14.987324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:14.987324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:14.987324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:14.987324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:14.987324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:14.987324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:14.987324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:14.987324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:14.988208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:14.988208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:14.988208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:14.988208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:14.988208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:14.988208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:14.988208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:14.988208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:14.988208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:14.988208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:14.988208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:14.988208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:14.988208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:14.988208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:14.988208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:14.988208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:14.989767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:14.989767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:14.989767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:14.989767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:14.989767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:14.989767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:14.989767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:14.989767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:14.989767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:14.989767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:14.989767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:04:14.989767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:14.989767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 218/418] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:14.994925 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70684bb3-3cab-4e75-8882-145f919d5dda None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:15.095868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d6f9-ca5d-44bb-b920-254c0d6f325f None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:15.096209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d6f9-ca5d-44bb-b920-254c0d6f325f None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:15.096423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86d6f9-ca5d-44bb-b920-254c0d6f325f None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:15.097784 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 219/419] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:04:15.108132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5902cac-a4a4-4366-b712-1c7216eeacaf None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:15.108710 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5902cac-a4a4-4366-b712-1c7216eeacaf None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:15.108710 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5902cac-a4a4-4366-b712-1c7216eeacaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:15.134787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-d5902cac-a4a4-4366-b712-1c7216eeacaf None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:15.135988 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d5902cac-a4a4-4366-b712-1c7216eeacaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:15.176937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70684bb3-3cab-4e75-8882-145f919d5dda None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:15.235196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5ee96-d4a6-46a9-9b86-b6d1a2e9f8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:15.236115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5ee96-d4a6-46a9-9b86-b6d1a2e9f8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:15.236507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5ee96-d4a6-46a9-9b86-b6d1a2e9f8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:15.236784 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5ee96-d4a6-46a9-9b86-b6d1a2e9f8e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:15.237581 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5ee96-d4a6-46a9-9b86-b6d1a2e9f8e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:15.237885 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5ee96-d4a6-46a9-9b86-b6d1a2e9f8e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:15.239753 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5ee96-d4a6-46a9-9b86-b6d1a2e9f8e0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:15.249235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 201/420] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:04:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:15.255413 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5ee96-d4a6-46a9-9b86-b6d1a2e9f8e0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:15.260792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:15.278258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 220/421] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:04:15.308332 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:15.332753 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5902cac-a4a4-4366-b712-1c7216eeacaf None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:15.392870 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5ee96-d4a6-46a9-9b86-b6d1a2e9f8e0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:15.450818 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2489b-f1bf-4a7c-bb1f-ad2b746ee512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:15.451510 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2489b-f1bf-4a7c-bb1f-ad2b746ee512 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:15.452027 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2489b-f1bf-4a7c-bb1f-ad2b746ee512 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:15.452137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2489b-f1bf-4a7c-bb1f-ad2b746ee512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:15.460919 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5902cac-a4a4-4366-b712-1c7216eeacaf None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:15.519096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922ce26-c25a-48d1-8594-e4ea0a35692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:15.521011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922ce26-c25a-48d1-8594-e4ea0a35692a None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:15.522023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922ce26-c25a-48d1-8594-e4ea0a35692a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:15.524700 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922ce26-c25a-48d1-8594-e4ea0a35692a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:15.544520 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922ce26-c25a-48d1-8594-e4ea0a35692a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:15.558858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-d922ce26-c25a-48d1-8594-e4ea0a35692a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:04:15.558858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:15.558858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:15.558858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:15.558858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:15.558858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:15.558858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:15.558858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:15.558858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:15.558858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:15.558858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:15.558858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:15.558858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:15.558858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:15.558858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:15.558858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:15.559974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:15.559974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:15.559974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:15.559974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:15.559974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:15.559974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:15.559974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:15.559974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:15.559974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:15.559974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:15.559974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:15.559974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:15.559974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:15.559974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:15.559974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:15.559974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:15.560957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:15.560957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:15.560957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:15.560957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:15.560957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:15.560957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:15.560957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:15.560957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:15.560957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:15.560957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:15.560957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:04:15.560957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:15.563182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 221/422] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:04:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:15.570707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922ce26-c25a-48d1-8594-e4ea0a35692a None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:15.591095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2489b-f1bf-4a7c-bb1f-ad2b746ee512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:15.593268 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2489b-f1bf-4a7c-bb1f-ad2b746ee512 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:15.651546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:15.696488 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:15.697175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922ce26-c25a-48d1-8594-e4ea0a35692a None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:15.733707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ddd8e-b2e2-46b9-a42f-547f193ca1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:15.734873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ddd8e-b2e2-46b9-a42f-547f193ca1de None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:15.735321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ddd8e-b2e2-46b9-a42f-547f193ca1de None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:15.735733 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ddd8e-b2e2-46b9-a42f-547f193ca1de None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:15.736774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ddd8e-b2e2-46b9-a42f-547f193ca1de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:15.737226 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ddd8e-b2e2-46b9-a42f-547f193ca1de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:15.738867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ddd8e-b2e2-46b9-a42f-547f193ca1de None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:15.748037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 222/423] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:15.754341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ddd8e-b2e2-46b9-a42f-547f193ca1de None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:15.857853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ddd8e-b2e2-46b9-a42f-547f193ca1de None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:15.891351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb286cba-550f-42d6-a96a-49e90617b409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:15.892198 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb286cba-550f-42d6-a96a-49e90617b409 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:15.893199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb286cba-550f-42d6-a96a-49e90617b409 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:15.893673 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb286cba-550f-42d6-a96a-49e90617b409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:15.905361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 202/424] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:15.907579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:15.923424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2489b-f1bf-4a7c-bb1f-ad2b746ee512 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:15.967712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb286cba-550f-42d6-a96a-49e90617b409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:15.969173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb286cba-550f-42d6-a96a-49e90617b409 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:16.068559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 223/425] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 14:04:16.074041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb286cba-550f-42d6-a96a-49e90617b409 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:16.119634 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:16.177608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb286cba-550f-42d6-a96a-49e90617b409 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:16.212560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c3917-dcc0-4743-aa40-df59efda5eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:16.213423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c3917-dcc0-4743-aa40-df59efda5eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:16.213695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c3917-dcc0-4743-aa40-df59efda5eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:16.213956 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c3917-dcc0-4743-aa40-df59efda5eb0 None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:16.215208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c3917-dcc0-4743-aa40-df59efda5eb0 None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:16.222411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2489b-f1bf-4a7c-bb1f-ad2b746ee512 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:16.222737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c3917-dcc0-4743-aa40-df59efda5eb0 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:16.222960 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 224/426] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:04:16 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:16.223985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c3917-dcc0-4743-aa40-df59efda5eb0 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:16.272895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01c39a-7a09-4c31-a67e-81e900c2a365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:16.274141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01c39a-7a09-4c31-a67e-81e900c2a365 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:16.274666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01c39a-7a09-4c31-a67e-81e900c2a365 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:16.275152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01c39a-7a09-4c31-a67e-81e900c2a365 None admin] PATH_INFO: `/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:16.276558 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01c39a-7a09-4c31-a67e-81e900c2a365 None admin] RBAC: Authorizing `identity:get_project(project_id=c5562cd7183a40e6a7b3680cf02f3e05)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:16.278262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01c39a-7a09-4c31-a67e-81e900c2a365 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:16.280558 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 203/427] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:04:15 2022] GET /identity/v3/projects/c5562cd7183a40e6a7b3680cf02f3e05 => generated 298 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:16.285617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01c39a-7a09-4c31-a67e-81e900c2a365 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:16.299175 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:16.378476 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:16.437062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01c39a-7a09-4c31-a67e-81e900c2a365 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:16.452423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c3917-dcc0-4743-aa40-df59efda5eb0 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:16.473299 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce18e7-0fbf-428c-b92e-cf217adf41ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:16.474261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce18e7-0fbf-428c-b92e-cf217adf41ab None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:16.474583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce18e7-0fbf-428c-b92e-cf217adf41ab None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:16.474862 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce18e7-0fbf-428c-b92e-cf217adf41ab None admin] PATH_INFO: `/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:16.476078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce18e7-0fbf-428c-b92e-cf217adf41ab None admin] RBAC: Authorizing `identity:get_group(group_id=0195fc159fa94ff9950bc9b63ba52bdc)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:16.477550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce18e7-0fbf-428c-b92e-cf217adf41ab None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:16.479615 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 204/428] 10.222.0.99 () {56 vars in 1180 bytes} [Mon Jul 18 14:04:16 2022] GET /identity/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:16.486747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce18e7-0fbf-428c-b92e-cf217adf41ab None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:16.529510 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02c473-a40b-400b-971e-0e876a66df4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:16.530372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02c473-a40b-400b-971e-0e876a66df4b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:16.530685 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02c473-a40b-400b-971e-0e876a66df4b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:16.531015 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02c473-a40b-400b-971e-0e876a66df4b None admin] PATH_INFO: `/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:16.532451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02c473-a40b-400b-971e-0e876a66df4b None admin] RBAC: Authorizing `identity:get_group(group_id=0195fc159fa94ff9950bc9b63ba52bdc)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:16.533952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02c473-a40b-400b-971e-0e876a66df4b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:16.535626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 225/429] 10.222.0.99 () {56 vars in 1180 bytes} [Mon Jul 18 14:04:16 2022] GET /identity/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc => generated 226 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:16.541530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02c473-a40b-400b-971e-0e876a66df4b None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:16.620411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:16.653951 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce18e7-0fbf-428c-b92e-cf217adf41ab None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:16.694988 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273b66a-f747-44ac-b005-24b51a1ad49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:16.695677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273b66a-f747-44ac-b005-24b51a1ad49e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:16.695963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273b66a-f747-44ac-b005-24b51a1ad49e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:16.696240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273b66a-f747-44ac-b005-24b51a1ad49e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:16.697103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273b66a-f747-44ac-b005-24b51a1ad49e None admin] RBAC: Adding query filter params (group.id=0195fc159fa94ff9950bc9b63ba52bdc, role.id=9e92f0503b5c47a4a7368e618f37c6ae, scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:16.697221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02c473-a40b-400b-971e-0e876a66df4b None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:16.697536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273b66a-f747-44ac-b005-24b51a1ad49e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:16.700266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273b66a-f747-44ac-b005-24b51a1ad49e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:16.707560 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 205/430] 10.222.0.99 () {56 vars in 1376 bytes} [Mon Jul 18 14:04:16 2022] GET /identity/v3/role_assignments?group.id=0195fc159fa94ff9950bc9b63ba52bdc&scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05&role.id=9e92f0503b5c47a4a7368e618f37c6ae => generated 611 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:16.709061 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2db41-727e-40a3-b3ee-7b6e3ecabdb9 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:16.709357 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2db41-727e-40a3-b3ee-7b6e3ecabdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:16.709638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2db41-727e-40a3-b3ee-7b6e3ecabdb9 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:16.711347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 206/431] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:16.718103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f876b-edf4-456a-9afb-4e29266a7e46 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:16.718492 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f876b-edf4-456a-9afb-4e29266a7e46 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:16.718852 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f876b-edf4-456a-9afb-4e29266a7e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:16.753721 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d85f876b-edf4-456a-9afb-4e29266a7e46 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:16.756451 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d85f876b-edf4-456a-9afb-4e29266a7e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:16.785775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa907d-dd24-4f67-84ca-a927b780c320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:16.786946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa907d-dd24-4f67-84ca-a927b780c320 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:16.787385 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa907d-dd24-4f67-84ca-a927b780c320 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:16.787853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa907d-dd24-4f67-84ca-a927b780c320 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:16.789359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa907d-dd24-4f67-84ca-a927b780c320 None admin] RBAC: Adding query filter params (group.id=0195fc159fa94ff9950bc9b63ba52bdc, role.id=2e761f6eaaa94f9e85d77734e01ac393, scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:16.789690 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa907d-dd24-4f67-84ca-a927b780c320 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:16.791208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa907d-dd24-4f67-84ca-a927b780c320 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:16.806419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 226/432] 10.222.0.99 () {56 vars in 1376 bytes} [Mon Jul 18 14:04:16 2022] GET /identity/v3/role_assignments?group.id=0195fc159fa94ff9950bc9b63ba52bdc&scope.project.id=c5562cd7183a40e6a7b3680cf02f3e05&role.id=2e761f6eaaa94f9e85d77734e01ac393 => generated 611 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:16.871502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179eef9-6a4d-4410-9c6d-9f594c4b1be2 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:16.871856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179eef9-6a4d-4410-9c6d-9f594c4b1be2 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:16.872112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179eef9-6a4d-4410-9c6d-9f594c4b1be2 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:16.875840 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 227/433] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:16.881546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac147f-8f37-4c0b-b635-414a35608f12 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:16.881883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac147f-8f37-4c0b-b635-414a35608f12 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:16.882133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac147f-8f37-4c0b-b635-414a35608f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:16.900863 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 207/434] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:16.912602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-37ac147f-8f37-4c0b-b635-414a35608f12 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:16.913754 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-37ac147f-8f37-4c0b-b635-414a35608f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:16.924688 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f876b-edf4-456a-9afb-4e29266a7e46 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:16.927243 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:17.017111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 228/435] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:17.041276 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac147f-8f37-4c0b-b635-414a35608f12 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:17.045791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:17.077162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f876b-edf4-456a-9afb-4e29266a7e46 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:17.125574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484ef13-8338-4c8a-a409-0a03b6194005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:17.127153 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484ef13-8338-4c8a-a409-0a03b6194005 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:17.127441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484ef13-8338-4c8a-a409-0a03b6194005 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:17.127998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484ef13-8338-4c8a-a409-0a03b6194005 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:17.144596 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484ef13-8338-4c8a-a409-0a03b6194005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:17.152155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c484ef13-8338-4c8a-a409-0a03b6194005 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:04:17.152155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:17.152155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:17.152155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:17.152155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:17.152155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:17.152155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:17.152155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:17.152155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:17.152155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:17.152155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:17.152155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:17.152155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:17.152155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:17.152155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:17.152155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:17.153065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:17.153065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:17.153065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:17.153065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:17.153065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:17.153065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:17.153065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:17.153065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:17.153065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:17.153065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:17.153065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:17.153065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:17.153065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:17.153065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:17.153065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:17.153065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:17.153956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:17.153956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:17.153956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:17.153956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:17.153956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:17.153956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:17.153956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:17.153956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:17.153956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:17.153956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:17.153956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 14:04:17.153956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:17.154594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 208/436] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:17.155461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7aa74e-496b-4239-acb5-aabdb6dcce5f None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:17.155753 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7aa74e-496b-4239-acb5-aabdb6dcce5f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:17.156032 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7aa74e-496b-4239-acb5-aabdb6dcce5f None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:17.157292 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 209/437] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:17.165306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7aa74e-496b-4239-acb5-aabdb6dcce5f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:17.201671 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac147f-8f37-4c0b-b635-414a35608f12 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:17.246963 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8e310-d99e-435c-8d38-fe22671ad59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:17.247767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8e310-d99e-435c-8d38-fe22671ad59c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:17.248056 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8e310-d99e-435c-8d38-fe22671ad59c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:17.248333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8e310-d99e-435c-8d38-fe22671ad59c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:17.262279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8e310-d99e-435c-8d38-fe22671ad59c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:17.271314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-a4d8e310-d99e-435c-8d38-fe22671ad59c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:04:17.271314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:17.271314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:17.271314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:17.271314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:17.271314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:17.271314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:17.271314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:17.271314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:17.271314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:17.271314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:17.271314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:17.271314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:17.271314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:17.271314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:17.271314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:17.272301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:17.272301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:17.272301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:17.272301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:17.272301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:17.272301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:17.272301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:17.272301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:17.272301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:17.272301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:17.272301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:17.272301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:17.272301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:17.272301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:17.272301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:17.272301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:17.273160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:17.273160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:17.273160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:17.273160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:17.273160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:17.273160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:17.273160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:17.273160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:17.273160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:17.273160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:17.273160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:04:17.273160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:17.275246 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 229/438] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:04:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:17.281371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f68bc-463d-4413-a23f-7cfe1339016b None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:17.281664 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f68bc-463d-4413-a23f-7cfe1339016b None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:17.281949 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f68bc-463d-4413-a23f-7cfe1339016b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:17.291860 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7aa74e-496b-4239-acb5-aabdb6dcce5f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:17.297765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:17.299948 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-517f68bc-463d-4413-a23f-7cfe1339016b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:17.301961 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-517f68bc-463d-4413-a23f-7cfe1339016b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:17.320475 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:17.329898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd57a42-fc5a-4037-8795-78947f139b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:17.330715 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd57a42-fc5a-4037-8795-78947f139b71 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:17.331000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd57a42-fc5a-4037-8795-78947f139b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:17.331272 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd57a42-fc5a-4037-8795-78947f139b71 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:17.332030 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd57a42-fc5a-4037-8795-78947f139b71 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:17.332334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd57a42-fc5a-4037-8795-78947f139b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:17.333719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd57a42-fc5a-4037-8795-78947f139b71 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:17.344408 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 210/439] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:04:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:17.347588 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd57a42-fc5a-4037-8795-78947f139b71 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:17.387737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 230/440] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:17.388604 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f68bc-463d-4413-a23f-7cfe1339016b None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:17.463592 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd57a42-fc5a-4037-8795-78947f139b71 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:17.492498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f68bc-463d-4413-a23f-7cfe1339016b None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:17.496736 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcd869-a364-4ac8-a00a-0ff19c2c7865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:17.497403 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcd869-a364-4ac8-a00a-0ff19c2c7865 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:17.497688 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcd869-a364-4ac8-a00a-0ff19c2c7865 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:17.497966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcd869-a364-4ac8-a00a-0ff19c2c7865 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:17.498758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcd869-a364-4ac8-a00a-0ff19c2c7865 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:17.499067 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcd869-a364-4ac8-a00a-0ff19c2c7865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:17.500767 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcd869-a364-4ac8-a00a-0ff19c2c7865 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:17.508806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 211/441] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:17.509585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcd869-a364-4ac8-a00a-0ff19c2c7865 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:17.532351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdfcd9-21da-4690-9a56-eab981d6d5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:17.533023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdfcd9-21da-4690-9a56-eab981d6d5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:17.533311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdfcd9-21da-4690-9a56-eab981d6d5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:17.533589 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdfcd9-21da-4690-9a56-eab981d6d5d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:17.537261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:17.561379 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:17.604491 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdfcd9-21da-4690-9a56-eab981d6d5d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:17.605957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdfcd9-21da-4690-9a56-eab981d6d5d2 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:17.610586 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcd869-a364-4ac8-a00a-0ff19c2c7865 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:17.644136 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804f83d-55a3-48da-9c69-0ff2c0000c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:17.644979 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804f83d-55a3-48da-9c69-0ff2c0000c12 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:17.645230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804f83d-55a3-48da-9c69-0ff2c0000c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:17.645506 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804f83d-55a3-48da-9c69-0ff2c0000c12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:17.655716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804f83d-55a3-48da-9c69-0ff2c0000c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:17.664179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d804f83d-55a3-48da-9c69-0ff2c0000c12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:04:17.664179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:17.664179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:17.664179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:17.664179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:17.664179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:17.664179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:17.664179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:17.664179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:17.664179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:17.664179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:17.664179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:17.664179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:17.664179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:17.664179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:17.664179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:17.665119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:17.665119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:17.665119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:17.665119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:17.665119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:17.665119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:17.665119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:17.665119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:17.665119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:17.665119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:17.665119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:17.665119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:17.665119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:17.665119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:17.665119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:17.665119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:17.665919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:17.665919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:17.665919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:17.665919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:17.665919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:17.665919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:17.665919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:17.665919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:17.665919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:17.665919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:17.665919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:04:17.665919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:17.665919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 212/442] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:04:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:17.666613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804f83d-55a3-48da-9c69-0ff2c0000c12 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:17.711123 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 231/443] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:17.712241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdfcd9-21da-4690-9a56-eab981d6d5d2 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:17.747242 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:17.769345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804f83d-55a3-48da-9c69-0ff2c0000c12 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:17.782628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:17.805091 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b3f7f-3d6f-4ff1-be8d-adc95e2068bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:17.805737 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b3f7f-3d6f-4ff1-be8d-adc95e2068bf None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:17.806262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b3f7f-3d6f-4ff1-be8d-adc95e2068bf None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:17.806262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b3f7f-3d6f-4ff1-be8d-adc95e2068bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:17.811861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdfcd9-21da-4690-9a56-eab981d6d5d2 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:17.846768 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faac3e2-d8ee-45ef-8610-c5a529664f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:17.847561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faac3e2-d8ee-45ef-8610-c5a529664f25 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:17.847711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faac3e2-d8ee-45ef-8610-c5a529664f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:17.848229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faac3e2-d8ee-45ef-8610-c5a529664f25 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:17.848713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faac3e2-d8ee-45ef-8610-c5a529664f25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:17.849021 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faac3e2-d8ee-45ef-8610-c5a529664f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:17.850425 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faac3e2-d8ee-45ef-8610-c5a529664f25 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:17.858457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 232/444] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:17.859233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faac3e2-d8ee-45ef-8610-c5a529664f25 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:17.877445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b3f7f-3d6f-4ff1-be8d-adc95e2068bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:17.878973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b3f7f-3d6f-4ff1-be8d-adc95e2068bf None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:17.958492 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:17.962674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faac3e2-d8ee-45ef-8610-c5a529664f25 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:17.976198 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 213/445] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:17.977038 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b3f7f-3d6f-4ff1-be8d-adc95e2068bf None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:17.992466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:17.998165 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71747e-5412-489d-9ded-2e2301260911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:17.998996 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71747e-5412-489d-9ded-2e2301260911 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:17.999276 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71747e-5412-489d-9ded-2e2301260911 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:17.999532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71747e-5412-489d-9ded-2e2301260911 None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:18.001044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71747e-5412-489d-9ded-2e2301260911 None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:18.002521 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71747e-5412-489d-9ded-2e2301260911 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:18.004429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 233/446] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:04:17 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:18.004965 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71747e-5412-489d-9ded-2e2301260911 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:18.081455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b3f7f-3d6f-4ff1-be8d-adc95e2068bf None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:18.102860 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71747e-5412-489d-9ded-2e2301260911 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:18.116123 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3501d-32bd-4083-b42a-8302fb344bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:18.116769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3501d-32bd-4083-b42a-8302fb344bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:18.117048 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3501d-32bd-4083-b42a-8302fb344bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:18.117317 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3501d-32bd-4083-b42a-8302fb344bf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:18.135886 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9d75-d5d2-4e45-b369-17cdf9a17f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:18.136746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9d75-d5d2-4e45-b369-17cdf9a17f0f None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:18.137025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9d75-d5d2-4e45-b369-17cdf9a17f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:18.137294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b9d75-d5d2-4e45-b369-17cdf9a17f0f None admin] PATH_INFO: `/v3/projects/268276b3ee674678ab5061125ae1a657` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:18.138509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b9d75-d5d2-4e45-b369-17cdf9a17f0f None admin] RBAC: Authorizing `identity:get_project(project_id=268276b3ee674678ab5061125ae1a657)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:18.139979 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b9d75-d5d2-4e45-b369-17cdf9a17f0f None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:18.141654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 234/447] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:04:18 2022] GET /identity/v3/projects/268276b3ee674678ab5061125ae1a657 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:18.142524 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9d75-d5d2-4e45-b369-17cdf9a17f0f None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:18.179632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:18.194682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3501d-32bd-4083-b42a-8302fb344bf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:18.196170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3501d-32bd-4083-b42a-8302fb344bf1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:18.210157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:18.246671 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b9d75-d5d2-4e45-b369-17cdf9a17f0f None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:18.283545 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffc5bb-ff8a-442e-aebc-5101b8e06902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:18.284320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffc5bb-ff8a-442e-aebc-5101b8e06902 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:18.284601 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffc5bb-ff8a-442e-aebc-5101b8e06902 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:18.284873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffc5bb-ff8a-442e-aebc-5101b8e06902 None admin] PATH_INFO: `/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:18.286149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ffc5bb-ff8a-442e-aebc-5101b8e06902 None admin] RBAC: Authorizing `identity:get_group(group_id=0195fc159fa94ff9950bc9b63ba52bdc)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:18.287629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ffc5bb-ff8a-442e-aebc-5101b8e06902 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:18.289241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 235/448] 10.222.0.99 () {56 vars in 1180 bytes} [Mon Jul 18 14:04:18 2022] GET /identity/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:18.289990 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffc5bb-ff8a-442e-aebc-5101b8e06902 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:18.309388 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 214/449] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:18.310516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3501d-32bd-4083-b42a-8302fb344bf1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:18.391376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffc5bb-ff8a-442e-aebc-5101b8e06902 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:18.392893 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:18.412504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3501d-32bd-4083-b42a-8302fb344bf1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:18.425381 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86191dc5-2930-4a14-aa77-5dc6d93601dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:18.426102 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:18.426222 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86191dc5-2930-4a14-aa77-5dc6d93601dd None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:18.426496 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86191dc5-2930-4a14-aa77-5dc6d93601dd None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:18.426768 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86191dc5-2930-4a14-aa77-5dc6d93601dd None admin] PATH_INFO: `/v3/groups/9f1e70710f604ff0bc63d6bec43f4e7b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:18.427940 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86191dc5-2930-4a14-aa77-5dc6d93601dd None admin] RBAC: Authorizing `identity:get_group(group_id=9f1e70710f604ff0bc63d6bec43f4e7b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:18.429597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86191dc5-2930-4a14-aa77-5dc6d93601dd None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:18.431253 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 236/450] 10.222.0.99 () {56 vars in 1180 bytes} [Mon Jul 18 14:04:18 2022] GET /identity/v3/groups/9f1e70710f604ff0bc63d6bec43f4e7b => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:18.432001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86191dc5-2930-4a14-aa77-5dc6d93601dd None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:18.450475 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1a3d1-d2fd-4b88-8c79-33eea09a4cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:18.451125 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1a3d1-d2fd-4b88-8c79-33eea09a4cac None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:18.451408 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1a3d1-d2fd-4b88-8c79-33eea09a4cac None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:18.451690 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1a3d1-d2fd-4b88-8c79-33eea09a4cac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:18.452530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1a3d1-d2fd-4b88-8c79-33eea09a4cac None admin] RBAC: Adding query filter params (group.id=0195fc159fa94ff9950bc9b63ba52bdc, role.id=9e92f0503b5c47a4a7368e618f37c6ae, scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:18.452841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1a3d1-d2fd-4b88-8c79-33eea09a4cac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:18.454295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1a3d1-d2fd-4b88-8c79-33eea09a4cac None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:18.460311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 215/451] 10.222.0.99 () {56 vars in 1376 bytes} [Mon Jul 18 14:04:18 2022] GET /identity/v3/role_assignments?group.id=0195fc159fa94ff9950bc9b63ba52bdc&scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b&role.id=9e92f0503b5c47a4a7368e618f37c6ae => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:18.461090 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1a3d1-d2fd-4b88-8c79-33eea09a4cac None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:18.548896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86191dc5-2930-4a14-aa77-5dc6d93601dd None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:18.576941 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1a3d1-d2fd-4b88-8c79-33eea09a4cac None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:18.583753 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86427555-e910-440a-a170-7f4c338f8017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:18.584628 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86427555-e910-440a-a170-7f4c338f8017 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:18.584907 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86427555-e910-440a-a170-7f4c338f8017 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:18.585177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86427555-e910-440a-a170-7f4c338f8017 None admin] PATH_INFO: `/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:18.586470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86427555-e910-440a-a170-7f4c338f8017 None admin] RBAC: Authorizing `identity:get_project(project_id=ca571ac5ee4f4ce99041231e60f5c76b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:18.587887 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86427555-e910-440a-a170-7f4c338f8017 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:18.589686 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 237/452] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:04:18 2022] GET /identity/v3/projects/ca571ac5ee4f4ce99041231e60f5c76b => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:18.595309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86427555-e910-440a-a170-7f4c338f8017 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:18.619402 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27259a1-34b0-43e0-9067-3fb928e91052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:18.620062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27259a1-34b0-43e0-9067-3fb928e91052 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:18.620349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27259a1-34b0-43e0-9067-3fb928e91052 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:18.620626 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27259a1-34b0-43e0-9067-3fb928e91052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:18.621554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27259a1-34b0-43e0-9067-3fb928e91052 None admin] RBAC: Adding query filter params (group.id=9f1e70710f604ff0bc63d6bec43f4e7b, role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=268276b3ee674678ab5061125ae1a657) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:18.621773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27259a1-34b0-43e0-9067-3fb928e91052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:18.623267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27259a1-34b0-43e0-9067-3fb928e91052 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:18.636441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 216/453] 10.222.0.99 () {56 vars in 1376 bytes} [Mon Jul 18 14:04:18 2022] GET /identity/v3/role_assignments?group.id=9f1e70710f604ff0bc63d6bec43f4e7b&scope.project.id=268276b3ee674678ab5061125ae1a657&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:18.646431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:18.716456 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86427555-e910-440a-a170-7f4c338f8017 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:18.753153 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe343ee1-9f56-4ebe-b53e-b02bb8673729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:18.754032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe343ee1-9f56-4ebe-b53e-b02bb8673729 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:18.754317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe343ee1-9f56-4ebe-b53e-b02bb8673729 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:18.754625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe343ee1-9f56-4ebe-b53e-b02bb8673729 None admin] PATH_INFO: `/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:18.755924 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe343ee1-9f56-4ebe-b53e-b02bb8673729 None admin] RBAC: Authorizing `identity:get_group(group_id=0195fc159fa94ff9950bc9b63ba52bdc)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:18.757389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe343ee1-9f56-4ebe-b53e-b02bb8673729 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:18.759114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 238/454] 10.222.0.99 () {56 vars in 1180 bytes} [Mon Jul 18 14:04:18 2022] GET /identity/v3/groups/0195fc159fa94ff9950bc9b63ba52bdc => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:18.765180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27259a1-34b0-43e0-9067-3fb928e91052 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:18.814812 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:18.877440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27259a1-34b0-43e0-9067-3fb928e91052 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:18.909856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549c496-2252-4c02-86ae-bee1058a9a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:18.911651 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549c496-2252-4c02-86ae-bee1058a9a22 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:18.911651 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549c496-2252-4c02-86ae-bee1058a9a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:18.911651 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549c496-2252-4c02-86ae-bee1058a9a22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:18.911931 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549c496-2252-4c02-86ae-bee1058a9a22 None admin] RBAC: Adding query filter params (group.id=0195fc159fa94ff9950bc9b63ba52bdc, role.id=2e761f6eaaa94f9e85d77734e01ac393, scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:18.912186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549c496-2252-4c02-86ae-bee1058a9a22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:18.913626 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549c496-2252-4c02-86ae-bee1058a9a22 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:18.919603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 217/455] 10.222.0.99 () {56 vars in 1376 bytes} [Mon Jul 18 14:04:18 2022] GET /identity/v3/role_assignments?group.id=0195fc159fa94ff9950bc9b63ba52bdc&scope.project.id=ca571ac5ee4f4ce99041231e60f5c76b&role.id=2e761f6eaaa94f9e85d77734e01ac393 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:21.615633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca237d93-3bd2-456b-b57c-ba34e624efeb None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:21.616134 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca237d93-3bd2-456b-b57c-ba34e624efeb None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:21.616231 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca237d93-3bd2-456b-b57c-ba34e624efeb None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:21.617829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 239/456] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:21.623437 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019d4e0-fd19-46a3-b7bb-d8dbe1812adf None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:21.623834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019d4e0-fd19-46a3-b7bb-d8dbe1812adf None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:21.624014 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019d4e0-fd19-46a3-b7bb-d8dbe1812adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:21.635620 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e89e3b-ccad-4bde-9cc7-f6055f699c7a None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:21.635907 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e89e3b-ccad-4bde-9cc7-f6055f699c7a None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:21.636191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e89e3b-ccad-4bde-9cc7-f6055f699c7a None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:21.637813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 240/457] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:21.646953 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2019d4e0-fd19-46a3-b7bb-d8dbe1812adf None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:21.648316 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2019d4e0-fd19-46a3-b7bb-d8dbe1812adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:21.651777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb8da3-6d6d-4905-a9e1-f2af27aa56fa None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:21.652064 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb8da3-6d6d-4905-a9e1-f2af27aa56fa None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:21.652343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb8da3-6d6d-4905-a9e1-f2af27aa56fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:21.678668 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-64fb8da3-6d6d-4905-a9e1-f2af27aa56fa None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:21.679863 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-64fb8da3-6d6d-4905-a9e1-f2af27aa56fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:21.766500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 218/458] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:04:21.784828 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019d4e0-fd19-46a3-b7bb-d8dbe1812adf None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:21.808931 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 241/459] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:21.822809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:21.838440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb8da3-6d6d-4905-a9e1-f2af27aa56fa None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:21.890071 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019d4e0-fd19-46a3-b7bb-d8dbe1812adf None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:21.896915 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:21.926380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4a313-4de1-471e-990f-f280c6d6f9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:21.927442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4a313-4de1-471e-990f-f280c6d6f9ea None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:21.927871 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4a313-4de1-471e-990f-f280c6d6f9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:21.928666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4a313-4de1-471e-990f-f280c6d6f9ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:21.945129 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4a313-4de1-471e-990f-f280c6d6f9ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:21.946649 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4a313-4de1-471e-990f-f280c6d6f9ea None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:21.964584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-eca4a313-4de1-471e-990f-f280c6d6f9ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:21.964584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:21.964584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:21.964584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:21.964584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:21.964584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:21.964584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:21.964584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:21.964584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:21.964584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:21.964584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:21.964584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:21.964584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:21.964584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:21.964584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:21.965494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:21.971108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:21.971108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:21.971108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:21.971108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:21.971108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 219/460] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:21.971108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc54370-a448-4d88-b1bc-89382754f246 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:21.971108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc54370-a448-4d88-b1bc-89382754f246 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:21.971108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc54370-a448-4d88-b1bc-89382754f246 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:21.973856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 220/461] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:21.974735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1bc0e-b1d0-4404-ae4c-1cf6fa8e24a0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:21.974993 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1bc0e-b1d0-4404-ae4c-1cf6fa8e24a0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:21.975333 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1bc0e-b1d0-4404-ae4c-1cf6fa8e24a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:21.977402 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb8da3-6d6d-4905-a9e1-f2af27aa56fa None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:21.996122 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6ef1bc0e-b1d0-4404-ae4c-1cf6fa8e24a0 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:21.997332 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6ef1bc0e-b1d0-4404-ae4c-1cf6fa8e24a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:22.026307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041ea16-148b-428e-b5e4-3c2d996080ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:22.027759 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041ea16-148b-428e-b5e4-3c2d996080ed None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:22.028502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041ea16-148b-428e-b5e4-3c2d996080ed None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:22.029332 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041ea16-148b-428e-b5e4-3c2d996080ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:22.041469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041ea16-148b-428e-b5e4-3c2d996080ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:22.043780 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041ea16-148b-428e-b5e4-3c2d996080ed None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:22.071509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-5041ea16-148b-428e-b5e4-3c2d996080ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:22.071509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:22.071509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:22.071509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:22.071509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:22.071509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:22.071509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:22.071509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:22.071509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:22.071509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:22.071509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:22.071509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:22.071509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:22.071509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:22.071509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:22.072439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:22.073728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:22.073728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:22.073728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:22.073728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:22.073728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 242/462] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:22.073728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041ea16-148b-428e-b5e4-3c2d996080ed None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:22.082481 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 221/463] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:22.083431 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1bc0e-b1d0-4404-ae4c-1cf6fa8e24a0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:22.118262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:22.186965 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:22.201801 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041ea16-148b-428e-b5e4-3c2d996080ed None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:22.225050 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1bc0e-b1d0-4404-ae4c-1cf6fa8e24a0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:22.248984 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab1a91-5818-4190-b986-dd212460c766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:22.250985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1a91-5818-4190-b986-dd212460c766 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:22.251479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1a91-5818-4190-b986-dd212460c766 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:22.252245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab1a91-5818-4190-b986-dd212460c766 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:22.253441 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab1a91-5818-4190-b986-dd212460c766 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:22.254734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab1a91-5818-4190-b986-dd212460c766 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:22.257075 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab1a91-5818-4190-b986-dd212460c766 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:22.264395 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49af0fc-661e-4e41-8827-112c5aed946d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:22.265070 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49af0fc-661e-4e41-8827-112c5aed946d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:22.265353 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49af0fc-661e-4e41-8827-112c5aed946d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:22.265628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49af0fc-661e-4e41-8827-112c5aed946d None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:22.266372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49af0fc-661e-4e41-8827-112c5aed946d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:22.266721 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49af0fc-661e-4e41-8827-112c5aed946d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:22.268334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49af0fc-661e-4e41-8827-112c5aed946d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:22.279548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 243/464] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:22.280708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab1a91-5818-4190-b986-dd212460c766 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:22.284697 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 222/465] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:22.285794 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49af0fc-661e-4e41-8827-112c5aed946d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:22.369539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:22.394446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49af0fc-661e-4e41-8827-112c5aed946d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:22.412353 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab1a91-5818-4190-b986-dd212460c766 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:22.431711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e985af-5f9d-49f0-b61a-f51fcdfb680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:22.432575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e985af-5f9d-49f0-b61a-f51fcdfb680c None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:22.433433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e985af-5f9d-49f0-b61a-f51fcdfb680c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:22.433433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e985af-5f9d-49f0-b61a-f51fcdfb680c None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:22.434145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e985af-5f9d-49f0-b61a-f51fcdfb680c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:22.436830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e985af-5f9d-49f0-b61a-f51fcdfb680c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:22.465854 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 223/466] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:04:22 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:04:22.465854 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e985af-5f9d-49f0-b61a-f51fcdfb680c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:22.466148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34fef6-608f-42c6-af7b-bb09d34b5edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:22.466148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34fef6-608f-42c6-af7b-bb09d34b5edb None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:22.466148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34fef6-608f-42c6-af7b-bb09d34b5edb None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:22.466148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34fef6-608f-42c6-af7b-bb09d34b5edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:22.485534 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34fef6-608f-42c6-af7b-bb09d34b5edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:22.487151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34fef6-608f-42c6-af7b-bb09d34b5edb None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:22.497569 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:22.507519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-fb34fef6-608f-42c6-af7b-bb09d34b5edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:22.507519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:22.507519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:22.507519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:22.507519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:22.507519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:22.507519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:22.507519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:22.507519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:22.507519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:22.507519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:22.507519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:22.507519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:22.507519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:22.507519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:22.508434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:22.509791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:22.509791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:22.509791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:22.509791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:22.509791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 244/467] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:22.510675 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6861a-1ce5-4678-813c-43e4c66ea0e8 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:22.511023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6861a-1ce5-4678-813c-43e4c66ea0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:22.511308 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6861a-1ce5-4678-813c-43e4c66ea0e8 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:22.516845 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 245/468] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:22.517967 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6861a-1ce5-4678-813c-43e4c66ea0e8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:22.622996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e985af-5f9d-49f0-b61a-f51fcdfb680c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:22.628557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6861a-1ce5-4678-813c-43e4c66ea0e8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:22.662316 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:22.670221 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303aec8-1b47-4d56-b47f-85fa8dddb525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:22.671237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303aec8-1b47-4d56-b47f-85fa8dddb525 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:22.671408 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303aec8-1b47-4d56-b47f-85fa8dddb525 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:22.672356 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303aec8-1b47-4d56-b47f-85fa8dddb525 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:22.672501 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43571dc2-d348-432c-8838-1b3c6638a33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:22.673071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43571dc2-d348-432c-8838-1b3c6638a33c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:22.673169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303aec8-1b47-4d56-b47f-85fa8dddb525 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:22.673362 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43571dc2-d348-432c-8838-1b3c6638a33c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:22.673769 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43571dc2-d348-432c-8838-1b3c6638a33c None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:22.674541 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43571dc2-d348-432c-8838-1b3c6638a33c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:22.674650 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303aec8-1b47-4d56-b47f-85fa8dddb525 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:22.674852 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43571dc2-d348-432c-8838-1b3c6638a33c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:22.677829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43571dc2-d348-432c-8838-1b3c6638a33c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:22.689210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 246/469] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:22.694188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02708d8-43de-4091-91b2-d86ab57ec804 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:22.694188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02708d8-43de-4091-91b2-d86ab57ec804 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:22.694188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02708d8-43de-4091-91b2-d86ab57ec804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:22.703001 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 224/470] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:04:22 2022] POST /identity/v3/users => generated 248 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:04:22.705512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c89756-ffc6-4c0c-9ad5-a31de2bf2d0f None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:22.705968 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c89756-ffc6-4c0c-9ad5-a31de2bf2d0f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:22.706455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c89756-ffc6-4c0c-9ad5-a31de2bf2d0f None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:22.708276 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 225/471] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:22.709184 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-c02708d8-43de-4091-91b2-d86ab57ec804 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:22.709327 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c89756-ffc6-4c0c-9ad5-a31de2bf2d0f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:22.710525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c02708d8-43de-4091-91b2-d86ab57ec804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:22.803919 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:22.820419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 247/472] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:22.822210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31f233-8a74-48f7-8697-4f8ff65ecfe4 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:22.823053 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31f233-8a74-48f7-8697-4f8ff65ecfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:22.823560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31f233-8a74-48f7-8697-4f8ff65ecfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:22.840905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c89756-ffc6-4c0c-9ad5-a31de2bf2d0f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:22.845525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-6d31f233-8a74-48f7-8697-4f8ff65ecfe4 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:22.846997 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6d31f233-8a74-48f7-8697-4f8ff65ecfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:22.880357 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93739c-48b0-4767-9f4d-cf4c19565d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:22.881226 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93739c-48b0-4767-9f4d-cf4c19565d6b None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:22.881432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93739c-48b0-4767-9f4d-cf4c19565d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:22.881705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93739c-48b0-4767-9f4d-cf4c19565d6b None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:22.882637 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93739c-48b0-4767-9f4d-cf4c19565d6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:22.884143 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93739c-48b0-4767-9f4d-cf4c19565d6b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:22.911328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 226/473] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:04:22 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:04:22.912273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93739c-48b0-4767-9f4d-cf4c19565d6b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:22.938496 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 248/474] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:22.961439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31f233-8a74-48f7-8697-4f8ff65ecfe4 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:22.971585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:23.082206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93739c-48b0-4767-9f4d-cf4c19565d6b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:23.101515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31f233-8a74-48f7-8697-4f8ff65ecfe4 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:23.140046 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:23.142513 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac4a01-5487-4dfa-8294-30250ea59b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:23.143605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac4a01-5487-4dfa-8294-30250ea59b4f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:23.143605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac4a01-5487-4dfa-8294-30250ea59b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:23.143751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac4a01-5487-4dfa-8294-30250ea59b4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:23.159912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac4a01-5487-4dfa-8294-30250ea59b4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:23.161391 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac4a01-5487-4dfa-8294-30250ea59b4f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:23.163236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da95927-a2fd-4b46-be57-b0184194e126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:23.164212 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da95927-a2fd-4b46-be57-b0184194e126 None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:23.164692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da95927-a2fd-4b46-be57-b0184194e126 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:23.165142 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da95927-a2fd-4b46-be57-b0184194e126 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:23.166217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da95927-a2fd-4b46-be57-b0184194e126 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:23.167813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da95927-a2fd-4b46-be57-b0184194e126 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:23.175458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.sql.core [None req-3da95927-a2fd-4b46-be57-b0184194e126 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 14:04:23.175458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 14:04:23.175458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [parameters: {'id': '25952283bf8346aba55ed3e1d5e53970', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 14:04:23.175458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80436) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 14:04:23.181243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-15ac4a01-5487-4dfa-8294-30250ea59b4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:23.181243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:23.181243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:23.181243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:23.181243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:23.181243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:23.181243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:23.181243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:23.181243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:23.181243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:23.181243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:23.181243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:23.181243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:23.181243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:23.181243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:23.182147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:23.183306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:23.183306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:23.183306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:23.183306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:23.183306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 227/475] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:23.188990 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac4a01-5487-4dfa-8294-30250ea59b4f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:23.196132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-3da95927-a2fd-4b46-be57-b0184194e126 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 14:04:23.196132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:23.196132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 14:04:23.196132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 14:04:23.196132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 14:04:23.196132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 14:04:23.196132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 14:04:23.196132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 14:04:23.196132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 14:04:23.196132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application conn.query(q) Jul 18 14:04:23.196132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 14:04:23.196132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 14:04:23.196132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 14:04:23.196132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application result.read() Jul 18 14:04:23.196132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return ref.to_dict() Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 14:04:23.197185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application next(self.gen) Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application yield resource Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application next(self.gen) Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise self.value Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application session.commit() Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 14:04:23.198180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self.session.flush() Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application compat.raise_( Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 14:04:23.199102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 14:04:23.199964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 14:04:23.199964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 14:04:23.199964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 14:04:23.199964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 14:04:23.199964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 14:04:23.199964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 14:04:23.199964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 14:04:23.199964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 14:04:23.199964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 14:04:23.199964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 14:04:23.199964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 14:04:23.199964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 14:04:23.199964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 14:04:23.199964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 14:04:23.199964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 14:04:23.199964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception Jul 18 14:04:23.200770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 14:04:23.200770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 14:04:23.200770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 14:04:23.200770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 14:04:23.200770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 14:04:23.200770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 14:04:23.200770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 14:04:23.200770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application conn.query(q) Jul 18 14:04:23.200770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 14:04:23.200770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 14:04:23.200770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 14:04:23.200770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application result.read() Jul 18 14:04:23.200770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 14:04:23.200770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 14:04:23.200770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 14:04:23.200770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 14:04:23.201556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 14:04:23.201556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 14:04:23.201556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 14:04:23.201556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 14:04:23.201556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 14:04:23.201556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 14:04:23.201556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [parameters: {'id': '25952283bf8346aba55ed3e1d5e53970', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 14:04:23.201556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 14:04:23.201556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:23.201556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:04:23.201556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:23.201556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:23.201556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:23.201556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:23.201556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:23.201556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:23.202344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:23.202344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:23.202344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:23.202344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:23.202344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:23.202344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:23.202344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 18 14:04:23.202344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 18 14:04:23.202344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:23.202344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:23.202344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 18 14:04:23.202344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 18 14:04:23.202344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 14:04:23.202344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 14:04:23.202344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 14:04:23.202344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:23.205053 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 249/476] 10.222.0.99 () {60 vars in 1131 bytes} [Mon Jul 18 14:04:22 2022] POST /identity/v3/roles => generated 144 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:23.210539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da95927-a2fd-4b46-be57-b0184194e126 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:23.290676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:23.297288 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac4a01-5487-4dfa-8294-30250ea59b4f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:23.327108 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da95927-a2fd-4b46-be57-b0184194e126 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:23.342954 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5b10b-b5ab-48bf-84af-96850f580f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:23.343624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5b10b-b5ab-48bf-84af-96850f580f08 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:23.343904 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5b10b-b5ab-48bf-84af-96850f580f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:23.344177 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5b10b-b5ab-48bf-84af-96850f580f08 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:23.345166 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5b10b-b5ab-48bf-84af-96850f580f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:23.345502 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5b10b-b5ab-48bf-84af-96850f580f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:23.348103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5b10b-b5ab-48bf-84af-96850f580f08 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:23.363894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 228/477] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:23.369430 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5b10b-b5ab-48bf-84af-96850f580f08 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:23.374969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd9922-c92a-4787-8e0c-6340796cbde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:23.376038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd9922-c92a-4787-8e0c-6340796cbde9 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:23.376544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd9922-c92a-4787-8e0c-6340796cbde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:23.377051 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd9922-c92a-4787-8e0c-6340796cbde9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:23.388302 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd9922-c92a-4787-8e0c-6340796cbde9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:23.397236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-30dd9922-c92a-4787-8e0c-6340796cbde9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:04:23.397236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:23.397236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:23.397236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:23.397236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:23.397236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:23.397236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:23.397236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:23.397236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:23.397236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:23.397236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:23.397236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:23.397236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:23.397236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:23.397236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:23.397236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:23.398210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:23.398210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:23.398210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:23.398210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:23.398210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:23.398210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:23.398210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:23.398210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:23.398210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:23.398210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:23.398210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:23.398210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:23.398210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:23.398210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:23.398210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:23.398210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:23.399121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:23.399121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:23.399121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:23.399121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:23.399121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:23.399121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:23.399121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:23.399121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:23.399121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:23.399121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:23.399121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 14:04:23.399121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:23.401829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 250/478] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:04:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:23.407307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd9922-c92a-4787-8e0c-6340796cbde9 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:23.474803 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5b10b-b5ab-48bf-84af-96850f580f08 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:23.519178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:23.539235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e8d9b-d1ef-476a-a6e5-7d1d4672a615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:23.539916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e8d9b-d1ef-476a-a6e5-7d1d4672a615 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:23.540195 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e8d9b-d1ef-476a-a6e5-7d1d4672a615 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:23.540465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e8d9b-d1ef-476a-a6e5-7d1d4672a615 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:23.541168 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e8d9b-d1ef-476a-a6e5-7d1d4672a615 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:23.542637 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e8d9b-d1ef-476a-a6e5-7d1d4672a615 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:23.579370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 229/479] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:04:23 2022] POST /identity/v3/users => generated 249 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:04:23.603761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd9922-c92a-4787-8e0c-6340796cbde9 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:23.660344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f62851-112d-4b1d-86dd-ebf67f20e75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:23.661286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f62851-112d-4b1d-86dd-ebf67f20e75b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:23.661571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f62851-112d-4b1d-86dd-ebf67f20e75b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:23.661847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f62851-112d-4b1d-86dd-ebf67f20e75b None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:23.662653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f62851-112d-4b1d-86dd-ebf67f20e75b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:23.663019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f62851-112d-4b1d-86dd-ebf67f20e75b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:23.664512 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f62851-112d-4b1d-86dd-ebf67f20e75b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:23.674544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 251/480] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:24.828610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffa39f-cf40-4d06-b3a3-250c8ef3add8 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:24.829141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffa39f-cf40-4d06-b3a3-250c8ef3add8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:24.829141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffa39f-cf40-4d06-b3a3-250c8ef3add8 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:24.830921 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 230/481] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:24.839235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b850dc-5302-4b14-8192-e2c112d32cc0 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:24.839736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b850dc-5302-4b14-8192-e2c112d32cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:24.839838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b850dc-5302-4b14-8192-e2c112d32cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:24.863557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-25b850dc-5302-4b14-8192-e2c112d32cc0 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:24.864754 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-25b850dc-5302-4b14-8192-e2c112d32cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:24.983118 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 252/482] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:25.017601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffa39f-cf40-4d06-b3a3-250c8ef3add8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:25.042784 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:25.151639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffa39f-cf40-4d06-b3a3-250c8ef3add8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:25.207135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c196c2-af26-418a-9a36-47754d61d0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:25.207949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c196c2-af26-418a-9a36-47754d61d0bb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:25.208231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c196c2-af26-418a-9a36-47754d61d0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:25.208507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c196c2-af26-418a-9a36-47754d61d0bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:25.226443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c196c2-af26-418a-9a36-47754d61d0bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:25.235074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c9c196c2-af26-418a-9a36-47754d61d0bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:25.235074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:25.235074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:25.235074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:25.235074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:25.235074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:25.235074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:25.235074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:25.235074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:25.235074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:25.235074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:25.235074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:25.235074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:25.235074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:25.235074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:25.235074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:25.236287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:25.236287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:25.236287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:25.236287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:25.236287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:25.236287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:25.236287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:25.236287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:25.236287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:25.236287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:25.236287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:25.236287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:25.236287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:25.236287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:25.236287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:25.236287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:25.237264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:25.237264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:25.237264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:25.237264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:25.237264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:25.237264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:25.237264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:25.237264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:25.237264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:25.237264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:25.237264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:25.237264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:25.246895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 231/483] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:25.247489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b850dc-5302-4b14-8192-e2c112d32cc0 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:25.302780 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:25.377582 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b850dc-5302-4b14-8192-e2c112d32cc0 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:25.413739 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8868ec-ec6d-42ab-a864-13b66be7050c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:25.414331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8868ec-ec6d-42ab-a864-13b66be7050c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:25.414652 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8868ec-ec6d-42ab-a864-13b66be7050c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:25.414929 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8868ec-ec6d-42ab-a864-13b66be7050c None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:25.415690 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8868ec-ec6d-42ab-a864-13b66be7050c None admin] RBAC: Adding query filter params (name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:25.415998 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8868ec-ec6d-42ab-a864-13b66be7050c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:25.417376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8868ec-ec6d-42ab-a864-13b66be7050c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:25.426104 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 253/484] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:25.431652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c196c2-af26-418a-9a36-47754d61d0bb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:25.484286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bd948-668c-4e96-9643-6bbdd64524b7 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:25.484598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bd948-668c-4e96-9643-6bbdd64524b7 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:25.484837 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bd948-668c-4e96-9643-6bbdd64524b7 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:25.486570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 254/485] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:04:25.494382 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e749c0-4edb-4797-b30d-01fa0085c5bc None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:25.494688 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e749c0-4edb-4797-b30d-01fa0085c5bc None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:25.494971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e749c0-4edb-4797-b30d-01fa0085c5bc None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:25.496529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 255/486] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:04:25.497566 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304f555-7bc8-4097-81d7-86127c2baa39 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:25.497846 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304f555-7bc8-4097-81d7-86127c2baa39 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:25.498122 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304f555-7bc8-4097-81d7-86127c2baa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:25.518815 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-d304f555-7bc8-4097-81d7-86127c2baa39 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:25.520222 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d304f555-7bc8-4097-81d7-86127c2baa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:25.534873 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:25.567772 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c196c2-af26-418a-9a36-47754d61d0bb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:25.607251 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 256/487] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:25.608702 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904ea67-417b-4576-9d91-0989f78aa33f None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:25.609015 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904ea67-417b-4576-9d91-0989f78aa33f None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:25.609293 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904ea67-417b-4576-9d91-0989f78aa33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:25.618913 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dba145-4c97-41be-aacb-a171b370c1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:25.619711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dba145-4c97-41be-aacb-a171b370c1ba None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:25.619992 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dba145-4c97-41be-aacb-a171b370c1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:25.620268 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dba145-4c97-41be-aacb-a171b370c1ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:25.635826 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-8904ea67-417b-4576-9d91-0989f78aa33f None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:25.637059 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8904ea67-417b-4576-9d91-0989f78aa33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:25.638874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dba145-4c97-41be-aacb-a171b370c1ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:25.640377 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dba145-4c97-41be-aacb-a171b370c1ba None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:25.661371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-87dba145-4c97-41be-aacb-a171b370c1ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:25.661371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:25.661371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:25.661371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:25.661371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:25.661371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:25.661371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:25.661371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:25.661371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:25.661371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:25.661371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:25.661371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:25.661371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:25.661371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:25.661371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:25.662277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:25.663809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:25.663809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:25.663809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:25.663809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:25.663809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 232/488] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:25.663809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dba145-4c97-41be-aacb-a171b370c1ba None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:25.667457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:25.711496 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 257/489] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:25.712775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904ea67-417b-4576-9d91-0989f78aa33f None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:25.801392 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dba145-4c97-41be-aacb-a171b370c1ba None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:25.827128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904ea67-417b-4576-9d91-0989f78aa33f None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:25.834562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:25.849889 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd958c69-4ebd-41ed-a08c-125ef8dc41c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:25.850975 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd958c69-4ebd-41ed-a08c-125ef8dc41c9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:25.851265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd958c69-4ebd-41ed-a08c-125ef8dc41c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:25.851546 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd958c69-4ebd-41ed-a08c-125ef8dc41c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:25.867826 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd958c69-4ebd-41ed-a08c-125ef8dc41c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:25.878060 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a539360-583f-4410-bca6-c367bdd9dcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:25.879369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a539360-583f-4410-bca6-c367bdd9dcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:25.879822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-fd958c69-4ebd-41ed-a08c-125ef8dc41c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:25.879822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:25.879822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:25.879822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:25.879822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:25.879822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:25.879822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:25.879822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:25.879822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:25.879822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:25.879822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:25.879822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:25.879822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:25.879822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:25.879822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:25.879822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:25.880684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:25.880684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:25.880684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:25.880684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:25.880684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:25.880684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:25.880684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:25.880684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:25.880684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:25.880684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:25.880684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:25.880684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:25.880684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:25.880684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:25.880684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:25.880684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:25.881906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:25.881906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:25.881906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:25.881906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:25.881906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:25.881906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:25.881906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:25.881906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:25.881906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:25.881906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:25.881906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:25.881906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:25.882898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a539360-583f-4410-bca6-c367bdd9dcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:25.883390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a539360-583f-4410-bca6-c367bdd9dcd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:25.884328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a539360-583f-4410-bca6-c367bdd9dcd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:25.884824 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a539360-583f-4410-bca6-c367bdd9dcd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:25.886616 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 233/490] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:25.886982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a539360-583f-4410-bca6-c367bdd9dcd2 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:25.887365 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd958c69-4ebd-41ed-a08c-125ef8dc41c9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:25.902085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 258/491] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:25.903522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a539360-583f-4410-bca6-c367bdd9dcd2 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:25.925147 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:26.006544 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd958c69-4ebd-41ed-a08c-125ef8dc41c9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:26.015799 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a539360-583f-4410-bca6-c367bdd9dcd2 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:26.042638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d506a-f753-46e8-b59b-f1822d1b2d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:26.043442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d506a-f753-46e8-b59b-f1822d1b2d00 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:26.043773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d506a-f753-46e8-b59b-f1822d1b2d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:26.044093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d506a-f753-46e8-b59b-f1822d1b2d00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:26.056286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d506a-f753-46e8-b59b-f1822d1b2d00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:26.056874 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069e921-6024-4d8d-9301-f4679c204bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:26.057757 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e921-6024-4d8d-9301-f4679c204bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:26.058233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e921-6024-4d8d-9301-f4679c204bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:26.058723 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e921-6024-4d8d-9301-f4679c204bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:26.059671 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069e921-6024-4d8d-9301-f4679c204bf5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:26.060204 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069e921-6024-4d8d-9301-f4679c204bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:26.061775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069e921-6024-4d8d-9301-f4679c204bf5 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:26.064450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-173d506a-f753-46e8-b59b-f1822d1b2d00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:26.064450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:26.064450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:26.064450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:26.064450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:26.064450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:26.064450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:26.064450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:26.064450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:26.064450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:26.064450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:26.064450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:26.064450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:26.064450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:26.064450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:26.064450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:26.065328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:26.065328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:26.065328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:26.065328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:26.065328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:26.065328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:26.065328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:26.065328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:26.065328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:26.065328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:26.065328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:26.065328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:26.065328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:26.065328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:26.065328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:26.065328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:26.066104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:26.066104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:26.066104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:26.066104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:26.066104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:26.066104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:26.066104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:26.066104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:26.066104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:26.066104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:26.066104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:26.066104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:26.067376 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 234/492] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:26.067376 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d506a-f753-46e8-b59b-f1822d1b2d00 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:26.074298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 259/493] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:26.075999 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d625c28-3ec5-48cd-8f20-986e8de2826e None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:26.076482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d625c28-3ec5-48cd-8f20-986e8de2826e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:26.076957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d625c28-3ec5-48cd-8f20-986e8de2826e None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:26.078758 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 260/494] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:26.079693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d625c28-3ec5-48cd-8f20-986e8de2826e None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:26.116039 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:26.168397 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:26.179713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d506a-f753-46e8-b59b-f1822d1b2d00 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:26.190373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d625c28-3ec5-48cd-8f20-986e8de2826e None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:26.215602 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87932740-4a09-4f1c-9dab-a6de3b0cdea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:26.216400 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87932740-4a09-4f1c-9dab-a6de3b0cdea3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:26.216671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87932740-4a09-4f1c-9dab-a6de3b0cdea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:26.216942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87932740-4a09-4f1c-9dab-a6de3b0cdea3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:26.224951 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87932740-4a09-4f1c-9dab-a6de3b0cdea3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:26.225477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bf843-9e3e-4615-83ef-01c957da523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:26.226136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bf843-9e3e-4615-83ef-01c957da523b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:26.226417 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87932740-4a09-4f1c-9dab-a6de3b0cdea3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:26.226517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bf843-9e3e-4615-83ef-01c957da523b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:26.226705 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bf843-9e3e-4615-83ef-01c957da523b None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:26.227458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bf843-9e3e-4615-83ef-01c957da523b None admin] RBAC: Adding query filter params (name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:26.227763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bf843-9e3e-4615-83ef-01c957da523b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:26.229115 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bf843-9e3e-4615-83ef-01c957da523b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:26.237558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 261/495] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:26.238358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bf843-9e3e-4615-83ef-01c957da523b None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:26.242461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-87932740-4a09-4f1c-9dab-a6de3b0cdea3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:04:26.242461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:26.242461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:26.242461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:26.242461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:26.242461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:26.242461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:26.242461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:26.242461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:26.242461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:26.242461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:26.242461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:26.242461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:26.242461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:26.242461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:26.242461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:26.243398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:26.244274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:26.244274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:26.244274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:26.244274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:26.244274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:26.244274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:26.244274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:26.244274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:26.244274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:04:26.244274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:26.244274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 235/496] 10.222.0.99 () {56 vars in 1093 bytes} [Mon Jul 18 14:04:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:26.245371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a07715-5046-4118-a56d-813d25ef93fe None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:26.245371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a07715-5046-4118-a56d-813d25ef93fe None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:26.245536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a07715-5046-4118-a56d-813d25ef93fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:26.263422 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-58a07715-5046-4118-a56d-813d25ef93fe None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:26.264606 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-58a07715-5046-4118-a56d-813d25ef93fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:26.343874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 236/497] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:26.344550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a07715-5046-4118-a56d-813d25ef93fe None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:26.355870 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bf843-9e3e-4615-83ef-01c957da523b None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:26.388246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:26.393703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310a221-25d9-4866-8291-286fbb0ae378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:26.394548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310a221-25d9-4866-8291-286fbb0ae378 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:26.395086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310a221-25d9-4866-8291-286fbb0ae378 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:26.395086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310a221-25d9-4866-8291-286fbb0ae378 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:26.405998 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310a221-25d9-4866-8291-286fbb0ae378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:26.407503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310a221-25d9-4866-8291-286fbb0ae378 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:26.409229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:26.426065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-3310a221-25d9-4866-8291-286fbb0ae378 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:26.426065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:26.426065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:26.426065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:26.426065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:26.426065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:26.426065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:26.426065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:26.426065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:26.426065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:26.426065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:26.426065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:26.426065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:26.426065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:26.426065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:26.426957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:26.427794 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:26.427794 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:26.427794 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:26.427794 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:26.427794 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 262/498] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:26.428524 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310a221-25d9-4866-8291-286fbb0ae378 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:26.456416 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a07715-5046-4118-a56d-813d25ef93fe None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:26.489329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f809513-b1f3-45c7-9e78-0192af56bbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:26.490135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f809513-b1f3-45c7-9e78-0192af56bbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:26.490442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f809513-b1f3-45c7-9e78-0192af56bbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:26.490720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f809513-b1f3-45c7-9e78-0192af56bbc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:26.501154 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f809513-b1f3-45c7-9e78-0192af56bbc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:26.502641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f809513-b1f3-45c7-9e78-0192af56bbc7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:26.520078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-6f809513-b1f3-45c7-9e78-0192af56bbc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:26.520078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:26.520078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:26.520078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:26.520078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:26.520078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:26.520078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:26.520078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:26.520078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:26.520078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:26.520078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:26.520078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:26.520078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:26.520078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:26.520078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:26.520923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:26.521745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:26.521745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:26.521745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:26.521745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:26.521745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 237/499] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:26.522534 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bd79d-1b64-432f-be77-60f115f14bbb None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:26.522710 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bd79d-1b64-432f-be77-60f115f14bbb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:26.523001 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bd79d-1b64-432f-be77-60f115f14bbb None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:26.524380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 238/500] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:26.524903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bd79d-1b64-432f-be77-60f115f14bbb None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:26.532972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310a221-25d9-4866-8291-286fbb0ae378 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:26.571901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e7f99-37a0-4861-aca4-a3f90dcef86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:26.572597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e7f99-37a0-4861-aca4-a3f90dcef86f None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:26.572876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e7f99-37a0-4861-aca4-a3f90dcef86f None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:26.573151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e7f99-37a0-4861-aca4-a3f90dcef86f None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:26.574309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e7f99-37a0-4861-aca4-a3f90dcef86f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:26.574715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e7f99-37a0-4861-aca4-a3f90dcef86f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:26.576785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e7f99-37a0-4861-aca4-a3f90dcef86f None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:26.617289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 263/501] 10.222.0.99 () {56 vars in 1133 bytes} [Mon Jul 18 14:04:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:26.618190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e7f99-37a0-4861-aca4-a3f90dcef86f None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:26.627362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:26.644717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bd79d-1b64-432f-be77-60f115f14bbb None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:26.672118 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:26.679671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc4bd6-356c-4975-8021-3b34e18a38e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:26.680471 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4bd6-356c-4975-8021-3b34e18a38e6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:26.680757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4bd6-356c-4975-8021-3b34e18a38e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:26.681027 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4bd6-356c-4975-8021-3b34e18a38e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:26.692522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc4bd6-356c-4975-8021-3b34e18a38e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:26.700771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-6abc4bd6-356c-4975-8021-3b34e18a38e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:26.700771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:26.700771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:26.700771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:26.700771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:26.700771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:26.700771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:26.700771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:26.700771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:26.700771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:26.700771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:26.700771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:26.700771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:26.700771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:26.700771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:26.700771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:26.701899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:26.701899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:26.701899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:26.701899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:26.701899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:26.701899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:26.701899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:26.701899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:26.701899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:26.701899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:26.701899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:26.701899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:26.701899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:26.701899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:26.701899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:26.701899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:26.702937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:26.702937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:26.702937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:26.702937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:26.702937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:26.702937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:26.702937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:26.702937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:26.702937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:26.702937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:26.702937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:26.702937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:26.704277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 239/502] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:26.704905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc4bd6-356c-4975-8021-3b34e18a38e6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:26.734225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e7f99-37a0-4861-aca4-a3f90dcef86f None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:26.781326 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51c9ff-2c01-4014-bc3c-1ee0d09d81c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:26.781999 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51c9ff-2c01-4014-bc3c-1ee0d09d81c9 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:26.782284 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51c9ff-2c01-4014-bc3c-1ee0d09d81c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:26.782595 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51c9ff-2c01-4014-bc3c-1ee0d09d81c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:26.783414 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51c9ff-2c01-4014-bc3c-1ee0d09d81c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:26.783723 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51c9ff-2c01-4014-bc3c-1ee0d09d81c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:26.785694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51c9ff-2c01-4014-bc3c-1ee0d09d81c9 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:26.798890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 264/503] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:26.800186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64071345-74e2-479a-b95f-e3ae6734ee8d None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:26.800474 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64071345-74e2-479a-b95f-e3ae6734ee8d None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:26.800753 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64071345-74e2-479a-b95f-e3ae6734ee8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:26.817052 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-64071345-74e2-479a-b95f-e3ae6734ee8d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:26.818250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-64071345-74e2-479a-b95f-e3ae6734ee8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:26.833978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc4bd6-356c-4975-8021-3b34e18a38e6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:26.870530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37f060-b5b0-4b0a-ac4f-7aa79a5d2ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:26.871174 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37f060-b5b0-4b0a-ac4f-7aa79a5d2ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:26.871454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37f060-b5b0-4b0a-ac4f-7aa79a5d2ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:26.871731 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37f060-b5b0-4b0a-ac4f-7aa79a5d2ac9 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:26.872479 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37f060-b5b0-4b0a-ac4f-7aa79a5d2ac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:26.872775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37f060-b5b0-4b0a-ac4f-7aa79a5d2ac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:26.874159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37f060-b5b0-4b0a-ac4f-7aa79a5d2ac9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:26.886542 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 240/504] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:26.886674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 265/505] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:26.891346 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37f060-b5b0-4b0a-ac4f-7aa79a5d2ac9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:26.891487 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64071345-74e2-479a-b95f-e3ae6734ee8d None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:26.912802 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:26.933229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:27.000316 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64071345-74e2-479a-b95f-e3ae6734ee8d None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:27.014135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37f060-b5b0-4b0a-ac4f-7aa79a5d2ac9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:27.036387 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c8868-e8a1-4bc7-bee8-0cf5eff75c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:27.037057 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c8868-e8a1-4bc7-bee8-0cf5eff75c59 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:27.037369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c8868-e8a1-4bc7-bee8-0cf5eff75c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:27.037644 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c8868-e8a1-4bc7-bee8-0cf5eff75c59 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:27.038410 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c8868-e8a1-4bc7-bee8-0cf5eff75c59 None admin] RBAC: Adding query filter params (name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:27.038735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c8868-e8a1-4bc7-bee8-0cf5eff75c59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:27.040132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c8868-e8a1-4bc7-bee8-0cf5eff75c59 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:27.048715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 266/506] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:27.049531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c8868-e8a1-4bc7-bee8-0cf5eff75c59 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:27.051136 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b042035-6495-4dae-9774-241d3bd46e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:27.051794 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b042035-6495-4dae-9774-241d3bd46e84 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:27.052187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b042035-6495-4dae-9774-241d3bd46e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:27.052463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b042035-6495-4dae-9774-241d3bd46e84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:27.123712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b042035-6495-4dae-9774-241d3bd46e84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:27.126287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b042035-6495-4dae-9774-241d3bd46e84 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:27.137200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:27.159399 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c8868-e8a1-4bc7-bee8-0cf5eff75c59 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:27.161926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:27.193520 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599eebc-74f0-4fda-a30a-933c5c611d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:27.194314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599eebc-74f0-4fda-a30a-933c5c611d5c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:27.194623 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599eebc-74f0-4fda-a30a-933c5c611d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:27.194897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599eebc-74f0-4fda-a30a-933c5c611d5c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:27.202126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599eebc-74f0-4fda-a30a-933c5c611d5c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:27.203608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599eebc-74f0-4fda-a30a-933c5c611d5c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:27.220016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-e599eebc-74f0-4fda-a30a-933c5c611d5c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 14:04:27.220016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:27.220016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:27.220016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:27.220016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:27.220016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:27.220016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:27.220016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:27.220016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:27.220016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:27.220016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:27.220016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:27.220016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:27.220016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:27.220016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:27.220016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:27.220976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:27.221861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:27.221861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:27.221861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:27.221861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:27.221861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:27.221861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:27.221861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:27.221861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:27.221861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 14:04:27.221861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:27.221861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 267/507] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:27.222432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599eebc-74f0-4fda-a30a-933c5c611d5c None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:27.237089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 241/508] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:27.238325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b042035-6495-4dae-9774-241d3bd46e84 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:27.325369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599eebc-74f0-4fda-a30a-933c5c611d5c None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:27.339228 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b042035-6495-4dae-9774-241d3bd46e84 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:27.346874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:27.359266 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf78413-a184-475a-83e4-43d3038727a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:27.360068 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf78413-a184-475a-83e4-43d3038727a4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:27.360352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf78413-a184-475a-83e4-43d3038727a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:27.360627 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf78413-a184-475a-83e4-43d3038727a4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:27.368338 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf78413-a184-475a-83e4-43d3038727a4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:27.369790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf78413-a184-475a-83e4-43d3038727a4 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:27.374338 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726700f5-6dc9-44d6-bd91-66ff51f9e475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:27.375468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726700f5-6dc9-44d6-bd91-66ff51f9e475 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:27.375751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726700f5-6dc9-44d6-bd91-66ff51f9e475 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:27.376025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726700f5-6dc9-44d6-bd91-66ff51f9e475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:27.384233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-7bf78413-a184-475a-83e4-43d3038727a4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 14:04:27.384233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:27.384233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:27.384233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:27.384233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:27.384233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:27.384233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:27.384233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:27.384233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:27.384233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:27.384233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:27.384233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:27.384233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:27.384233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:27.384233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:27.384233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:27.385131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:27.386027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:27.386027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:27.386027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:27.386027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:27.386027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:27.386027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:27.386027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:27.386027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:27.386027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 14:04:27.386027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:27.386027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 268/509] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:27.386615 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf78413-a184-475a-83e4-43d3038727a4 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:27.390830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726700f5-6dc9-44d6-bd91-66ff51f9e475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:27.392347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726700f5-6dc9-44d6-bd91-66ff51f9e475 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:27.409644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-726700f5-6dc9-44d6-bd91-66ff51f9e475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:27.409644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:27.409644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:27.409644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:27.409644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:27.409644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:27.409644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:27.409644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:27.409644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:27.409644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:27.409644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:27.409644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:27.409644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:27.409644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:27.409644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:27.410660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:27.411511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:27.411511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:27.411511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:27.411511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:27.411511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 242/510] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:27.411932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726700f5-6dc9-44d6-bd91-66ff51f9e475 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:27.415048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:27.487902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf78413-a184-475a-83e4-43d3038727a4 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:27.511141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726700f5-6dc9-44d6-bd91-66ff51f9e475 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:27.521330 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb3d42-0996-4696-b534-bf58cac7b09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:27.522122 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb3d42-0996-4696-b534-bf58cac7b09b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:27.522373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb3d42-0996-4696-b534-bf58cac7b09b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:27.522707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb3d42-0996-4696-b534-bf58cac7b09b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:27.533560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb3d42-0996-4696-b534-bf58cac7b09b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:27.535034 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb3d42-0996-4696-b534-bf58cac7b09b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:27.546252 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaeaa10-cbad-4f19-b329-f177bed03988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:27.546946 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaeaa10-cbad-4f19-b329-f177bed03988 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:27.547231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaeaa10-cbad-4f19-b329-f177bed03988 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:27.547508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaeaa10-cbad-4f19-b329-f177bed03988 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:27.548353 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaeaa10-cbad-4f19-b329-f177bed03988 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:27.548696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaeaa10-cbad-4f19-b329-f177bed03988 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:27.550150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaeaa10-cbad-4f19-b329-f177bed03988 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:27.552024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-ddbb3d42-0996-4696-b534-bf58cac7b09b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:27.552024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:27.552024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:27.552024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:27.552024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:27.552024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:27.552024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:27.552024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:27.552024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:27.552024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:27.552024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:27.552024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:27.552024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:27.552024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:27.552024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:27.552995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:27.553903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:27.553903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:27.553903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:27.553903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:27.553903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 269/511] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:27.554277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb3d42-0996-4696-b534-bf58cac7b09b None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:27.587444 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 243/512] 10.222.0.99 () {56 vars in 1137 bytes} [Mon Jul 18 14:04:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:27.588198 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaeaa10-cbad-4f19-b329-f177bed03988 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:27.606271 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:27.637641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:27.664960 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb3d42-0996-4696-b534-bf58cac7b09b None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:27.696266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaeaa10-cbad-4f19-b329-f177bed03988 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:27.698433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799761b-9fde-4288-b604-b6f103891cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:27.699250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799761b-9fde-4288-b604-b6f103891cca None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:27.699530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799761b-9fde-4288-b604-b6f103891cca None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:27.699803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799761b-9fde-4288-b604-b6f103891cca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:27.710634 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799761b-9fde-4288-b604-b6f103891cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:27.712104 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799761b-9fde-4288-b604-b6f103891cca None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:27.728790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-a799761b-9fde-4288-b604-b6f103891cca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:27.728790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:27.728790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:27.728790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:27.728790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:27.728790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:27.728790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:27.728790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:27.728790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:27.728790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:27.728790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:27.728790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:27.728790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:27.728790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:27.728790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:27.729632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:27.730515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:27.730515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:27.730515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:27.730515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:27.730515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 270/513] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:27.730791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799761b-9fde-4288-b604-b6f103891cca None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:27.735201 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c6843-86d6-4f07-8285-c41ef224b85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:27.735917 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c6843-86d6-4f07-8285-c41ef224b85c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:27.736258 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c6843-86d6-4f07-8285-c41ef224b85c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:27.736533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c6843-86d6-4f07-8285-c41ef224b85c None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:27.737385 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c6843-86d6-4f07-8285-c41ef224b85c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:27.737695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c6843-86d6-4f07-8285-c41ef224b85c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:27.739193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c6843-86d6-4f07-8285-c41ef224b85c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:27.757091 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 244/514] 10.222.0.99 () {56 vars in 1137 bytes} [Mon Jul 18 14:04:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:27.757910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c6843-86d6-4f07-8285-c41ef224b85c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:27.829567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799761b-9fde-4288-b604-b6f103891cca None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:27.835170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:27.855415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:27.861357 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c6843-86d6-4f07-8285-c41ef224b85c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:27.865098 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d5191-69f8-406c-92f1-cd58e4cbeb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:27.865779 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d5191-69f8-406c-92f1-cd58e4cbeb0b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:27.866061 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d5191-69f8-406c-92f1-cd58e4cbeb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:27.866332 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d5191-69f8-406c-92f1-cd58e4cbeb0b None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:27.867100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d5191-69f8-406c-92f1-cd58e4cbeb0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:27.867407 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d5191-69f8-406c-92f1-cd58e4cbeb0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:27.868797 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d5191-69f8-406c-92f1-cd58e4cbeb0b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:27.880509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 271/515] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:27.881302 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d5191-69f8-406c-92f1-cd58e4cbeb0b None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:27.903941 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e826b79-5f08-42c5-8d2c-9811396d5a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:27.904598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e826b79-5f08-42c5-8d2c-9811396d5a67 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:27.904886 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e826b79-5f08-42c5-8d2c-9811396d5a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:27.905158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e826b79-5f08-42c5-8d2c-9811396d5a67 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:27.905886 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e826b79-5f08-42c5-8d2c-9811396d5a67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:27.906189 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e826b79-5f08-42c5-8d2c-9811396d5a67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:27.907603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e826b79-5f08-42c5-8d2c-9811396d5a67 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:27.919497 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 245/516] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:27.920291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e826b79-5f08-42c5-8d2c-9811396d5a67 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:27.985472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d5191-69f8-406c-92f1-cd58e4cbeb0b None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:28.020380 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbecac-0a8f-4f1a-98a4-8363cfdd9681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:28.021023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbecac-0a8f-4f1a-98a4-8363cfdd9681 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:28.021301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbecac-0a8f-4f1a-98a4-8363cfdd9681 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:28.021567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbecac-0a8f-4f1a-98a4-8363cfdd9681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:28.029102 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e826b79-5f08-42c5-8d2c-9811396d5a67 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:28.063524 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e55ca9-7855-4089-85a6-14bbb2787b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:28.064209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e55ca9-7855-4089-85a6-14bbb2787b28 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:28.064667 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e55ca9-7855-4089-85a6-14bbb2787b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:28.064774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e55ca9-7855-4089-85a6-14bbb2787b28 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:28.065469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e55ca9-7855-4089-85a6-14bbb2787b28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:28.065771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e55ca9-7855-4089-85a6-14bbb2787b28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:28.067197 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e55ca9-7855-4089-85a6-14bbb2787b28 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:28.068691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:28.079566 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:28.079720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 246/517] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:28.080499 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e55ca9-7855-4089-85a6-14bbb2787b28 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:28.096790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbecac-0a8f-4f1a-98a4-8363cfdd9681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:28.098348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbecac-0a8f-4f1a-98a4-8363cfdd9681 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:28.182246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e55ca9-7855-4089-85a6-14bbb2787b28 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:28.198472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 272/518] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:28.200320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbecac-0a8f-4f1a-98a4-8363cfdd9681 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:28.216833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6975a-fe4b-4b19-a821-51a3de8f404c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:28.217496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6975a-fe4b-4b19-a821-51a3de8f404c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:28.217766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6975a-fe4b-4b19-a821-51a3de8f404c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:28.218039 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6975a-fe4b-4b19-a821-51a3de8f404c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:28.284588 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:28.294012 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6975a-fe4b-4b19-a821-51a3de8f404c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:28.295542 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6975a-fe4b-4b19-a821-51a3de8f404c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:28.299958 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:28.313049 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbecac-0a8f-4f1a-98a4-8363cfdd9681 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:28.346329 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136800d0-3fad-49c7-89a1-6cffc27a742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:28.347025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136800d0-3fad-49c7-89a1-6cffc27a742a None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:28.347302 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136800d0-3fad-49c7-89a1-6cffc27a742a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:28.347579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136800d0-3fad-49c7-89a1-6cffc27a742a None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:28.348281 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136800d0-3fad-49c7-89a1-6cffc27a742a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:28.349716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136800d0-3fad-49c7-89a1-6cffc27a742a None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:28.369724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 273/519] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:04:28 2022] POST /identity/v3/users => generated 247 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:04:28.370981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136800d0-3fad-49c7-89a1-6cffc27a742a None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:28.400799 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 247/520] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:28.402091 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6975a-fe4b-4b19-a821-51a3de8f404c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:28.507820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136800d0-3fad-49c7-89a1-6cffc27a742a None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:28.510053 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:28.522849 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6975a-fe4b-4b19-a821-51a3de8f404c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:28.548986 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fff771-c294-4737-b0cc-be434e7210c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:28.550060 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fff771-c294-4737-b0cc-be434e7210c2 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:28.550358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fff771-c294-4737-b0cc-be434e7210c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:28.550802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fff771-c294-4737-b0cc-be434e7210c2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:28.559732 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fff771-c294-4737-b0cc-be434e7210c2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:28.561321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fff771-c294-4737-b0cc-be434e7210c2 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:28.562133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad08c9-1f79-4148-bdf6-88f6a5420294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:28.563654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad08c9-1f79-4148-bdf6-88f6a5420294 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:28.563654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad08c9-1f79-4148-bdf6-88f6a5420294 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:28.563654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad08c9-1f79-4148-bdf6-88f6a5420294 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:28.571103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad08c9-1f79-4148-bdf6-88f6a5420294 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:28.572579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad08c9-1f79-4148-bdf6-88f6a5420294 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:28.582724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-14fff771-c294-4737-b0cc-be434e7210c2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 14:04:28.582724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:28.582724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:28.582724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:28.582724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:28.582724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:28.582724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:28.582724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:28.582724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:28.582724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:28.582724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:28.582724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:28.582724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:28.582724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:28.582724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:28.582724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:28.583655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:28.584528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:28.584528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:28.584528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:28.584528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:28.584528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:28.584528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:28.584528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:28.584528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:28.584528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 14:04:28.584528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:28.584528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 274/521] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:28.585082 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fff771-c294-4737-b0cc-be434e7210c2 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:28.587960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b6ad08c9-1f79-4148-bdf6-88f6a5420294 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:28.587960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:28.587960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:28.587960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:28.587960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:28.587960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:28.587960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:28.587960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:28.587960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:28.587960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:28.587960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:28.587960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:28.587960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:28.587960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:28.587960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:28.588797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:28.589666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:28.589666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:28.589666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:28.589666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:28.589666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:28.589666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:28.589666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:28.589666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:28.589666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 248/522] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:28.590677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad08c9-1f79-4148-bdf6-88f6a5420294 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:28.591588 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:28.696581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fff771-c294-4737-b0cc-be434e7210c2 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:28.697248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad08c9-1f79-4148-bdf6-88f6a5420294 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:28.731995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4452e-5409-4c72-a525-84a678cd442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:28.733173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c3007-9d1a-495c-8023-33fe64e848cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:28.733452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4452e-5409-4c72-a525-84a678cd442a None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:28.733924 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4452e-5409-4c72-a525-84a678cd442a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:28.734026 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c3007-9d1a-495c-8023-33fe64e848cb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:28.734240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c3007-9d1a-495c-8023-33fe64e848cb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:28.734572 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c3007-9d1a-495c-8023-33fe64e848cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:28.734940 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4452e-5409-4c72-a525-84a678cd442a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:28.745492 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c3007-9d1a-495c-8023-33fe64e848cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:28.747007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c3007-9d1a-495c-8023-33fe64e848cb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:28.747941 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4452e-5409-4c72-a525-84a678cd442a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:28.750133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4452e-5409-4c72-a525-84a678cd442a None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:28.764535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-196c3007-9d1a-495c-8023-33fe64e848cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:28.764535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:28.764535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:28.764535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:28.764535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:28.764535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:28.764535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:28.764535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:28.764535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:28.764535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:28.764535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:28.764535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:28.764535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:28.764535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:28.764535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:28.765467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:28.766487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:28.766487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:28.766487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:28.766487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:28.766487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 249/523] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:28.766744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c3007-9d1a-495c-8023-33fe64e848cb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:28.772030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-1cd4452e-5409-4c72-a525-84a678cd442a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:28.772030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:28.772030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:28.772030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:28.772030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:28.772030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:28.772030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:28.772030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:28.772030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:28.772030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:28.772030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:28.772030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:28.772030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:28.772030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:28.772030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:28.772935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:28.773767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:28.773767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:28.773767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:28.773767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:28.775809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:28.776619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 275/524] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:28.777615 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4452e-5409-4c72-a525-84a678cd442a None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:28.836212 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:28.876237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c3007-9d1a-495c-8023-33fe64e848cb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:28.882862 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4452e-5409-4c72-a525-84a678cd442a None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:28.915388 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c354a1b-d1a4-464f-bd09-17170885a749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:28.916057 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c354a1b-d1a4-464f-bd09-17170885a749 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:28.916337 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c354a1b-d1a4-464f-bd09-17170885a749 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:28.916612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c354a1b-d1a4-464f-bd09-17170885a749 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:28.916768 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c674b3-c998-4a4d-80e2-8e1100f663c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:28.917398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c674b3-c998-4a4d-80e2-8e1100f663c6 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:28.917492 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c354a1b-d1a4-464f-bd09-17170885a749 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:28.917682 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c674b3-c998-4a4d-80e2-8e1100f663c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:28.917776 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c354a1b-d1a4-464f-bd09-17170885a749 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:28.917960 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c674b3-c998-4a4d-80e2-8e1100f663c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:28.918792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c674b3-c998-4a4d-80e2-8e1100f663c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:28.919111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c674b3-c998-4a4d-80e2-8e1100f663c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:28.919320 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c354a1b-d1a4-464f-bd09-17170885a749 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:28.920532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c674b3-c998-4a4d-80e2-8e1100f663c6 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:28.944168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 276/525] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:28.944405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 250/526] 10.222.0.99 () {56 vars in 1139 bytes} [Mon Jul 18 14:04:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:28.944405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c354a1b-d1a4-464f-bd09-17170885a749 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:28.944578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c674b3-c998-4a4d-80e2-8e1100f663c6 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:29.015608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:29.054589 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c674b3-c998-4a4d-80e2-8e1100f663c6 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:29.057284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c354a1b-d1a4-464f-bd09-17170885a749 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:29.072106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:29.092525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2a963-3764-48ad-b19a-f79ad6583d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:29.093200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2a963-3764-48ad-b19a-f79ad6583d7a None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:29.093486 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2a963-3764-48ad-b19a-f79ad6583d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:29.093758 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2a963-3764-48ad-b19a-f79ad6583d7a None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:29.094520 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2a963-3764-48ad-b19a-f79ad6583d7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:29.094698 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da72db-cd6d-4ae3-81f5-2138029cf563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:29.094809 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2a963-3764-48ad-b19a-f79ad6583d7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:29.095690 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da72db-cd6d-4ae3-81f5-2138029cf563 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:29.096166 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da72db-cd6d-4ae3-81f5-2138029cf563 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:29.096267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2a963-3764-48ad-b19a-f79ad6583d7a None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:29.096785 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da72db-cd6d-4ae3-81f5-2138029cf563 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:29.097692 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da72db-cd6d-4ae3-81f5-2138029cf563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:29.098170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da72db-cd6d-4ae3-81f5-2138029cf563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:29.099743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da72db-cd6d-4ae3-81f5-2138029cf563 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:29.108663 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 277/527] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:29.109552 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2a963-3764-48ad-b19a-f79ad6583d7a None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:29.121509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 251/528] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:29.121509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da72db-cd6d-4ae3-81f5-2138029cf563 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:29.221268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2a963-3764-48ad-b19a-f79ad6583d7a None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:29.233851 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da72db-cd6d-4ae3-81f5-2138029cf563 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:29.255087 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef743f-090b-44e2-9937-ed7a2025e791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:29.255749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef743f-090b-44e2-9937-ed7a2025e791 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:29.256032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef743f-090b-44e2-9937-ed7a2025e791 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:29.256315 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef743f-090b-44e2-9937-ed7a2025e791 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:29.259646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:29.271893 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f6f62-8ef6-4ad4-ba14-f3045e950097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:29.272480 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f6f62-8ef6-4ad4-ba14-f3045e950097 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:29.272766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f6f62-8ef6-4ad4-ba14-f3045e950097 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:29.273043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f6f62-8ef6-4ad4-ba14-f3045e950097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:29.273894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f6f62-8ef6-4ad4-ba14-f3045e950097 None admin] RBAC: Adding query filter params (role.id=ea9f1b43d91c4665ba5af180f55c663c, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=b1b66b55e0374152828913910c4002f4) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:29.274207 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f6f62-8ef6-4ad4-ba14-f3045e950097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:29.275704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f6f62-8ef6-4ad4-ba14-f3045e950097 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:29.281198 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 252/529] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:04:29 2022] GET /identity/v3/role_assignments?user.id=b1b66b55e0374152828913910c4002f4&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=ea9f1b43d91c4665ba5af180f55c663c => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:29.281967 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f6f62-8ef6-4ad4-ba14-f3045e950097 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:29.329712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:29.367318 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef743f-090b-44e2-9937-ed7a2025e791 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:29.370270 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef743f-090b-44e2-9937-ed7a2025e791 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:29.412258 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f6f62-8ef6-4ad4-ba14-f3045e950097 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:29.463189 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690f8a0-7cfd-40d8-ad8f-bad80c4bb9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:29.464240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690f8a0-7cfd-40d8-ad8f-bad80c4bb9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:29.464526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690f8a0-7cfd-40d8-ad8f-bad80c4bb9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:29.464800 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690f8a0-7cfd-40d8-ad8f-bad80c4bb9d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:29.472104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690f8a0-7cfd-40d8-ad8f-bad80c4bb9d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:29.473595 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690f8a0-7cfd-40d8-ad8f-bad80c4bb9d2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:29.486241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 278/530] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:29.487217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef743f-090b-44e2-9937-ed7a2025e791 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:29.488775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-7690f8a0-7cfd-40d8-ad8f-bad80c4bb9d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:29.488775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:29.488775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:29.488775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:29.488775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:29.488775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:29.488775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:29.488775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:29.488775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:29.488775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:29.488775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:29.488775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:29.488775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:29.488775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:29.488775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:29.489610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:29.490473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:29.490473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:29.490473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:29.490473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:29.490473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:29.490473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:29.490473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:29.490473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:29.494872 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 253/531] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:29.495759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690f8a0-7cfd-40d8-ad8f-bad80c4bb9d2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:29.573611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:29.578739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:29.598366 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef743f-090b-44e2-9937-ed7a2025e791 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:29.603754 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690f8a0-7cfd-40d8-ad8f-bad80c4bb9d2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:29.632593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55e047-d65b-4b10-9056-e9477f81a790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:29.633248 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55e047-d65b-4b10-9056-e9477f81a790 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:29.633531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55e047-d65b-4b10-9056-e9477f81a790 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:29.633807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55e047-d65b-4b10-9056-e9477f81a790 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:29.640895 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55e047-d65b-4b10-9056-e9477f81a790 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:29.641581 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad21e0-dc7d-49ba-9b05-57bad1033e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:29.642448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55e047-d65b-4b10-9056-e9477f81a790 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:29.642939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad21e0-dc7d-49ba-9b05-57bad1033e4b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:29.643413 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad21e0-dc7d-49ba-9b05-57bad1033e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:29.643886 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad21e0-dc7d-49ba-9b05-57bad1033e4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:29.657668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad21e0-dc7d-49ba-9b05-57bad1033e4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:29.659602 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad21e0-dc7d-49ba-9b05-57bad1033e4b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:29.660485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-1d55e047-d65b-4b10-9056-e9477f81a790 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:29.660485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:29.660485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:29.660485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:29.660485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:29.660485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:29.660485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:29.660485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:29.660485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:29.660485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:29.660485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:29.660485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:29.660485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:29.660485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:29.660485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:29.661298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:29.662157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:29.662157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:29.662157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:29.662157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:29.662157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:29.662157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:29.662157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:29.662157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:29.662611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 279/532] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:29.663102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55e047-d65b-4b10-9056-e9477f81a790 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:29.681490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-96ad21e0-dc7d-49ba-9b05-57bad1033e4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:29.681490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:29.681490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:29.681490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:29.681490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:29.681490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:29.681490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:29.681490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:29.681490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:29.681490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:29.681490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:29.681490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:29.681490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:29.681490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:29.681490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:29.682439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:29.683290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:29.683290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:29.683290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:29.683290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:29.685580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 254/533] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:29.686655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad21e0-dc7d-49ba-9b05-57bad1033e4b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:29.774998 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55e047-d65b-4b10-9056-e9477f81a790 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:29.788918 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:29.792143 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad21e0-dc7d-49ba-9b05-57bad1033e4b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:29.812234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a5eee-2eba-49f2-9653-28c5161fad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:29.812900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a5eee-2eba-49f2-9653-28c5161fad27 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:29.813185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a5eee-2eba-49f2-9653-28c5161fad27 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:29.813461 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a5eee-2eba-49f2-9653-28c5161fad27 None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:29.814320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a5eee-2eba-49f2-9653-28c5161fad27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:29.814830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a5eee-2eba-49f2-9653-28c5161fad27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:29.816267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a5eee-2eba-49f2-9653-28c5161fad27 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:29.819141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:29.829898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 280/534] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:29.831059 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a5eee-2eba-49f2-9653-28c5161fad27 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:29.833014 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c266d09-0263-495b-bb28-bce24e0c5b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:29.834019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c266d09-0263-495b-bb28-bce24e0c5b9f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:29.834632 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c266d09-0263-495b-bb28-bce24e0c5b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:29.835104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c266d09-0263-495b-bb28-bce24e0c5b9f None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:29.836095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c266d09-0263-495b-bb28-bce24e0c5b9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:29.836612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c266d09-0263-495b-bb28-bce24e0c5b9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:29.838279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c266d09-0263-495b-bb28-bce24e0c5b9f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:29.858162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 255/535] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:29.859497 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c266d09-0263-495b-bb28-bce24e0c5b9f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:29.936255 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a5eee-2eba-49f2-9653-28c5161fad27 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:29.966649 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c266d09-0263-495b-bb28-bce24e0c5b9f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:29.971920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec1ccc-ab59-4483-933f-93f1cb4bfb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:29.972597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec1ccc-ab59-4483-933f-93f1cb4bfb01 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:29.972882 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec1ccc-ab59-4483-933f-93f1cb4bfb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:29.973162 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec1ccc-ab59-4483-933f-93f1cb4bfb01 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:29.973898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec1ccc-ab59-4483-933f-93f1cb4bfb01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:29.974208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec1ccc-ab59-4483-933f-93f1cb4bfb01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:29.975628 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec1ccc-ab59-4483-933f-93f1cb4bfb01 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:29.993172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 281/536] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:29.994210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec1ccc-ab59-4483-933f-93f1cb4bfb01 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:30.005898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f62b4-ae0b-4705-b455-2079b31167fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:30.007033 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f62b4-ae0b-4705-b455-2079b31167fe None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:30.007511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f62b4-ae0b-4705-b455-2079b31167fe None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:30.007981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f62b4-ae0b-4705-b455-2079b31167fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:30.009120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f62b4-ae0b-4705-b455-2079b31167fe None admin] RBAC: Adding query filter params (role.id=ea9f1b43d91c4665ba5af180f55c663c, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=19eb97598f774389ad927867a7023fc8) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:30.009727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f62b4-ae0b-4705-b455-2079b31167fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:30.011522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f62b4-ae0b-4705-b455-2079b31167fe None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:30.018370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 256/537] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:04:29 2022] GET /identity/v3/role_assignments?user.id=19eb97598f774389ad927867a7023fc8&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=ea9f1b43d91c4665ba5af180f55c663c => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:30.019507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f62b4-ae0b-4705-b455-2079b31167fe None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:30.048596 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:30.061970 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:30.117897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec1ccc-ab59-4483-933f-93f1cb4bfb01 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:30.140399 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f62b4-ae0b-4705-b455-2079b31167fe None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:30.174318 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e814f4-d88b-4465-8e61-fb1416afd5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:30.175291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e814f4-d88b-4465-8e61-fb1416afd5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:30.175793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e814f4-d88b-4465-8e61-fb1416afd5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:30.176209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e814f4-d88b-4465-8e61-fb1416afd5e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:30.177292 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e814f4-d88b-4465-8e61-fb1416afd5e6 None admin] RBAC: Adding query filter params (role.id=ea9f1b43d91c4665ba5af180f55c663c, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=927543219de847b88b97fbe4f343d2be) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:30.177767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e814f4-d88b-4465-8e61-fb1416afd5e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:30.179585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e814f4-d88b-4465-8e61-fb1416afd5e6 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:30.181840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4289200-9b42-4427-8ee3-01f8f6ed6687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:30.190421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4289200-9b42-4427-8ee3-01f8f6ed6687 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:30.190421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4289200-9b42-4427-8ee3-01f8f6ed6687 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:30.190421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4289200-9b42-4427-8ee3-01f8f6ed6687 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:30.196106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 282/538] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:04:29 2022] GET /identity/v3/role_assignments?user.id=927543219de847b88b97fbe4f343d2be&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=ea9f1b43d91c4665ba5af180f55c663c => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:30.202156 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4289200-9b42-4427-8ee3-01f8f6ed6687 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:30.203742 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4289200-9b42-4427-8ee3-01f8f6ed6687 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:30.219719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c4289200-9b42-4427-8ee3-01f8f6ed6687 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:30.219719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:30.219719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:30.219719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:30.219719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:30.219719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:30.219719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:30.219719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:30.219719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:30.219719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:30.219719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:30.219719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:30.219719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:30.219719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:30.219719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:30.220716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:30.221568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:30.221568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:30.221568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:30.221568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:30.221568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:30.221568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:30.221568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:30.221568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:30.221568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 257/539] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:30.228532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e814f4-d88b-4465-8e61-fb1416afd5e6 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:30.349637 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e814f4-d88b-4465-8e61-fb1416afd5e6 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:30.373042 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:30.391529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc548715-ef59-465a-9974-2d51269ed0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:30.392230 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc548715-ef59-465a-9974-2d51269ed0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:30.392514 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc548715-ef59-465a-9974-2d51269ed0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:30.392792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc548715-ef59-465a-9974-2d51269ed0d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:30.393598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc548715-ef59-465a-9974-2d51269ed0d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:30.393908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc548715-ef59-465a-9974-2d51269ed0d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:30.395397 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc548715-ef59-465a-9974-2d51269ed0d8 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:30.408615 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 283/540] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:30.414506 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4289200-9b42-4427-8ee3-01f8f6ed6687 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:30.503478 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:30.519532 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4289200-9b42-4427-8ee3-01f8f6ed6687 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:30.554991 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507058b-26d3-4d62-bf67-4fc4e954d92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:30.555649 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507058b-26d3-4d62-bf67-4fc4e954d92e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:30.555931 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507058b-26d3-4d62-bf67-4fc4e954d92e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:30.556208 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507058b-26d3-4d62-bf67-4fc4e954d92e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:30.557051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507058b-26d3-4d62-bf67-4fc4e954d92e None admin] RBAC: Adding query filter params (role.id=ea9f1b43d91c4665ba5af180f55c663c, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=abc51e98d0054609b6ce10723f70bf49) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:30.557364 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507058b-26d3-4d62-bf67-4fc4e954d92e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:30.558850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507058b-26d3-4d62-bf67-4fc4e954d92e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:30.565058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 258/541] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:04:30 2022] GET /identity/v3/role_assignments?user.id=abc51e98d0054609b6ce10723f70bf49&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=ea9f1b43d91c4665ba5af180f55c663c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:30.591701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9c03b-fad6-4c1d-91ff-b5489763b1b6 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:30.592016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9c03b-fad6-4c1d-91ff-b5489763b1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:30.592269 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9c03b-fad6-4c1d-91ff-b5489763b1b6 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:30.593685 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 284/542] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:30.600031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b7bd-4e24-4732-a0aa-4017c79602ad None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:30.600334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b7bd-4e24-4732-a0aa-4017c79602ad None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:30.600598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b7bd-4e24-4732-a0aa-4017c79602ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:30.627538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-24b5b7bd-4e24-4732-a0aa-4017c79602ad None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:30.628694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-24b5b7bd-4e24-4732-a0aa-4017c79602ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:30.720386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 259/543] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:04:30.756174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9c03b-fad6-4c1d-91ff-b5489763b1b6 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:30.880280 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9c03b-fad6-4c1d-91ff-b5489763b1b6 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:30.916115 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e968130-1017-47be-9ce3-58b33fd508f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:30.916976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e968130-1017-47be-9ce3-58b33fd508f4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:30.917261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e968130-1017-47be-9ce3-58b33fd508f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:30.917542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e968130-1017-47be-9ce3-58b33fd508f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:30.928997 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e968130-1017-47be-9ce3-58b33fd508f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:30.937027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-7e968130-1017-47be-9ce3-58b33fd508f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:30.937027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:30.937027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:30.937027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:30.937027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:30.937027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:30.937027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:30.937027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:30.937027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:30.937027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:30.937027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:30.937027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:30.937027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:30.937027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:30.937027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:30.937027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:30.937921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:30.937921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:30.937921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:30.937921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:30.937921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:30.937921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:30.937921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:30.937921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:30.937921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:30.937921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:30.937921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:30.937921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:30.937921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:30.937921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:30.937921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:30.937921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:30.938775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:30.938775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:30.938775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:30.938775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:30.938775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:30.938775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:30.938775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:30.938775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:30.938775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:30.938775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:30.938775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:30.938775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:30.938775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 285/544] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:30.944158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5b7bd-4e24-4732-a0aa-4017c79602ad None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:31.040193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:31.072694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5b7bd-4e24-4732-a0aa-4017c79602ad None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:31.117942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4748ad3-e027-46e0-a765-bbaec784f0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:31.118659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4748ad3-e027-46e0-a765-bbaec784f0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:31.118946 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4748ad3-e027-46e0-a765-bbaec784f0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:31.119223 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4748ad3-e027-46e0-a765-bbaec784f0c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:31.119986 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4748ad3-e027-46e0-a765-bbaec784f0c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:31.120291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4748ad3-e027-46e0-a765-bbaec784f0c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:31.123483 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4748ad3-e027-46e0-a765-bbaec784f0c0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:31.135758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 260/545] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:31.141003 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e968130-1017-47be-9ce3-58b33fd508f4 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:31.213178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:31.274745 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e968130-1017-47be-9ce3-58b33fd508f4 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:31.309101 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae8413-87ec-4372-98d1-61074adadf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:31.309992 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae8413-87ec-4372-98d1-61074adadf60 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:31.310348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae8413-87ec-4372-98d1-61074adadf60 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:31.310730 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae8413-87ec-4372-98d1-61074adadf60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:31.322038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae8413-87ec-4372-98d1-61074adadf60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:31.323533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae8413-87ec-4372-98d1-61074adadf60 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:31.341025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-48ae8413-87ec-4372-98d1-61074adadf60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:31.341025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:31.341025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:31.341025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:31.341025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:31.341025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:31.341025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:31.341025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:31.341025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:31.341025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:31.341025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:31.341025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:31.341025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:31.341025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:31.341025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:31.341933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:31.342816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:31.342816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:31.342816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:31.342816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:31.342816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 286/546] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:31.349107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4748ad3-e027-46e0-a765-bbaec784f0c0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:31.490886 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4748ad3-e027-46e0-a765-bbaec784f0c0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:31.539834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e8958-e8fb-4c9f-b999-de3fe6bf74dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:31.540529 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e8958-e8fb-4c9f-b999-de3fe6bf74dd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:31.540810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e8958-e8fb-4c9f-b999-de3fe6bf74dd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:31.541084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e8958-e8fb-4c9f-b999-de3fe6bf74dd None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:31.541829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e8958-e8fb-4c9f-b999-de3fe6bf74dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:31.542134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e8958-e8fb-4c9f-b999-de3fe6bf74dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:31.543588 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e8958-e8fb-4c9f-b999-de3fe6bf74dd None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:31.553974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:31.557744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 261/547] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:31.562948 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae8413-87ec-4372-98d1-61074adadf60 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:31.668232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:31.682322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae8413-87ec-4372-98d1-61074adadf60 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:31.691623 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5f1f-6ddc-4a5a-a128-920b3a2aec5e None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:31.692220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5f1f-6ddc-4a5a-a128-920b3a2aec5e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:31.692711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5f1f-6ddc-4a5a-a128-920b3a2aec5e None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:31.694665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 262/548] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:04:31.699738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3ba6b-d815-4eb5-bc66-ce88cfd1e501 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:31.700237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3ba6b-d815-4eb5-bc66-ce88cfd1e501 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:31.700713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3ba6b-d815-4eb5-bc66-ce88cfd1e501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:31.718307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-23d3ba6b-d815-4eb5-bc66-ce88cfd1e501 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:31.719901 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-23d3ba6b-d815-4eb5-bc66-ce88cfd1e501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:31.731011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cddd7-b8fa-42ae-bfb0-a98b4ae3773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:31.732028 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cddd7-b8fa-42ae-bfb0-a98b4ae3773f None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:31.732209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cddd7-b8fa-42ae-bfb0-a98b4ae3773f None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:31.732479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cddd7-b8fa-42ae-bfb0-a98b4ae3773f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:31.741127 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cddd7-b8fa-42ae-bfb0-a98b4ae3773f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:31.742937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cddd7-b8fa-42ae-bfb0-a98b4ae3773f None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:31.762415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-ef5cddd7-b8fa-42ae-bfb0-a98b4ae3773f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 14:04:31.762415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:31.762415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:31.762415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:31.762415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:31.762415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:31.762415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:31.762415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:31.762415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:31.762415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:31.762415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:31.762415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:31.762415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:31.762415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:31.762415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:31.762415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:31.763866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:31.764930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:31.764930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:31.764930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:31.764930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:31.764930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:31.764930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:31.764930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:31.764930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:31.764930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 14:04:31.764930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:31.764930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 287/549] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:04:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:31.765493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cddd7-b8fa-42ae-bfb0-a98b4ae3773f None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:31.838763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 263/550] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:04:31.861433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3ba6b-d815-4eb5-bc66-ce88cfd1e501 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:31.910793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cddd7-b8fa-42ae-bfb0-a98b4ae3773f None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:31.951205 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316427b-66ce-46c1-b951-05625664a670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:31.951881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316427b-66ce-46c1-b951-05625664a670 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:31.952212 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316427b-66ce-46c1-b951-05625664a670 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:31.952495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316427b-66ce-46c1-b951-05625664a670 None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:31.953350 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316427b-66ce-46c1-b951-05625664a670 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:31.953661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316427b-66ce-46c1-b951-05625664a670 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:31.955161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316427b-66ce-46c1-b951-05625664a670 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:31.984308 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 288/551] 10.222.0.99 () {56 vars in 1135 bytes} [Mon Jul 18 14:04:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:31.989375 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316427b-66ce-46c1-b951-05625664a670 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:32.010817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:32.103118 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316427b-66ce-46c1-b951-05625664a670 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:32.118786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3ba6b-d815-4eb5-bc66-ce88cfd1e501 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:32.149393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e0d56-1d80-48d3-bdc8-d24b8ddcd627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:32.150071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e0d56-1d80-48d3-bdc8-d24b8ddcd627 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:32.150357 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e0d56-1d80-48d3-bdc8-d24b8ddcd627 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:32.150661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e0d56-1d80-48d3-bdc8-d24b8ddcd627 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:32.159158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:32.171732 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7476bf0-7ee4-409a-b8b4-a962c7773bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:32.172868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7476bf0-7ee4-409a-b8b4-a962c7773bfa None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:32.173402 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7476bf0-7ee4-409a-b8b4-a962c7773bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:32.173864 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7476bf0-7ee4-409a-b8b4-a962c7773bfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:32.191869 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7476bf0-7ee4-409a-b8b4-a962c7773bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:32.202770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-e7476bf0-7ee4-409a-b8b4-a962c7773bfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:32.202770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:32.202770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:32.202770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:32.202770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:32.202770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:32.202770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:32.202770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:32.202770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:32.202770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:32.202770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:32.202770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:32.202770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:32.202770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:32.202770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:32.202770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:32.203774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:32.203774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:32.203774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:32.203774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:32.203774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:32.203774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:32.203774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:32.203774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:32.203774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:32.203774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:32.203774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:32.203774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:32.203774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:32.203774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:32.203774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:32.203774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:32.204716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:32.204716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:32.204716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:32.204716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:32.204716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:32.204716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:32.204716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:32.204716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:32.204716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:32.204716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:32.204716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:32.204716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:32.212886 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 264/552] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:32.219472 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7476bf0-7ee4-409a-b8b4-a962c7773bfa None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:32.292788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e0d56-1d80-48d3-bdc8-d24b8ddcd627 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:32.294600 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e0d56-1d80-48d3-bdc8-d24b8ddcd627 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:32.318755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:32.405453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7476bf0-7ee4-409a-b8b4-a962c7773bfa None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:32.474337 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb27430-b823-4d9f-9612-81f3c521fcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:32.475025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb27430-b823-4d9f-9612-81f3c521fcd6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:32.475307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb27430-b823-4d9f-9612-81f3c521fcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:32.475579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb27430-b823-4d9f-9612-81f3c521fcd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:32.476334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb27430-b823-4d9f-9612-81f3c521fcd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:32.476633 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb27430-b823-4d9f-9612-81f3c521fcd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:32.478030 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb27430-b823-4d9f-9612-81f3c521fcd6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:32.487800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 289/553] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 14:04:32.495813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e0d56-1d80-48d3-bdc8-d24b8ddcd627 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:32.501056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 265/554] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:32.507419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb27430-b823-4d9f-9612-81f3c521fcd6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:32.602819 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:32.652979 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e0d56-1d80-48d3-bdc8-d24b8ddcd627 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:32.653658 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb27430-b823-4d9f-9612-81f3c521fcd6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:32.668645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:32.690031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c11954-6a5e-44a0-9184-e8d664e390cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:32.690892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c11954-6a5e-44a0-9184-e8d664e390cf None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:32.691180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c11954-6a5e-44a0-9184-e8d664e390cf None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:32.691505 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c11954-6a5e-44a0-9184-e8d664e390cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:32.693687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbaa95-6eb1-4095-9751-a48cc1ff544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:32.694602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbaa95-6eb1-4095-9751-a48cc1ff544b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:32.694883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbaa95-6eb1-4095-9751-a48cc1ff544b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:32.695155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbaa95-6eb1-4095-9751-a48cc1ff544b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:32.703105 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c11954-6a5e-44a0-9184-e8d664e390cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:32.704633 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c11954-6a5e-44a0-9184-e8d664e390cf None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:32.705850 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbaa95-6eb1-4095-9751-a48cc1ff544b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:32.707533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbaa95-6eb1-4095-9751-a48cc1ff544b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:32.722141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d5c11954-6a5e-44a0-9184-e8d664e390cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:32.722141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:32.722141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:32.722141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:32.722141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:32.722141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:32.722141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:32.722141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:32.722141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:32.722141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:32.722141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:32.722141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:32.722141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:32.722141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:32.722141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:32.723089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:32.723937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:32.723937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:32.723937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:32.723937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:32.725311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-96cbaa95-6eb1-4095-9751-a48cc1ff544b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:32.725311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:32.725311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:32.725311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:32.725311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:32.725311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:32.725311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:32.725311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:32.725311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:32.725311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:32.725311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:32.725311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:32.725311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:32.725311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:32.725311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:32.726168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:32.727570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:32.727570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:32.727570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:32.727570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:32.728385 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 266/555] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:32.729571 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049213c3-ef47-47ff-b712-aab03c94ec62 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:32.729839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049213c3-ef47-47ff-b712-aab03c94ec62 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:32.730157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049213c3-ef47-47ff-b712-aab03c94ec62 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:32.732783 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 290/556] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:32.732971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 267/557] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:32.733144 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c4ff6-a479-4118-ba3e-7969faf95851 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:32.733144 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c4ff6-a479-4118-ba3e-7969faf95851 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:32.733308 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049213c3-ef47-47ff-b712-aab03c94ec62 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:32.733392 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c4ff6-a479-4118-ba3e-7969faf95851 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:32.738773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 291/558] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:32.739577 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c4ff6-a479-4118-ba3e-7969faf95851 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:32.849216 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c4ff6-a479-4118-ba3e-7969faf95851 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:32.852332 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049213c3-ef47-47ff-b712-aab03c94ec62 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:32.855586 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:32.883960 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355698d-c93c-4ebd-b9ef-dda29dd40af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:32.884620 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355698d-c93c-4ebd-b9ef-dda29dd40af4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:32.884902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355698d-c93c-4ebd-b9ef-dda29dd40af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:32.885176 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355698d-c93c-4ebd-b9ef-dda29dd40af4 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:32.885982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355698d-c93c-4ebd-b9ef-dda29dd40af4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:32.886291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355698d-c93c-4ebd-b9ef-dda29dd40af4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:32.887960 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355698d-c93c-4ebd-b9ef-dda29dd40af4 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:32.889278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6be98e-1fb4-4e72-bf1d-23a1323d1763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:32.889946 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6be98e-1fb4-4e72-bf1d-23a1323d1763 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:32.890229 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6be98e-1fb4-4e72-bf1d-23a1323d1763 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:32.890544 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6be98e-1fb4-4e72-bf1d-23a1323d1763 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:32.891278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6be98e-1fb4-4e72-bf1d-23a1323d1763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:32.891617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6be98e-1fb4-4e72-bf1d-23a1323d1763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:32.893084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6be98e-1fb4-4e72-bf1d-23a1323d1763 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:32.902405 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 292/559] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:32.903950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffe57b-6ec1-4972-925e-ff07280e4050 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:32.904304 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffe57b-6ec1-4972-925e-ff07280e4050 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:32.904646 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffe57b-6ec1-4972-925e-ff07280e4050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:32.914763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 268/560] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:32.916581 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cef16d-d9a7-4a10-9144-da924f6743e1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:32.917065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cef16d-d9a7-4a10-9144-da924f6743e1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:32.917387 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cef16d-d9a7-4a10-9144-da924f6743e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:32.925309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-fdffe57b-6ec1-4972-925e-ff07280e4050 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:32.926673 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-fdffe57b-6ec1-4972-925e-ff07280e4050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:32.934735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b8cef16d-d9a7-4a10-9144-da924f6743e1 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:32.935923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b8cef16d-d9a7-4a10-9144-da924f6743e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:32.943950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:32.998721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 293/561] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:33.000057 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffe57b-6ec1-4972-925e-ff07280e4050 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:33.016064 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 269/562] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:33.017298 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cef16d-d9a7-4a10-9144-da924f6743e1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:33.110027 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:33.116882 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cef16d-d9a7-4a10-9144-da924f6743e1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:33.120901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffe57b-6ec1-4972-925e-ff07280e4050 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:33.154432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd03d9c-7aec-4dbd-b0d1-5cd3c8091c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:33.155258 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03d9c-7aec-4dbd-b0d1-5cd3c8091c10 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:33.155541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03d9c-7aec-4dbd-b0d1-5cd3c8091c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:33.155822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03d9c-7aec-4dbd-b0d1-5cd3c8091c10 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:33.158179 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a89b03-4f54-4bb8-9ee7-a087849d4940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:33.159573 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a89b03-4f54-4bb8-9ee7-a087849d4940 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:33.159905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a89b03-4f54-4bb8-9ee7-a087849d4940 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:33.160114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a89b03-4f54-4bb8-9ee7-a087849d4940 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:33.163465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd03d9c-7aec-4dbd-b0d1-5cd3c8091c10 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:33.164936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd03d9c-7aec-4dbd-b0d1-5cd3c8091c10 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:33.167071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a89b03-4f54-4bb8-9ee7-a087849d4940 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:33.168513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a89b03-4f54-4bb8-9ee7-a087849d4940 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:33.179375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-8dd03d9c-7aec-4dbd-b0d1-5cd3c8091c10 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:04:33.179375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:33.179375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:33.179375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:33.179375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:33.179375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:33.179375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:33.179375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:33.179375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:33.179375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:33.179375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:33.179375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:33.179375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:33.179375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:33.179375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:33.179375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:33.185711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:33.187491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:33.187491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:33.187491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:33.187491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:33.187491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:33.187491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:33.187491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:33.187491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:33.187491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:04:33.187491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:33.187491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 270/563] 10.222.0.99 () {56 vars in 1093 bytes} [Mon Jul 18 14:04:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:33.187491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd03d9c-7aec-4dbd-b0d1-5cd3c8091c10 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:33.188684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-c0a89b03-4f54-4bb8-9ee7-a087849d4940 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:33.188684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:33.188684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:33.188684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:33.188684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:33.188684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:33.188684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:33.188684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:33.188684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:33.188684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:33.188684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:33.188684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:33.188684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:33.188684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:33.188684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:33.189744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:33.191925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:33.191925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:33.191925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:33.191925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:33.191925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:33.191925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:33.191925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:33.191925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:33.191925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 294/564] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:33.191925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac122bd-fbe1-4b53-bba9-b78a3220c87c None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:33.191925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac122bd-fbe1-4b53-bba9-b78a3220c87c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:33.192735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac122bd-fbe1-4b53-bba9-b78a3220c87c None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:33.192735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 295/565] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:33.192735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac122bd-fbe1-4b53-bba9-b78a3220c87c None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:33.201750 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:33.287517 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd03d9c-7aec-4dbd-b0d1-5cd3c8091c10 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:33.290059 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac122bd-fbe1-4b53-bba9-b78a3220c87c None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:33.322970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d173f-f5a0-4763-a056-d45eebd51d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:33.323199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bd94a-017d-42ab-a52c-524913b031cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:33.323773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d173f-f5a0-4763-a056-d45eebd51d07 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:33.323971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bd94a-017d-42ab-a52c-524913b031cc None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:33.324071 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d173f-f5a0-4763-a056-d45eebd51d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:33.324241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bd94a-017d-42ab-a52c-524913b031cc None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:33.324341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d173f-f5a0-4763-a056-d45eebd51d07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:33.324527 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bd94a-017d-42ab-a52c-524913b031cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:33.335390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bd94a-017d-42ab-a52c-524913b031cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:33.335521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d173f-f5a0-4763-a056-d45eebd51d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:33.343086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-cf5bd94a-017d-42ab-a52c-524913b031cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:33.343086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:33.343086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:33.343086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:33.343086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:33.343086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:33.343086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:33.343086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:33.343086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:33.343086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:33.343086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:33.343086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:33.343086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:33.343086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:33.343086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:33.343086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:33.344008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:33.344008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:33.344008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:33.344008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:33.344008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:33.344008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:33.344008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:33.344008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:33.344008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:33.344008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:33.344008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:33.344008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:33.344008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:33.344008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:33.344008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:33.344008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:33.344847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:33.344847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:33.344847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:33.344847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:33.344847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:33.344847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:33.344847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:33.344847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:33.344847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:33.344847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:33.344847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:33.344847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:33.345611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-478d173f-f5a0-4763-a056-d45eebd51d07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:33.345611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:33.345611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:33.345611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:33.345611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:33.345611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:33.345611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:33.345611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:33.345611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:33.345611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:33.345611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:33.345611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:33.345611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:33.345611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:33.345611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:33.345611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:33.346453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:33.346453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:33.346453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:33.346453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:33.346453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:33.346453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:33.346453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:33.346453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:33.346453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:33.346453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:33.346453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:33.346453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:33.346453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:33.346453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:33.346453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:33.346453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:33.347302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:33.347302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:33.347302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:33.347302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:33.347302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:33.347302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:33.347302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:33.347302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:33.347302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:33.347302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:33.347302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:33.347302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:33.347910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 296/566] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:33.347910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bd94a-017d-42ab-a52c-524913b031cc None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:33.349243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 271/567] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:33.350109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d173f-f5a0-4763-a056-d45eebd51d07 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:33.367817 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:33.419000 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:33.448635 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bd94a-017d-42ab-a52c-524913b031cc None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:33.451666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d173f-f5a0-4763-a056-d45eebd51d07 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:33.482495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca9496-c306-45b8-909d-7d24f0b85208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:33.483155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca9496-c306-45b8-909d-7d24f0b85208 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:33.483433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca9496-c306-45b8-909d-7d24f0b85208 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:33.483708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca9496-c306-45b8-909d-7d24f0b85208 None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:33.484549 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca9496-c306-45b8-909d-7d24f0b85208 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:33.484852 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca9496-c306-45b8-909d-7d24f0b85208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:33.486309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca9496-c306-45b8-909d-7d24f0b85208 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:33.486453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf1d95-fa50-4312-a0b6-6deadc601a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:33.486992 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf1d95-fa50-4312-a0b6-6deadc601a4a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:33.487269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf1d95-fa50-4312-a0b6-6deadc601a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:33.487545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf1d95-fa50-4312-a0b6-6deadc601a4a None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:33.488393 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf1d95-fa50-4312-a0b6-6deadc601a4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:33.488693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf1d95-fa50-4312-a0b6-6deadc601a4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:33.490117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf1d95-fa50-4312-a0b6-6deadc601a4a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:33.502920 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 272/568] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:33.503546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 297/569] 10.222.0.99 () {56 vars in 1133 bytes} [Mon Jul 18 14:04:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:33.504254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca9496-c306-45b8-909d-7d24f0b85208 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:33.507903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777841b-9a57-499c-af3f-47fb2b4c70d4 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:33.508350 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777841b-9a57-499c-af3f-47fb2b4c70d4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:33.508630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777841b-9a57-499c-af3f-47fb2b4c70d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:33.525731 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8777841b-9a57-499c-af3f-47fb2b4c70d4 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:33.526981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8777841b-9a57-499c-af3f-47fb2b4c70d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:33.592311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 273/570] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:33.593117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777841b-9a57-499c-af3f-47fb2b4c70d4 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:33.601977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca9496-c306-45b8-909d-7d24f0b85208 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:33.606900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:33.631485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:33.637724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaa925-fd63-41be-b87d-8de5da6b042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:33.638413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaa925-fd63-41be-b87d-8de5da6b042f None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:33.638751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaa925-fd63-41be-b87d-8de5da6b042f None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:33.639037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaa925-fd63-41be-b87d-8de5da6b042f None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:33.639790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaa925-fd63-41be-b87d-8de5da6b042f None admin] RBAC: Adding query filter params (name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:33.640097 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaa925-fd63-41be-b87d-8de5da6b042f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:33.641471 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaa925-fd63-41be-b87d-8de5da6b042f None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:33.649816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 298/571] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:33.650641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaa925-fd63-41be-b87d-8de5da6b042f None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:33.707164 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777841b-9a57-499c-af3f-47fb2b4c70d4 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:33.741052 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba31101-2d45-4e36-a8d2-968e16c516aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:33.741711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31101-2d45-4e36-a8d2-968e16c516aa None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:33.741987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31101-2d45-4e36-a8d2-968e16c516aa None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:33.742255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31101-2d45-4e36-a8d2-968e16c516aa None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:33.743038 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba31101-2d45-4e36-a8d2-968e16c516aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:33.743337 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba31101-2d45-4e36-a8d2-968e16c516aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:33.744738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba31101-2d45-4e36-a8d2-968e16c516aa None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:33.749064 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaa925-fd63-41be-b87d-8de5da6b042f None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:33.753236 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 274/572] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:33.754024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba31101-2d45-4e36-a8d2-968e16c516aa None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:33.783053 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f00e2e-8196-40ef-9f9f-973f34019a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:33.783723 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f00e2e-8196-40ef-9f9f-973f34019a07 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:33.783997 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f00e2e-8196-40ef-9f9f-973f34019a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:33.784269 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f00e2e-8196-40ef-9f9f-973f34019a07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:33.785104 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f00e2e-8196-40ef-9f9f-973f34019a07 None admin] RBAC: Adding query filter params (role.id=ea9f1b43d91c4665ba5af180f55c663c, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=55fe1a286c2045d5bcd49895a878a3bf) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:33.785418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f00e2e-8196-40ef-9f9f-973f34019a07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:33.786885 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f00e2e-8196-40ef-9f9f-973f34019a07 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:33.792443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 299/573] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:04:33 2022] GET /identity/v3/role_assignments?user.id=55fe1a286c2045d5bcd49895a878a3bf&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=ea9f1b43d91c4665ba5af180f55c663c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:33.793069 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f00e2e-8196-40ef-9f9f-973f34019a07 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:33.835718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:33.857972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:33.883326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba31101-2d45-4e36-a8d2-968e16c516aa None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:33.905698 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f00e2e-8196-40ef-9f9f-973f34019a07 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:33.924462 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534bd60-60b1-4258-ba41-6d9d4dff1f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:33.925382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534bd60-60b1-4258-ba41-6d9d4dff1f8b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:33.925662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534bd60-60b1-4258-ba41-6d9d4dff1f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:33.925932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534bd60-60b1-4258-ba41-6d9d4dff1f8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:33.938137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534bd60-60b1-4258-ba41-6d9d4dff1f8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:33.939691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534bd60-60b1-4258-ba41-6d9d4dff1f8b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:33.942477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618e93d-604a-41b1-9e71-16ddb239eca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:33.943286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618e93d-604a-41b1-9e71-16ddb239eca4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:33.943571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618e93d-604a-41b1-9e71-16ddb239eca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:33.943838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618e93d-604a-41b1-9e71-16ddb239eca4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:33.955471 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618e93d-604a-41b1-9e71-16ddb239eca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:33.958418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-7534bd60-60b1-4258-ba41-6d9d4dff1f8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:33.958418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:33.958418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:33.958418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:33.958418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:33.958418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:33.958418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:33.958418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:33.958418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:33.958418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:33.958418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:33.958418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:33.958418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:33.958418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:33.958418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:33.959260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:33.960117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:33.960117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:33.960117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:33.960117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:33.960857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 275/574] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:33.961860 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534bd60-60b1-4258-ba41-6d9d4dff1f8b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:33.963325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-4618e93d-604a-41b1-9e71-16ddb239eca4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:33.963325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:33.963325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:33.963325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:33.963325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:33.963325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:33.963325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:33.963325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:33.963325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:33.963325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:33.963325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:33.963325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:33.963325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:33.963325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:33.963325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:33.963325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:33.964214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:33.964214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:33.964214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:33.964214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:33.964214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:33.964214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:33.964214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:33.964214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:33.964214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:33.964214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:33.964214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:33.964214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:33.964214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:33.964214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:33.964214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:33.964214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:33.965007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:33.965007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:33.965007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:33.965007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:33.965007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:33.965007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:33.965007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:33.965007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:33.965007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:33.965007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:33.965007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:33.965007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:33.965007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 300/575] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:33.965678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618e93d-604a-41b1-9e71-16ddb239eca4 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:34.068180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534bd60-60b1-4258-ba41-6d9d4dff1f8b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:34.071477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618e93d-604a-41b1-9e71-16ddb239eca4 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:34.087574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:34.089402 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:34.107258 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f852-8478-43e8-b327-af9b83acd326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:34.107913 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853b433-42ec-47aa-8359-5da849d3b14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:34.108032 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f852-8478-43e8-b327-af9b83acd326 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:34.108308 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f852-8478-43e8-b327-af9b83acd326 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:34.108580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4f852-8478-43e8-b327-af9b83acd326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:34.108736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853b433-42ec-47aa-8359-5da849d3b14d None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:34.109017 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853b433-42ec-47aa-8359-5da849d3b14d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:34.109290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853b433-42ec-47aa-8359-5da849d3b14d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:34.119689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f852-8478-43e8-b327-af9b83acd326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:34.123346 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb4f852-8478-43e8-b327-af9b83acd326 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:34.127310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853b433-42ec-47aa-8359-5da849d3b14d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:34.129255 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853b433-42ec-47aa-8359-5da849d3b14d None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:34.141139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-7fb4f852-8478-43e8-b327-af9b83acd326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:34.141139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:34.141139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:34.141139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:34.141139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:34.141139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:34.141139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:34.141139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:34.141139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:34.141139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:34.141139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:34.141139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:34.141139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:34.141139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:34.141139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:34.142028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:34.142987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:34.142987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:34.142987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:34.142987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:34.146872 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 276/576] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:34.146872 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f852-8478-43e8-b327-af9b83acd326 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:34.152282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-c853b433-42ec-47aa-8359-5da849d3b14d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:34.152282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:34.152282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:34.152282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:34.152282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:34.152282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:34.152282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:34.152282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:34.152282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:34.152282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:34.152282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:34.152282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:34.152282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:34.152282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:34.152282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:34.153313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:34.154178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:34.154178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:34.154178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:34.154178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:34.154178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 301/577] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:34.154490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853b433-42ec-47aa-8359-5da849d3b14d None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:34.259319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4f852-8478-43e8-b327-af9b83acd326 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:34.266342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853b433-42ec-47aa-8359-5da849d3b14d None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:34.294350 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fb380-c0fb-46b5-a8d1-f8088b7fc367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:34.295139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fb380-c0fb-46b5-a8d1-f8088b7fc367 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:34.295420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fb380-c0fb-46b5-a8d1-f8088b7fc367 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:34.295694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fb380-c0fb-46b5-a8d1-f8088b7fc367 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:34.296514 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fb380-c0fb-46b5-a8d1-f8088b7fc367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:34.296821 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fb380-c0fb-46b5-a8d1-f8088b7fc367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:34.298344 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fb380-c0fb-46b5-a8d1-f8088b7fc367 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:34.299727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1646f6-5393-409b-bbe8-962683a940e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:34.300521 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1646f6-5393-409b-bbe8-962683a940e9 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:34.300827 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1646f6-5393-409b-bbe8-962683a940e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:34.301112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1646f6-5393-409b-bbe8-962683a940e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:34.301871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1646f6-5393-409b-bbe8-962683a940e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:34.302183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1646f6-5393-409b-bbe8-962683a940e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:34.303587 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1646f6-5393-409b-bbe8-962683a940e9 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:34.311694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 302/578] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:34.312485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1646f6-5393-409b-bbe8-962683a940e9 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:34.313368 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 277/579] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:34.314496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fb380-c0fb-46b5-a8d1-f8088b7fc367 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:34.349821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:34.350028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:34.421713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1646f6-5393-409b-bbe8-962683a940e9 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:34.426414 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fb380-c0fb-46b5-a8d1-f8088b7fc367 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:34.461130 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3077d9d-cd8b-4df5-b923-8f9acf4d42d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:34.461704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32329f-5c16-468b-be59-6994fa904e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:34.461911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3077d9d-cd8b-4df5-b923-8f9acf4d42d6 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:34.462179 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3077d9d-cd8b-4df5-b923-8f9acf4d42d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:34.462373 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32329f-5c16-468b-be59-6994fa904e80 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:34.462489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3077d9d-cd8b-4df5-b923-8f9acf4d42d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:34.462684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32329f-5c16-468b-be59-6994fa904e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:34.462962 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32329f-5c16-468b-be59-6994fa904e80 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:34.463210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3077d9d-cd8b-4df5-b923-8f9acf4d42d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:34.463518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3077d9d-cd8b-4df5-b923-8f9acf4d42d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:34.463690 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32329f-5c16-468b-be59-6994fa904e80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:34.463997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32329f-5c16-468b-be59-6994fa904e80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:34.464886 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3077d9d-cd8b-4df5-b923-8f9acf4d42d6 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:34.465378 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32329f-5c16-468b-be59-6994fa904e80 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:34.477563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 303/580] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:34.478084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 278/581] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:34.479155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32329f-5c16-468b-be59-6994fa904e80 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:34.482911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3077d9d-cd8b-4df5-b923-8f9acf4d42d6 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:34.569603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:34.577900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:34.579121 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32329f-5c16-468b-be59-6994fa904e80 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:34.588983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3077d9d-cd8b-4df5-b923-8f9acf4d42d6 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:34.613416 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99c91f-7454-4679-b17d-975aa739b538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:34.614205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99c91f-7454-4679-b17d-975aa739b538 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:34.614595 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99c91f-7454-4679-b17d-975aa739b538 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:34.614875 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99c91f-7454-4679-b17d-975aa739b538 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:34.621705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99c91f-7454-4679-b17d-975aa739b538 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:34.623110 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99c91f-7454-4679-b17d-975aa739b538 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:34.625390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cad899-3ea4-4649-ac02-15706a3926e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:34.626502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cad899-3ea4-4649-ac02-15706a3926e9 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:34.626784 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cad899-3ea4-4649-ac02-15706a3926e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:34.627052 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cad899-3ea4-4649-ac02-15706a3926e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:34.637041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cad899-3ea4-4649-ac02-15706a3926e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:34.637291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-cc99c91f-7454-4679-b17d-975aa739b538 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:34.637291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:34.637291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:34.637291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:34.637291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:34.637291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:34.637291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:34.637291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:34.637291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:34.637291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:34.637291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:34.637291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:34.637291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:34.637291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:34.637291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:34.638147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:34.639060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:34.639060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:34.639060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:34.639060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:34.639060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:34.639060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:34.639060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:34.639060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:34.639482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cad899-3ea4-4649-ac02-15706a3926e9 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:34.643416 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 279/582] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:34.644139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99c91f-7454-4679-b17d-975aa739b538 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:34.657803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-35cad899-3ea4-4649-ac02-15706a3926e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:34.657803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:34.657803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:34.657803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:34.657803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:34.657803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:34.657803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:34.657803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:34.657803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:34.657803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:34.657803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:34.657803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:34.657803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:34.657803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:34.657803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:34.658818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:34.659722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:34.659722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:34.659722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:34.659722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:34.659722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 304/583] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:34.659722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cad899-3ea4-4649-ac02-15706a3926e9 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:34.748643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99c91f-7454-4679-b17d-975aa739b538 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:34.766587 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cad899-3ea4-4649-ac02-15706a3926e9 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:34.783044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b1a8d-ff91-453b-a985-9f4e579bd58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:34.783839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b1a8d-ff91-453b-a985-9f4e579bd58a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:34.784185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b1a8d-ff91-453b-a985-9f4e579bd58a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:34.784404 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b1a8d-ff91-453b-a985-9f4e579bd58a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:34.791910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b1a8d-ff91-453b-a985-9f4e579bd58a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:34.793364 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b1a8d-ff91-453b-a985-9f4e579bd58a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:34.801954 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c14cd-8d79-4252-9de9-567c76da8bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:34.803005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c14cd-8d79-4252-9de9-567c76da8bdf None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:34.803457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c14cd-8d79-4252-9de9-567c76da8bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:34.803898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c14cd-8d79-4252-9de9-567c76da8bdf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:34.807745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-682b1a8d-ff91-453b-a985-9f4e579bd58a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 14:04:34.807745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:34.807745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:34.807745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:34.807745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:34.807745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:34.807745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:34.807745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:34.807745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:34.807745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:34.807745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:34.807745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:34.807745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:34.807745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:34.807745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:34.807745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:34.808643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:34.809580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:34.809580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:34.809580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:34.809580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:34.809580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:34.809580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:34.809580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:34.809580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:34.809580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 14:04:34.809580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:34.809580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 280/584] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:34.810168 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b1a8d-ff91-453b-a985-9f4e579bd58a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:34.814368 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c14cd-8d79-4252-9de9-567c76da8bdf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:34.815930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c14cd-8d79-4252-9de9-567c76da8bdf None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:34.827473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:34.831626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-174c14cd-8d79-4252-9de9-567c76da8bdf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 14:04:34.831626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:34.831626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:34.831626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:34.831626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:34.831626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:34.831626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:34.831626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:34.831626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:34.831626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:34.831626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:34.831626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:34.831626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:34.831626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:34.831626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:34.831626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:34.832578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:34.833497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:34.833497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:34.833497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:34.833497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:34.833497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:34.833497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:34.833497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:34.833497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:34.833497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 14:04:34.833497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:34.833497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 305/585] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:34.834075 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c14cd-8d79-4252-9de9-567c76da8bdf None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:34.839861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:34.931772 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b1a8d-ff91-453b-a985-9f4e579bd58a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:34.951392 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c14cd-8d79-4252-9de9-567c76da8bdf None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:34.976093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deebeea-88a9-4fb0-8518-348d8ce21515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:34.976757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deebeea-88a9-4fb0-8518-348d8ce21515 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:34.977141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deebeea-88a9-4fb0-8518-348d8ce21515 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:34.977419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deebeea-88a9-4fb0-8518-348d8ce21515 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:34.978314 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deebeea-88a9-4fb0-8518-348d8ce21515 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:34.978653 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deebeea-88a9-4fb0-8518-348d8ce21515 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:34.980101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deebeea-88a9-4fb0-8518-348d8ce21515 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:34.990093 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e5e3f-0d3d-4524-9744-c264076c89ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:34.990947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e5e3f-0d3d-4524-9744-c264076c89ca None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:34.991234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e5e3f-0d3d-4524-9744-c264076c89ca None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:34.991516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e5e3f-0d3d-4524-9744-c264076c89ca None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:34.992246 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e5e3f-0d3d-4524-9744-c264076c89ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:34.997543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e5e3f-0d3d-4524-9744-c264076c89ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:34.997676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 281/586] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:34.997676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deebeea-88a9-4fb0-8518-348d8ce21515 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:34.997811 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e5e3f-0d3d-4524-9744-c264076c89ca None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:35.011311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 306/587] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:35.011311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e5e3f-0d3d-4524-9744-c264076c89ca None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:35.071207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:35.071404 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:35.105808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deebeea-88a9-4fb0-8518-348d8ce21515 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:35.119261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e5e3f-0d3d-4524-9744-c264076c89ca None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:35.143642 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36229270-e1c6-4b15-8ba3-d1f013f28db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:35.144315 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36229270-e1c6-4b15-8ba3-d1f013f28db9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:35.144602 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36229270-e1c6-4b15-8ba3-d1f013f28db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:35.144873 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36229270-e1c6-4b15-8ba3-d1f013f28db9 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:35.145722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36229270-e1c6-4b15-8ba3-d1f013f28db9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:35.146030 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36229270-e1c6-4b15-8ba3-d1f013f28db9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:35.147540 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36229270-e1c6-4b15-8ba3-d1f013f28db9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:35.165558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d343a-06dd-449f-bff8-198e1881a6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:35.166357 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 282/588] 10.222.0.99 () {56 vars in 1137 bytes} [Mon Jul 18 14:04:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:35.166711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d343a-06dd-449f-bff8-198e1881a6fd None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:35.167177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d343a-06dd-449f-bff8-198e1881a6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:35.167466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36229270-e1c6-4b15-8ba3-d1f013f28db9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:35.167837 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d343a-06dd-449f-bff8-198e1881a6fd None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:35.169237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d343a-06dd-449f-bff8-198e1881a6fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:35.169798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d343a-06dd-449f-bff8-198e1881a6fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:35.171612 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d343a-06dd-449f-bff8-198e1881a6fd None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:35.198226 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 307/589] 10.222.0.99 () {56 vars in 1137 bytes} [Mon Jul 18 14:04:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:35.198226 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d343a-06dd-449f-bff8-198e1881a6fd None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:35.280501 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36229270-e1c6-4b15-8ba3-d1f013f28db9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:35.307725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d343a-06dd-449f-bff8-198e1881a6fd None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:35.310072 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:35.319945 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3811f7-319b-487c-989c-bba1c8d5d0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:35.320957 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3811f7-319b-487c-989c-bba1c8d5d0a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:35.321254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3811f7-319b-487c-989c-bba1c8d5d0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:35.321511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3811f7-319b-487c-989c-bba1c8d5d0a1 None admin] PATH_INFO: `/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/b1b66b55e0374152828913910c4002f4/roles/ea9f1b43d91c4665ba5af180f55c663c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:35.331557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:35.338128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3811f7-319b-487c-989c-bba1c8d5d0a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=50b78e16c86b4e6cac3a725f536a8274, user_id=b1b66b55e0374152828913910c4002f4, role_id=ea9f1b43d91c4665ba5af180f55c663c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:35.339676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3811f7-319b-487c-989c-bba1c8d5d0a1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:35.347620 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92122e4d-ca90-4f18-85f9-30e1946d8343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:35.348498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92122e4d-ca90-4f18-85f9-30e1946d8343 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:35.348829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92122e4d-ca90-4f18-85f9-30e1946d8343 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:35.349107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92122e4d-ca90-4f18-85f9-30e1946d8343 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:35.362455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 283/590] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:04:35 2022] PUT /identity/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/b1b66b55e0374152828913910c4002f4/roles/ea9f1b43d91c4665ba5af180f55c663c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:04:35.362455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3811f7-319b-487c-989c-bba1c8d5d0a1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:35.364902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92122e4d-ca90-4f18-85f9-30e1946d8343 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:35.366553 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92122e4d-ca90-4f18-85f9-30e1946d8343 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:35.385898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-92122e4d-ca90-4f18-85f9-30e1946d8343 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 14:04:35.385898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:35.385898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:35.385898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:35.385898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:35.385898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:35.385898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:35.385898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:35.385898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:35.385898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:35.385898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:35.385898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:35.385898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:35.385898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:35.385898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:35.385898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:35.386935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:35.387890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:35.387890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:35.387890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:35.387890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:35.387890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:35.387890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:35.387890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:35.387890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:35.387890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 14:04:35.387890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:35.387890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 308/591] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:35.388613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92122e4d-ca90-4f18-85f9-30e1946d8343 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:35.504105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92122e4d-ca90-4f18-85f9-30e1946d8343 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:35.504460 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3811f7-319b-487c-989c-bba1c8d5d0a1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:35.543236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fec28e-09b6-4004-a0cf-6d8f18cbbbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:35.543968 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fec28e-09b6-4004-a0cf-6d8f18cbbbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:35.544345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fec28e-09b6-4004-a0cf-6d8f18cbbbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:35.544714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fec28e-09b6-4004-a0cf-6d8f18cbbbf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:35.545596 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41699acb-440f-4299-b1fd-c1f9c22cc2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:35.546415 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699acb-440f-4299-b1fd-c1f9c22cc2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:35.546751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699acb-440f-4299-b1fd-c1f9c22cc2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:35.546984 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699acb-440f-4299-b1fd-c1f9c22cc2c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:35.557969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fec28e-09b6-4004-a0cf-6d8f18cbbbf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:35.559941 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fec28e-09b6-4004-a0cf-6d8f18cbbbf9 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:35.566450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41699acb-440f-4299-b1fd-c1f9c22cc2c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:35.568982 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41699acb-440f-4299-b1fd-c1f9c22cc2c7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:35.583111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-f1fec28e-09b6-4004-a0cf-6d8f18cbbbf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:35.583111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:35.583111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:35.583111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:35.583111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:35.583111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:35.583111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:35.583111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:35.583111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:35.583111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:35.583111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:35.583111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:35.583111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:35.583111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:35.583111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:35.584041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:35.585358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:35.585358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:35.585358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:35.585358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:35.585358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 309/592] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:35.585629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fec28e-09b6-4004-a0cf-6d8f18cbbbf9 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:35.593274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-41699acb-440f-4299-b1fd-c1f9c22cc2c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:35.593274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:35.593274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:35.593274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:35.593274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:35.593274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:35.593274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:35.593274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:35.593274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:35.593274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:35.593274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:35.593274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:35.593274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:35.593274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:35.593274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:35.594182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:35.595603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:35.595603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:35.595603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:35.595603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:35.595603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 284/593] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:35.600456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41699acb-440f-4299-b1fd-c1f9c22cc2c7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:35.618400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:35.634297 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:35.691545 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fec28e-09b6-4004-a0cf-6d8f18cbbbf9 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:35.711258 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41699acb-440f-4299-b1fd-c1f9c22cc2c7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:35.731774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186485c1-6878-4063-8dbf-39152a412f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:35.732460 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186485c1-6878-4063-8dbf-39152a412f7c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:35.732748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186485c1-6878-4063-8dbf-39152a412f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:35.733021 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186485c1-6878-4063-8dbf-39152a412f7c None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:35.733873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186485c1-6878-4063-8dbf-39152a412f7c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:35.734278 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186485c1-6878-4063-8dbf-39152a412f7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:35.736306 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186485c1-6878-4063-8dbf-39152a412f7c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:35.754303 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd9f9d-4f63-4363-9680-0d2f28ef4371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:35.755345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd9f9d-4f63-4363-9680-0d2f28ef4371 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:35.760015 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 310/594] 10.222.0.99 () {56 vars in 1139 bytes} [Mon Jul 18 14:04:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:35.760015 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186485c1-6878-4063-8dbf-39152a412f7c None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:35.760398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd9f9d-4f63-4363-9680-0d2f28ef4371 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:35.760903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd9f9d-4f63-4363-9680-0d2f28ef4371 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:35.761870 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd9f9d-4f63-4363-9680-0d2f28ef4371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:35.762360 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd9f9d-4f63-4363-9680-0d2f28ef4371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:35.763961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd9f9d-4f63-4363-9680-0d2f28ef4371 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:35.777736 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 285/595] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:35.779052 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd9f9d-4f63-4363-9680-0d2f28ef4371 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:35.850529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:35.862254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186485c1-6878-4063-8dbf-39152a412f7c None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:35.875454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:35.886554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd9f9d-4f63-4363-9680-0d2f28ef4371 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:35.904105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bae1f-b19c-42fc-b520-827d2b3054fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:35.905064 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bae1f-b19c-42fc-b520-827d2b3054fe None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:35.905337 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bae1f-b19c-42fc-b520-827d2b3054fe None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:35.905618 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bae1f-b19c-42fc-b520-827d2b3054fe None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:35.906344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bae1f-b19c-42fc-b520-827d2b3054fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:35.906674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bae1f-b19c-42fc-b520-827d2b3054fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:35.908146 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bae1f-b19c-42fc-b520-827d2b3054fe None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:35.919822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 311/596] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:35.921071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d0793-8dd1-4834-b2ee-9525f749e3d5 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:35.921356 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d0793-8dd1-4834-b2ee-9525f749e3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:35.921630 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d0793-8dd1-4834-b2ee-9525f749e3d5 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:35.927734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 312/597] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:35.927734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d0793-8dd1-4834-b2ee-9525f749e3d5 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:35.930201 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86401a6-b861-40d6-82fd-49b246f4a72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:35.931205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86401a6-b861-40d6-82fd-49b246f4a72a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:35.931640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86401a6-b861-40d6-82fd-49b246f4a72a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:35.931916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86401a6-b861-40d6-82fd-49b246f4a72a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:35.944465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86401a6-b861-40d6-82fd-49b246f4a72a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:35.945923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86401a6-b861-40d6-82fd-49b246f4a72a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:35.965757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a86401a6-b861-40d6-82fd-49b246f4a72a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:35.965757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:35.965757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:35.965757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:35.965757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:35.965757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:35.965757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:35.965757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:35.965757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:35.965757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:35.965757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:35.965757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:35.965757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:35.965757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:35.965757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:35.966932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:35.967800 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:35.967800 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:35.967800 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:35.967800 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:35.969135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 286/598] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:35.970330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86401a6-b861-40d6-82fd-49b246f4a72a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:36.032543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d0793-8dd1-4834-b2ee-9525f749e3d5 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:36.069839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2f0a8-62be-4e83-ae6c-53af1e9c15ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:36.070719 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2f0a8-62be-4e83-ae6c-53af1e9c15ce None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:36.071016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2f0a8-62be-4e83-ae6c-53af1e9c15ce None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:36.071258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2f0a8-62be-4e83-ae6c-53af1e9c15ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:36.075286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86401a6-b861-40d6-82fd-49b246f4a72a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:36.078073 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2f0a8-62be-4e83-ae6c-53af1e9c15ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:36.079648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2f0a8-62be-4e83-ae6c-53af1e9c15ce None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:36.094947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-bde2f0a8-62be-4e83-ae6c-53af1e9c15ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:36.094947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:36.094947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:36.094947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:36.094947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:36.094947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:36.094947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:36.094947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:36.094947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:36.094947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:36.094947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:36.094947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:36.094947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:36.094947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:36.094947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:36.095928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:36.096801 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:36.096801 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:36.096801 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:36.096801 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:36.096801 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:36.096801 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:36.096801 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:36.096801 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:36.096801 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 313/599] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:36.097689 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909213c6-80f4-4e12-817b-d25fd33bd3b6 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:36.097689 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909213c6-80f4-4e12-817b-d25fd33bd3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:36.097868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909213c6-80f4-4e12-817b-d25fd33bd3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:36.116014 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-909213c6-80f4-4e12-817b-d25fd33bd3b6 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:36.117236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-909213c6-80f4-4e12-817b-d25fd33bd3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:36.119762 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b152b3c-191b-4f5a-8e83-89e11cdc1f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:36.120680 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b152b3c-191b-4f5a-8e83-89e11cdc1f32 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:36.120895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b152b3c-191b-4f5a-8e83-89e11cdc1f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:36.121145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b152b3c-191b-4f5a-8e83-89e11cdc1f32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:36.121539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:36.131748 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b152b3c-191b-4f5a-8e83-89e11cdc1f32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:36.133227 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b152b3c-191b-4f5a-8e83-89e11cdc1f32 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:36.148246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-5b152b3c-191b-4f5a-8e83-89e11cdc1f32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:36.148246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:36.148246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:36.148246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:36.148246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:36.148246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:36.148246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:36.148246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:36.148246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:36.148246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:36.148246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:36.148246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:36.148246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:36.148246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:36.148246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:36.149092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:36.149956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:36.149956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:36.149956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:36.149956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:36.149956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:36.149956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:36.149956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:36.149956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:36.154231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 287/600] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:36.155176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b152b3c-191b-4f5a-8e83-89e11cdc1f32 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:36.157807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:36.202430 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 314/601] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:36.202430 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909213c6-80f4-4e12-817b-d25fd33bd3b6 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:36.272326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b152b3c-191b-4f5a-8e83-89e11cdc1f32 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:36.306916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed08ac6-d67c-467c-869f-03825de68f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:36.307571 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed08ac6-d67c-467c-869f-03825de68f8b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:36.307848 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed08ac6-d67c-467c-869f-03825de68f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:36.308123 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed08ac6-d67c-467c-869f-03825de68f8b None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:36.308601 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909213c6-80f4-4e12-817b-d25fd33bd3b6 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:36.308965 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed08ac6-d67c-467c-869f-03825de68f8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:36.309128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed08ac6-d67c-467c-869f-03825de68f8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:36.310537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed08ac6-d67c-467c-869f-03825de68f8b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:36.322495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 288/602] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:36.323590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed08ac6-d67c-467c-869f-03825de68f8b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:36.347111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce12c39-7df6-4ed2-baba-6dd3eea63ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:36.347779 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce12c39-7df6-4ed2-baba-6dd3eea63ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:36.348061 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce12c39-7df6-4ed2-baba-6dd3eea63ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:36.348335 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce12c39-7df6-4ed2-baba-6dd3eea63ad5 None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:36.349129 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce12c39-7df6-4ed2-baba-6dd3eea63ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:36.349437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce12c39-7df6-4ed2-baba-6dd3eea63ad5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:36.350906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce12c39-7df6-4ed2-baba-6dd3eea63ad5 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:36.360249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:36.368882 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 315/603] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:36.369536 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce12c39-7df6-4ed2-baba-6dd3eea63ad5 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:36.399282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:36.442984 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed08ac6-d67c-467c-869f-03825de68f8b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:36.477098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16065465-952d-45b7-8bd9-544bf41d800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:36.477756 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16065465-952d-45b7-8bd9-544bf41d800a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:36.478041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16065465-952d-45b7-8bd9-544bf41d800a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:36.478316 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16065465-952d-45b7-8bd9-544bf41d800a None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:36.479151 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16065465-952d-45b7-8bd9-544bf41d800a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:36.479447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16065465-952d-45b7-8bd9-544bf41d800a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:36.480895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16065465-952d-45b7-8bd9-544bf41d800a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:36.482535 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce12c39-7df6-4ed2-baba-6dd3eea63ad5 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:36.493156 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 289/604] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:36.493973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16065465-952d-45b7-8bd9-544bf41d800a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:36.524782 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e09cb-c5d7-45fb-aafc-0a2e860c1894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:36.525727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e09cb-c5d7-45fb-aafc-0a2e860c1894 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:36.526015 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e09cb-c5d7-45fb-aafc-0a2e860c1894 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:36.526287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e09cb-c5d7-45fb-aafc-0a2e860c1894 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:36.537613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e09cb-c5d7-45fb-aafc-0a2e860c1894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:36.545775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-c59e09cb-c5d7-45fb-aafc-0a2e860c1894 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:36.545775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:36.545775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:36.545775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:36.545775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:36.545775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:36.545775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:36.545775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:36.545775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:36.545775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:36.545775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:36.545775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:36.545775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:36.545775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:36.545775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:36.545775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:36.546971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:36.546971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:36.546971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:36.546971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:36.546971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:36.546971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:36.546971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:36.546971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:36.546971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:36.546971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:36.546971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:36.546971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:36.546971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:36.546971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:36.546971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:36.546971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:36.553404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:36.553404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:36.553404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:36.553404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:36.553404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:36.553404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:36.553404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:36.553404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:36.553404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:36.553404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:36.553404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:36.553404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:36.553404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 316/605] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:36.553404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e09cb-c5d7-45fb-aafc-0a2e860c1894 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:36.613132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16065465-952d-45b7-8bd9-544bf41d800a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:36.626989 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:36.637676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:36.649203 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696a4a0-44bf-4020-82cf-083b81ee5f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:36.650056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696a4a0-44bf-4020-82cf-083b81ee5f9f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:36.650341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696a4a0-44bf-4020-82cf-083b81ee5f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:36.650679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696a4a0-44bf-4020-82cf-083b81ee5f9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:36.657456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696a4a0-44bf-4020-82cf-083b81ee5f9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:36.659028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696a4a0-44bf-4020-82cf-083b81ee5f9f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:36.670052 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e09cb-c5d7-45fb-aafc-0a2e860c1894 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:36.672645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-5696a4a0-44bf-4020-82cf-083b81ee5f9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:36.672645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:36.672645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:36.672645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:36.672645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:36.672645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:36.672645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:36.672645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:36.672645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:36.672645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:36.672645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:36.672645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:36.672645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:36.672645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:36.672645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:36.673608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:36.674539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:36.674539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:36.674539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:36.674539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:36.674539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:36.674539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:36.674539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:36.674539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:36.674539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 290/606] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:36.675069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696a4a0-44bf-4020-82cf-083b81ee5f9f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:36.707987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65744a11-baa2-40b0-9d70-bc5e13169a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:36.709262 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744a11-baa2-40b0-9d70-bc5e13169a05 None admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:36.709725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744a11-baa2-40b0-9d70-bc5e13169a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:36.710027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744a11-baa2-40b0-9d70-bc5e13169a05 None admin] PATH_INFO: `/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/19eb97598f774389ad927867a7023fc8/roles/ea9f1b43d91c4665ba5af180f55c663c` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:36.726351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65744a11-baa2-40b0-9d70-bc5e13169a05 None admin] RBAC: Authorizing `identity:create_grant(project_id=50b78e16c86b4e6cac3a725f536a8274, user_id=19eb97598f774389ad927867a7023fc8, role_id=ea9f1b43d91c4665ba5af180f55c663c)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:36.727893 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65744a11-baa2-40b0-9d70-bc5e13169a05 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:36.740772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 317/607] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:04:36 2022] PUT /identity/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/19eb97598f774389ad927867a7023fc8/roles/ea9f1b43d91c4665ba5af180f55c663c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:04:36.741567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65744a11-baa2-40b0-9d70-bc5e13169a05 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:36.812504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696a4a0-44bf-4020-82cf-083b81ee5f9f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:36.863629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65744a11-baa2-40b0-9d70-bc5e13169a05 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:36.864180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5c86c-786b-4c3e-a684-8916408ac80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:36.865605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5c86c-786b-4c3e-a684-8916408ac80e None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:36.867100 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5c86c-786b-4c3e-a684-8916408ac80e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:36.867598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5c86c-786b-4c3e-a684-8916408ac80e None admin] PATH_INFO: `/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/927543219de847b88b97fbe4f343d2be/roles/ea9f1b43d91c4665ba5af180f55c663c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:36.877181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:36.892462 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5c86c-786b-4c3e-a684-8916408ac80e None admin] RBAC: Authorizing `identity:create_grant(project_id=50b78e16c86b4e6cac3a725f536a8274, user_id=927543219de847b88b97fbe4f343d2be, role_id=ea9f1b43d91c4665ba5af180f55c663c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:36.895127 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5c86c-786b-4c3e-a684-8916408ac80e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:36.905756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9aae56-ed6f-434a-8b63-55e6f2894c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:36.906464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aae56-ed6f-434a-8b63-55e6f2894c89 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:36.906766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aae56-ed6f-434a-8b63-55e6f2894c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:36.907026 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aae56-ed6f-434a-8b63-55e6f2894c89 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:36.907928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9aae56-ed6f-434a-8b63-55e6f2894c89 None admin] RBAC: Adding query filter params (name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:36.908234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9aae56-ed6f-434a-8b63-55e6f2894c89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:36.910788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9aae56-ed6f-434a-8b63-55e6f2894c89 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:36.915607 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 291/608] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:04:36 2022] PUT /identity/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/927543219de847b88b97fbe4f343d2be/roles/ea9f1b43d91c4665ba5af180f55c663c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:04:36.917186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5c86c-786b-4c3e-a684-8916408ac80e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:36.921916 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 318/609] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:36.933970 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9aae56-ed6f-434a-8b63-55e6f2894c89 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:36.960333 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:37.048894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5c86c-786b-4c3e-a684-8916408ac80e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:37.105207 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76925517-be9c-40e9-a154-317405952c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:37.106877 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76925517-be9c-40e9-a154-317405952c50 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:37.107478 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76925517-be9c-40e9-a154-317405952c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:37.109072 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76925517-be9c-40e9-a154-317405952c50 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:37.110061 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76925517-be9c-40e9-a154-317405952c50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:37.111325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76925517-be9c-40e9-a154-317405952c50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:37.113670 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76925517-be9c-40e9-a154-317405952c50 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:37.131517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9aae56-ed6f-434a-8b63-55e6f2894c89 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:37.135326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 292/610] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:37.154009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76925517-be9c-40e9-a154-317405952c50 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:37.180256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fce6b7-65fe-4321-a326-26b5caa9b3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:37.181499 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fce6b7-65fe-4321-a326-26b5caa9b3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:37.181879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fce6b7-65fe-4321-a326-26b5caa9b3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:37.182936 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fce6b7-65fe-4321-a326-26b5caa9b3e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:37.196598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fce6b7-65fe-4321-a326-26b5caa9b3e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:37.198402 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fce6b7-65fe-4321-a326-26b5caa9b3e1 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:37.216744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-a0fce6b7-65fe-4321-a326-26b5caa9b3e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:37.216744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:37.216744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:37.216744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:37.216744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:37.216744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:37.216744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:37.216744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:37.216744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:37.216744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:37.216744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:37.216744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:37.216744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:37.216744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:37.216744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:37.217714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:37.219025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:37.219025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:37.219025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:37.219025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:37.221092 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 319/611] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:37.227141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fce6b7-65fe-4321-a326-26b5caa9b3e1 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:37.253985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:37.270765 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:37.281840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76925517-be9c-40e9-a154-317405952c50 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:37.324394 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2fff8-3c19-418c-a3f9-a83f251d7b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:37.325284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2fff8-3c19-418c-a3f9-a83f251d7b61 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:37.325564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2fff8-3c19-418c-a3f9-a83f251d7b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:37.325836 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2fff8-3c19-418c-a3f9-a83f251d7b61 None admin] PATH_INFO: `/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/abc51e98d0054609b6ce10723f70bf49/roles/ea9f1b43d91c4665ba5af180f55c663c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:37.336792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fce6b7-65fe-4321-a326-26b5caa9b3e1 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:37.342452 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2fff8-3c19-418c-a3f9-a83f251d7b61 None admin] RBAC: Authorizing `identity:create_grant(project_id=50b78e16c86b4e6cac3a725f536a8274, user_id=abc51e98d0054609b6ce10723f70bf49, role_id=ea9f1b43d91c4665ba5af180f55c663c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:37.343908 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2fff8-3c19-418c-a3f9-a83f251d7b61 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:37.366793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 293/612] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:04:37 2022] PUT /identity/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/abc51e98d0054609b6ce10723f70bf49/roles/ea9f1b43d91c4665ba5af180f55c663c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:04:37.374242 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269e4c1-4a5f-4a86-912b-3b043335684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:37.375645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269e4c1-4a5f-4a86-912b-3b043335684b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:37.376166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269e4c1-4a5f-4a86-912b-3b043335684b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:37.376774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269e4c1-4a5f-4a86-912b-3b043335684b None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:37.377845 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269e4c1-4a5f-4a86-912b-3b043335684b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:37.378379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269e4c1-4a5f-4a86-912b-3b043335684b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:37.380038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269e4c1-4a5f-4a86-912b-3b043335684b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:37.395220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 320/613] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:37.402545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2fff8-3c19-418c-a3f9-a83f251d7b61 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:37.541489 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2fff8-3c19-418c-a3f9-a83f251d7b61 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:37.548832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb814766-5f64-4830-8dfb-0b13ec23ccea None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:37.549150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb814766-5f64-4830-8dfb-0b13ec23ccea None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:37.549394 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb814766-5f64-4830-8dfb-0b13ec23ccea None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:37.551129 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 321/614] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:37.556952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26a060-0b88-496d-b113-3d80386902b4 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:37.557236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26a060-0b88-496d-b113-3d80386902b4 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:37.557508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26a060-0b88-496d-b113-3d80386902b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:37.575014 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-fb26a060-0b88-496d-b113-3d80386902b4 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:37.576228 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-fb26a060-0b88-496d-b113-3d80386902b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:37.579885 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdd77f-df99-4e90-bfb3-a1b6c628a5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:37.580686 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdd77f-df99-4e90-bfb3-a1b6c628a5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:37.580996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdd77f-df99-4e90-bfb3-a1b6c628a5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:37.581273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdd77f-df99-4e90-bfb3-a1b6c628a5e3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:37.590350 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdd77f-df99-4e90-bfb3-a1b6c628a5e3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:37.591954 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdd77f-df99-4e90-bfb3-a1b6c628a5e3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:37.608220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c5cdd77f-df99-4e90-bfb3-a1b6c628a5e3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 14:04:37.608220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:37.608220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:37.608220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:37.608220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:37.608220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:37.608220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:37.608220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:37.608220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:37.608220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:37.608220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:37.608220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:37.608220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:37.608220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:37.608220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:37.608220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:37.609244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:37.610233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:37.610233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:37.610233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:37.610233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:37.610233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:37.610233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:37.610233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:37.610233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:37.610233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 14:04:37.610233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:37.615434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 294/615] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:04:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:37.615998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdd77f-df99-4e90-bfb3-a1b6c628a5e3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:37.620591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:37.687140 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 322/616] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:04:37.711591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26a060-0b88-496d-b113-3d80386902b4 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:37.730013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:37.776624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdd77f-df99-4e90-bfb3-a1b6c628a5e3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:37.816526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff93bb-8408-4f1f-9163-d9faf89b1547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:37.818050 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff93bb-8408-4f1f-9163-d9faf89b1547 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:37.818722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff93bb-8408-4f1f-9163-d9faf89b1547 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:37.819203 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff93bb-8408-4f1f-9163-d9faf89b1547 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:37.820586 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff93bb-8408-4f1f-9163-d9faf89b1547 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:37.821088 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff93bb-8408-4f1f-9163-d9faf89b1547 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:37.823019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff93bb-8408-4f1f-9163-d9faf89b1547 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:37.836952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26a060-0b88-496d-b113-3d80386902b4 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:37.850428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 295/617] 10.222.0.99 () {56 vars in 1135 bytes} [Mon Jul 18 14:04:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:37.866241 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff93bb-8408-4f1f-9163-d9faf89b1547 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:37.888267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b9255-263c-4597-aeb0-1689933ec311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:37.889448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b9255-263c-4597-aeb0-1689933ec311 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:37.889922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b9255-263c-4597-aeb0-1689933ec311 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:37.890426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b9255-263c-4597-aeb0-1689933ec311 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:37.913209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b9255-263c-4597-aeb0-1689933ec311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:37.921655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-9c6b9255-263c-4597-aeb0-1689933ec311 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:37.921655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:37.921655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:37.921655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:37.921655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:37.921655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:37.921655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:37.921655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:37.921655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:37.921655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:37.921655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:37.921655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:37.921655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:37.921655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:37.921655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:37.921655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:37.922629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:37.922629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:37.922629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:37.922629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:37.922629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:37.922629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:37.922629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:37.922629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:37.922629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:37.922629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:37.922629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:37.922629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:37.922629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:37.922629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:37.922629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:37.922629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:37.923469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:37.923469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:37.923469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:37.923469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:37.923469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:37.923469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:37.923469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:37.923469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:37.923469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:37.923469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:37.923469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:37.923469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:37.926839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 323/618] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:37.935441 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b9255-263c-4597-aeb0-1689933ec311 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:37.963613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:38.005702 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff93bb-8408-4f1f-9163-d9faf89b1547 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:38.045762 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ecda2-95e4-4e7f-af80-d3cbf16c8cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:38.046608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ecda2-95e4-4e7f-af80-d3cbf16c8cae None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:38.046894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ecda2-95e4-4e7f-af80-d3cbf16c8cae None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:38.047166 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ecda2-95e4-4e7f-af80-d3cbf16c8cae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:38.065060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ecda2-95e4-4e7f-af80-d3cbf16c8cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:38.066564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ecda2-95e4-4e7f-af80-d3cbf16c8cae None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:38.100319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-4d7ecda2-95e4-4e7f-af80-d3cbf16c8cae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:38.100319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:38.100319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:38.100319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:38.100319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:38.100319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:38.100319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:38.100319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:38.100319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:38.100319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:38.100319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:38.100319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:38.100319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:38.100319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:38.100319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:38.101587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:38.102656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:38.102656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:38.102656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:38.102656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:38.103323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 296/619] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:38.111460 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:38.111705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ecda2-95e4-4e7f-af80-d3cbf16c8cae None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:38.159732 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b9255-263c-4597-aeb0-1689933ec311 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:38.227318 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5e4de-ea7f-4f6c-8644-507c1394d90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:38.228387 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5e4de-ea7f-4f6c-8644-507c1394d90c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:38.228872 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5e4de-ea7f-4f6c-8644-507c1394d90c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:38.229355 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5e4de-ea7f-4f6c-8644-507c1394d90c None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:38.230487 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5e4de-ea7f-4f6c-8644-507c1394d90c None admin] RBAC: Adding query filter params (name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:38.231108 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5e4de-ea7f-4f6c-8644-507c1394d90c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:38.232700 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5e4de-ea7f-4f6c-8644-507c1394d90c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:38.258114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 324/620] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:38.263297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5e4de-ea7f-4f6c-8644-507c1394d90c None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:38.304775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ecda2-95e4-4e7f-af80-d3cbf16c8cae None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:38.334543 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:38.372563 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253034ee-ffbb-498d-a368-1fb6549185f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:38.376963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253034ee-ffbb-498d-a368-1fb6549185f9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:38.377471 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253034ee-ffbb-498d-a368-1fb6549185f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:38.377984 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253034ee-ffbb-498d-a368-1fb6549185f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:38.379087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253034ee-ffbb-498d-a368-1fb6549185f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:38.379627 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253034ee-ffbb-498d-a368-1fb6549185f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:38.381375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253034ee-ffbb-498d-a368-1fb6549185f9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:38.410226 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 297/621] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:38.416427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253034ee-ffbb-498d-a368-1fb6549185f9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:38.488565 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5e4de-ea7f-4f6c-8644-507c1394d90c None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:38.560765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f3003-c3e0-4c43-8a3d-035ea3fb0482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:38.561566 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3003-c3e0-4c43-8a3d-035ea3fb0482 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:38.561847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3003-c3e0-4c43-8a3d-035ea3fb0482 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:38.562123 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3003-c3e0-4c43-8a3d-035ea3fb0482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:38.570712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:38.582249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f3003-c3e0-4c43-8a3d-035ea3fb0482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:38.582741 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253034ee-ffbb-498d-a368-1fb6549185f9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:38.583737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f3003-c3e0-4c43-8a3d-035ea3fb0482 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:38.620150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-a86f3003-c3e0-4c43-8a3d-035ea3fb0482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:38.620150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:38.620150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:38.620150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:38.620150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:38.620150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:38.620150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:38.620150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:38.620150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:38.620150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:38.620150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:38.620150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:38.620150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:38.620150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:38.620150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:38.621116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:38.621991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:38.621991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:38.621991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:38.621991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:38.622685 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 325/622] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:38.629797 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f3003-c3e0-4c43-8a3d-035ea3fb0482 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:38.636352 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c00087-c020-4092-a519-00c2a1b39b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:38.637160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c00087-c020-4092-a519-00c2a1b39b23 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:38.637445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c00087-c020-4092-a519-00c2a1b39b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:38.637720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c00087-c020-4092-a519-00c2a1b39b23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:38.652072 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c00087-c020-4092-a519-00c2a1b39b23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:38.653555 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c00087-c020-4092-a519-00c2a1b39b23 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:38.680185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-76c00087-c020-4092-a519-00c2a1b39b23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:38.680185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:38.680185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:38.680185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:38.680185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:38.680185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:38.680185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:38.680185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:38.680185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:38.680185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:38.680185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:38.680185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:38.680185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:38.680185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:38.680185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:38.681162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:38.682051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:38.682051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:38.682051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:38.682051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:38.682051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:38.682051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:38.682051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:38.682051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:38.682051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 298/623] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:38.691316 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c00087-c020-4092-a519-00c2a1b39b23 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:38.763071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f3003-c3e0-4c43-8a3d-035ea3fb0482 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:38.780696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:38.803603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fec02-e6cb-4bcf-8cd1-e68098e2965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:38.804272 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fec02-e6cb-4bcf-8cd1-e68098e2965c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:38.804557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fec02-e6cb-4bcf-8cd1-e68098e2965c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:38.804834 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fec02-e6cb-4bcf-8cd1-e68098e2965c None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:38.805570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fec02-e6cb-4bcf-8cd1-e68098e2965c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:38.805876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fec02-e6cb-4bcf-8cd1-e68098e2965c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:38.808723 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fec02-e6cb-4bcf-8cd1-e68098e2965c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:38.833722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 326/624] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:38.839247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fec02-e6cb-4bcf-8cd1-e68098e2965c None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:38.919196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c00087-c020-4092-a519-00c2a1b39b23 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:38.945079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:38.989579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077412a-cd79-43fa-8e10-cfc6ca670946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:38.990648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077412a-cd79-43fa-8e10-cfc6ca670946 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:38.991166 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077412a-cd79-43fa-8e10-cfc6ca670946 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:38.991640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077412a-cd79-43fa-8e10-cfc6ca670946 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:38.992693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077412a-cd79-43fa-8e10-cfc6ca670946 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:38.993219 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077412a-cd79-43fa-8e10-cfc6ca670946 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:38.994949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077412a-cd79-43fa-8e10-cfc6ca670946 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:39.011462 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 299/625] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:39.013935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798caa1f-22c9-4c44-8588-a8e6cd97e1d3 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:39.014497 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798caa1f-22c9-4c44-8588-a8e6cd97e1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:39.015142 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798caa1f-22c9-4c44-8588-a8e6cd97e1d3 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:39.017605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 300/626] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:39.018575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798caa1f-22c9-4c44-8588-a8e6cd97e1d3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:39.025854 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fec02-e6cb-4bcf-8cd1-e68098e2965c None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:39.061134 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31529da4-1647-4a68-8878-91eb5d9163a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:39.061929 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31529da4-1647-4a68-8878-91eb5d9163a8 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:39.062208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31529da4-1647-4a68-8878-91eb5d9163a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:39.062520 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31529da4-1647-4a68-8878-91eb5d9163a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:39.070857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31529da4-1647-4a68-8878-91eb5d9163a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:39.072306 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31529da4-1647-4a68-8878-91eb5d9163a8 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:39.087408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-31529da4-1647-4a68-8878-91eb5d9163a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:04:39.087408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:39.087408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:39.087408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:39.087408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:39.087408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:39.087408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:39.087408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:39.087408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:39.087408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:39.087408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:39.087408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:39.087408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:39.087408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:39.087408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:39.087408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:39.088433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:39.089490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:39.089490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:39.089490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:39.089490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:39.089490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:39.089490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:39.089490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:39.089490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:39.089490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:04:39.089490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:39.089490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 327/627] 10.222.0.99 () {56 vars in 1093 bytes} [Mon Jul 18 14:04:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:39.090662 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2ba28-60a1-40ae-b505-0bda4cf58b1c None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:39.090662 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2ba28-60a1-40ae-b505-0bda4cf58b1c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:39.090907 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2ba28-60a1-40ae-b505-0bda4cf58b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:39.107567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-70c2ba28-60a1-40ae-b505-0bda4cf58b1c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:39.108743 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-70c2ba28-60a1-40ae-b505-0bda4cf58b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:39.151041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:39.163098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798caa1f-22c9-4c44-8588-a8e6cd97e1d3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:39.197449 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c57dc-0e55-4f2f-9d56-240c4daa85db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:39.198331 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c57dc-0e55-4f2f-9d56-240c4daa85db None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:39.198718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c57dc-0e55-4f2f-9d56-240c4daa85db None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:39.198923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c57dc-0e55-4f2f-9d56-240c4daa85db None admin] PATH_INFO: `/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/55fe1a286c2045d5bcd49895a878a3bf/roles/ea9f1b43d91c4665ba5af180f55c663c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:39.205856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 328/628] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:39.207120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2ba28-60a1-40ae-b505-0bda4cf58b1c None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:39.236010 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c57dc-0e55-4f2f-9d56-240c4daa85db None admin] RBAC: Authorizing `identity:create_grant(project_id=50b78e16c86b4e6cac3a725f536a8274, user_id=55fe1a286c2045d5bcd49895a878a3bf, role_id=ea9f1b43d91c4665ba5af180f55c663c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:39.237494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c57dc-0e55-4f2f-9d56-240c4daa85db None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:39.253008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:39.256550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 301/629] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:04:39 2022] PUT /identity/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/55fe1a286c2045d5bcd49895a878a3bf/roles/ea9f1b43d91c4665ba5af180f55c663c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:04:39.257571 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c57dc-0e55-4f2f-9d56-240c4daa85db None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:39.325106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2ba28-60a1-40ae-b505-0bda4cf58b1c None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:39.366761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931193f-efa8-4dee-9f36-4d0da76f35cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:39.367950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931193f-efa8-4dee-9f36-4d0da76f35cc None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:39.368469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931193f-efa8-4dee-9f36-4d0da76f35cc None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:39.368953 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931193f-efa8-4dee-9f36-4d0da76f35cc None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:39.370158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931193f-efa8-4dee-9f36-4d0da76f35cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:39.370841 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931193f-efa8-4dee-9f36-4d0da76f35cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:39.372705 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931193f-efa8-4dee-9f36-4d0da76f35cc None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:39.388095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c57dc-0e55-4f2f-9d56-240c4daa85db None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:39.394762 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 329/630] 10.222.0.99 () {56 vars in 1133 bytes} [Mon Jul 18 14:04:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:39.403734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931193f-efa8-4dee-9f36-4d0da76f35cc None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:39.439506 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56903b-0e13-4980-a3c9-c8668610c515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:39.440265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56903b-0e13-4980-a3c9-c8668610c515 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:39.440550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56903b-0e13-4980-a3c9-c8668610c515 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:39.440827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56903b-0e13-4980-a3c9-c8668610c515 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:39.460642 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56903b-0e13-4980-a3c9-c8668610c515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:39.468485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-0c56903b-0e13-4980-a3c9-c8668610c515 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:39.468485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:39.468485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:39.468485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:39.468485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:39.468485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:39.468485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:39.468485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:39.468485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:39.468485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:39.468485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:39.468485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:39.468485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:39.468485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:39.468485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:39.468485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:39.469428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:39.469428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:39.469428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:39.469428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:39.469428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:39.469428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:39.469428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:39.469428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:39.469428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:39.469428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:39.469428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:39.469428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:39.469428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:39.469428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:39.469428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:39.469428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:39.470381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:39.470381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:39.470381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:39.470381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:39.470381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:39.470381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:39.470381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:39.470381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:39.470381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:39.470381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:39.470381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:39.470381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:39.474748 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 302/631] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:39.476249 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885be15-8b8d-4202-9f3b-196793aa2aae None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:39.476532 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885be15-8b8d-4202-9f3b-196793aa2aae None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:39.476809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885be15-8b8d-4202-9f3b-196793aa2aae None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:39.478591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 303/632] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:39.480235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885be15-8b8d-4202-9f3b-196793aa2aae None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:39.483149 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:39.524650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:39.531718 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931193f-efa8-4dee-9f36-4d0da76f35cc None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:39.568454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ee1e9-c667-45a1-9f66-60ea0ba19b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:39.569419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ee1e9-c667-45a1-9f66-60ea0ba19b45 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:39.569879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ee1e9-c667-45a1-9f66-60ea0ba19b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:39.570328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ee1e9-c667-45a1-9f66-60ea0ba19b45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:39.607652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0885be15-8b8d-4202-9f3b-196793aa2aae None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:39.643339 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514e7da-f2a3-42a3-9ce7-3970316b7381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:39.644321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514e7da-f2a3-42a3-9ce7-3970316b7381 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:39.644785 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514e7da-f2a3-42a3-9ce7-3970316b7381 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:39.645232 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514e7da-f2a3-42a3-9ce7-3970316b7381 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:39.646185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514e7da-f2a3-42a3-9ce7-3970316b7381 None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:39.646718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514e7da-f2a3-42a3-9ce7-3970316b7381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:39.648281 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514e7da-f2a3-42a3-9ce7-3970316b7381 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:39.657136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ee1e9-c667-45a1-9f66-60ea0ba19b45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:39.657729 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 304/633] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:39.659014 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ee1e9-c667-45a1-9f66-60ea0ba19b45 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:39.659416 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef221ec-448d-469d-a6bf-5017978014d2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:39.659863 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef221ec-448d-469d-a6bf-5017978014d2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:39.660341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef221ec-448d-469d-a6bf-5017978014d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:39.688223 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6ef221ec-448d-469d-a6bf-5017978014d2 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:39.690031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6ef221ec-448d-469d-a6bf-5017978014d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:39.772159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:39.775100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:39.790598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 305/635] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:39.790598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef221ec-448d-469d-a6bf-5017978014d2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:39.791089 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 330/635] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:39.792250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ee1e9-c667-45a1-9f66-60ea0ba19b45 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:39.912656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ee1e9-c667-45a1-9f66-60ea0ba19b45 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:39.914261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef221ec-448d-469d-a6bf-5017978014d2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:39.950100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb79d6-0417-4eca-abbd-7602c7b8047c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:39.951232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb79d6-0417-4eca-abbd-7602c7b8047c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:39.951694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb79d6-0417-4eca-abbd-7602c7b8047c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:39.952173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb79d6-0417-4eca-abbd-7602c7b8047c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:39.952437 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eea87-c425-4f2a-ae2b-5c3fef71ee1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:39.953240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eea87-c425-4f2a-ae2b-5c3fef71ee1c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:39.953524 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eea87-c425-4f2a-ae2b-5c3fef71ee1c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:39.953802 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eea87-c425-4f2a-ae2b-5c3fef71ee1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:39.963987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb79d6-0417-4eca-abbd-7602c7b8047c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:39.965706 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb79d6-0417-4eca-abbd-7602c7b8047c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:39.967375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741eea87-c425-4f2a-ae2b-5c3fef71ee1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:39.969017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741eea87-c425-4f2a-ae2b-5c3fef71ee1c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:39.986333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-34bb79d6-0417-4eca-abbd-7602c7b8047c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:39.986333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:39.986333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:39.986333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:39.986333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:39.986333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:39.986333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:39.986333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:39.986333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:39.986333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:39.986333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:39.986333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:39.986333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:39.986333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:39.986333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:39.987317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:39.988194 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:39.988194 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:39.988194 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:39.988194 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:39.988410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-741eea87-c425-4f2a-ae2b-5c3fef71ee1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:39.988410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:39.988410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:39.988410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:39.988410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:39.988410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:39.988410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:39.988410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:39.988410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:39.988410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:39.988410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:39.988410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:39.988410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:39.988410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:39.988410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:39.989205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:39.990321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:39.990321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:39.990321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:39.990321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:39.990321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 306/636] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:39.990622 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eea87-c425-4f2a-ae2b-5c3fef71ee1c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:39.996436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 331/637] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:39.996436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f50bfa-7ed6-4b8b-bf24-80ad4dcfd7af None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:39.996436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f50bfa-7ed6-4b8b-bf24-80ad4dcfd7af None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:39.996436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f50bfa-7ed6-4b8b-bf24-80ad4dcfd7af None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:39.996436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 332/638] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:39.996436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f50bfa-7ed6-4b8b-bf24-80ad4dcfd7af None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:40.046702 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:40.047121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:40.102810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eea87-c425-4f2a-ae2b-5c3fef71ee1c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:40.103812 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f50bfa-7ed6-4b8b-bf24-80ad4dcfd7af None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:40.147602 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33017665-d9c5-46d6-98d3-ebd316752c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:40.148407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33017665-d9c5-46d6-98d3-ebd316752c23 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:40.148716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33017665-d9c5-46d6-98d3-ebd316752c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:40.149469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33017665-d9c5-46d6-98d3-ebd316752c23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:40.153674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478ec70-23e4-4ee8-b453-352308d9dd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:40.154688 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478ec70-23e4-4ee8-b453-352308d9dd33 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:40.155198 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478ec70-23e4-4ee8-b453-352308d9dd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:40.155631 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478ec70-23e4-4ee8-b453-352308d9dd33 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:40.156503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478ec70-23e4-4ee8-b453-352308d9dd33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:40.156968 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478ec70-23e4-4ee8-b453-352308d9dd33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:40.158593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478ec70-23e4-4ee8-b453-352308d9dd33 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:40.162005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33017665-d9c5-46d6-98d3-ebd316752c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:40.169806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-33017665-d9c5-46d6-98d3-ebd316752c23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:40.169806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:40.169806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:40.169806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:40.169806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:40.169806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:40.169806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:40.169806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:40.169806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:40.169806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:40.169806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:40.169806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:40.169806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:40.169806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:40.169806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:40.169806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:40.170898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:40.170898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:40.170898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:40.170898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:40.170898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:40.170898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:40.170898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:40.170898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:40.170898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:40.170898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:40.170898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:40.170898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:40.170898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:40.170898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:40.170898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:40.170898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:40.171738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:40.171738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:40.171738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:40.171738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:40.171738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:40.171738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:40.171738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:40.171738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:40.171738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:40.171738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:40.171738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:40.171738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:40.171738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 307/639] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:40.172440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33017665-d9c5-46d6-98d3-ebd316752c23 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:40.177826 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 333/640] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:40.177826 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d3844-f867-45a6-adf9-7abedc17ae05 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:40.177826 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d3844-f867-45a6-adf9-7abedc17ae05 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:40.177826 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d3844-f867-45a6-adf9-7abedc17ae05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:40.194844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-d42d3844-f867-45a6-adf9-7abedc17ae05 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:40.196037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d42d3844-f867-45a6-adf9-7abedc17ae05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:40.283105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 334/641] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:40.287419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d3844-f867-45a6-adf9-7abedc17ae05 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:40.302076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33017665-d9c5-46d6-98d3-ebd316752c23 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:40.309965 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:40.344657 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:40.349416 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0c483-a769-4297-87cf-2c35788b5030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:40.350105 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0c483-a769-4297-87cf-2c35788b5030 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:40.350525 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0c483-a769-4297-87cf-2c35788b5030 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:40.350725 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0c483-a769-4297-87cf-2c35788b5030 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:40.351567 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0c483-a769-4297-87cf-2c35788b5030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:40.352041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0c483-a769-4297-87cf-2c35788b5030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:40.353133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0c483-a769-4297-87cf-2c35788b5030 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:40.366432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 308/642] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:40.366432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0c483-a769-4297-87cf-2c35788b5030 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:40.421956 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d3844-f867-45a6-adf9-7abedc17ae05 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:40.457904 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e1dbc-91bd-4f84-9e3b-54a46b0fb767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:40.458484 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e1dbc-91bd-4f84-9e3b-54a46b0fb767 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:40.458780 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e1dbc-91bd-4f84-9e3b-54a46b0fb767 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:40.459073 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e1dbc-91bd-4f84-9e3b-54a46b0fb767 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:40.459809 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e1dbc-91bd-4f84-9e3b-54a46b0fb767 None admin] RBAC: Adding query filter params (name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:40.460132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e1dbc-91bd-4f84-9e3b-54a46b0fb767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:40.461511 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e1dbc-91bd-4f84-9e3b-54a46b0fb767 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:40.472187 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 335/643] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:40.477662 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e1dbc-91bd-4f84-9e3b-54a46b0fb767 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:40.484045 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0c483-a769-4297-87cf-2c35788b5030 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:40.522315 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c38ba-7b11-44dd-bfbc-56572fdafc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:40.523600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c38ba-7b11-44dd-bfbc-56572fdafc1f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:40.524062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c38ba-7b11-44dd-bfbc-56572fdafc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:40.524514 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c38ba-7b11-44dd-bfbc-56572fdafc1f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:40.533106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c38ba-7b11-44dd-bfbc-56572fdafc1f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:40.534755 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c38ba-7b11-44dd-bfbc-56572fdafc1f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:40.549466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-553c38ba-7b11-44dd-bfbc-56572fdafc1f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 14:04:40.549466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:40.549466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:40.549466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:40.549466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:40.549466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:40.549466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:40.549466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:40.549466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:40.549466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:40.549466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:40.549466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:40.549466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:40.549466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:40.549466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:40.549466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:40.550582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:40.551584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:40.551584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:40.551584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:40.551584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:40.551584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:40.551584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:40.551584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:40.551584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:40.551584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 14:04:40.551584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:40.551584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 309/644] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:40.551584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c38ba-7b11-44dd-bfbc-56572fdafc1f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:40.583673 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:40.586819 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:40.587961 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e1dbc-91bd-4f84-9e3b-54a46b0fb767 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:40.627097 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178c01a-94ac-4e1d-ae92-b64b605efaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:40.627901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178c01a-94ac-4e1d-ae92-b64b605efaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:40.628185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178c01a-94ac-4e1d-ae92-b64b605efaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:40.628450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178c01a-94ac-4e1d-ae92-b64b605efaa5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:40.639240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178c01a-94ac-4e1d-ae92-b64b605efaa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:40.646959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-3178c01a-94ac-4e1d-ae92-b64b605efaa5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:40.646959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:40.646959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:40.646959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:40.646959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:40.646959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:40.646959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:40.646959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:40.646959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:40.646959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:40.646959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:40.646959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:40.646959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:40.646959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:40.646959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:40.646959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:40.648096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:40.648096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:40.648096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:40.648096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:40.648096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:40.648096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:40.648096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:40.648096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:40.648096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:40.648096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:40.648096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:40.648096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:40.648096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:40.648096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:40.648096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:40.648096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:40.649095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:40.649095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:40.649095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:40.649095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:40.649095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:40.649095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:40.649095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:40.649095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:40.649095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:40.649095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:40.649095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:40.649095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:40.649095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 336/645] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:40.649095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178c01a-94ac-4e1d-ae92-b64b605efaa5 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:40.671559 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c38ba-7b11-44dd-bfbc-56572fdafc1f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:40.707841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce62d4-e3a9-4827-b81e-d62c2f976836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:40.708732 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce62d4-e3a9-4827-b81e-d62c2f976836 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:40.709035 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce62d4-e3a9-4827-b81e-d62c2f976836 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:40.709288 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce62d4-e3a9-4827-b81e-d62c2f976836 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:40.716604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce62d4-e3a9-4827-b81e-d62c2f976836 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:40.718194 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce62d4-e3a9-4827-b81e-d62c2f976836 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:40.732747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-fcce62d4-e3a9-4827-b81e-d62c2f976836 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:40.732747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:40.732747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:40.732747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:40.732747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:40.732747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:40.732747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:40.732747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:40.732747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:40.732747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:40.732747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:40.732747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:40.732747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:40.732747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:40.732747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:40.733643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:40.734947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:40.734947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:40.734947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:40.734947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:40.734947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:40.734947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:40.734947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:40.734947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:40.734947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 310/646] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:40.734947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce62d4-e3a9-4827-b81e-d62c2f976836 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:40.758036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178c01a-94ac-4e1d-ae92-b64b605efaa5 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:40.795418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a17346-fbc1-4c12-9075-c8762506e40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:40.796661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a17346-fbc1-4c12-9075-c8762506e40a None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:40.796947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a17346-fbc1-4c12-9075-c8762506e40a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:40.797482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a17346-fbc1-4c12-9075-c8762506e40a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:40.811249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a17346-fbc1-4c12-9075-c8762506e40a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:40.813143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a17346-fbc1-4c12-9075-c8762506e40a None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:40.821807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:40.836440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce62d4-e3a9-4827-b81e-d62c2f976836 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:40.836773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-48a17346-fbc1-4c12-9075-c8762506e40a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:40.836773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:40.836773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:40.836773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:40.836773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:40.836773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:40.836773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:40.836773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:40.836773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:40.836773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:40.836773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:40.836773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:40.836773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:40.836773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:40.836773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:40.837670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:40.838616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:40.838616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:40.838616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:40.838616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:40.844482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 337/647] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:40.844482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a17346-fbc1-4c12-9075-c8762506e40a None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:40.855338 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:40.884885 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cccf3-db88-4ae6-9d74-574bb91b8a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:40.885656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cccf3-db88-4ae6-9d74-574bb91b8a05 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:40.886009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cccf3-db88-4ae6-9d74-574bb91b8a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:40.886354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cccf3-db88-4ae6-9d74-574bb91b8a05 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:40.887314 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cccf3-db88-4ae6-9d74-574bb91b8a05 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:40.887690 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cccf3-db88-4ae6-9d74-574bb91b8a05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:40.889193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cccf3-db88-4ae6-9d74-574bb91b8a05 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:40.908352 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 311/648] 10.222.0.99 () {56 vars in 1137 bytes} [Mon Jul 18 14:04:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:40.913602 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cccf3-db88-4ae6-9d74-574bb91b8a05 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:40.951002 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a17346-fbc1-4c12-9075-c8762506e40a None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:40.987845 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f42561-b709-4cc4-a451-ec4c3ba0ac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:40.988773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f42561-b709-4cc4-a451-ec4c3ba0ac37 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:40.989206 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f42561-b709-4cc4-a451-ec4c3ba0ac37 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:40.989637 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f42561-b709-4cc4-a451-ec4c3ba0ac37 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:40.990578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f42561-b709-4cc4-a451-ec4c3ba0ac37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:40.990878 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f42561-b709-4cc4-a451-ec4c3ba0ac37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:40.992275 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f42561-b709-4cc4-a451-ec4c3ba0ac37 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:41.006736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 338/649] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:41.006736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f42561-b709-4cc4-a451-ec4c3ba0ac37 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:41.016891 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cccf3-db88-4ae6-9d74-574bb91b8a05 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:41.052179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b855b6-c6b3-43dd-9fe0-7b29a3376abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:41.053086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b855b6-c6b3-43dd-9fe0-7b29a3376abc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:41.053368 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b855b6-c6b3-43dd-9fe0-7b29a3376abc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:41.053641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b855b6-c6b3-43dd-9fe0-7b29a3376abc None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:41.054459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b855b6-c6b3-43dd-9fe0-7b29a3376abc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:41.054770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b855b6-c6b3-43dd-9fe0-7b29a3376abc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:41.056282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b855b6-c6b3-43dd-9fe0-7b29a3376abc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:41.068966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 312/650] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:41.070076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b855b6-c6b3-43dd-9fe0-7b29a3376abc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:41.075032 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:41.091751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:41.120362 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f42561-b709-4cc4-a451-ec4c3ba0ac37 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:41.162865 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524032c-cb85-4c99-871f-c70349845256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:41.164103 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524032c-cb85-4c99-871f-c70349845256 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:41.164445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524032c-cb85-4c99-871f-c70349845256 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:41.164725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524032c-cb85-4c99-871f-c70349845256 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:41.165781 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524032c-cb85-4c99-871f-c70349845256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:41.166241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524032c-cb85-4c99-871f-c70349845256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:41.168287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524032c-cb85-4c99-871f-c70349845256 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:41.177598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b855b6-c6b3-43dd-9fe0-7b29a3376abc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:41.181880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 339/651] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:41.183557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524032c-cb85-4c99-871f-c70349845256 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:41.223542 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154cd66-cca2-4460-8142-ede55c089ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:41.224607 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154cd66-cca2-4460-8142-ede55c089ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:41.225065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154cd66-cca2-4460-8142-ede55c089ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:41.225752 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154cd66-cca2-4460-8142-ede55c089ae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:41.297987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524032c-cb85-4c99-871f-c70349845256 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:41.307849 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154cd66-cca2-4460-8142-ede55c089ae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:41.309327 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154cd66-cca2-4460-8142-ede55c089ae1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:41.312807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:41.335177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9ab1e-fed7-4015-9653-1e3c1d90d8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:41.335979 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9ab1e-fed7-4015-9653-1e3c1d90d8ad None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:41.336258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9ab1e-fed7-4015-9653-1e3c1d90d8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:41.336533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9ab1e-fed7-4015-9653-1e3c1d90d8ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:41.338610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:41.349179 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9ab1e-fed7-4015-9653-1e3c1d90d8ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:41.350657 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9ab1e-fed7-4015-9653-1e3c1d90d8ad None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:41.368550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-87d9ab1e-fed7-4015-9653-1e3c1d90d8ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:41.368550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:41.368550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:41.368550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:41.368550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:41.368550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:41.368550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:41.368550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:41.368550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:41.368550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:41.368550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:41.368550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:41.368550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:41.368550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:41.368550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:41.369479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:41.370343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:41.370343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:41.370343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:41.370343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:41.370343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 340/652] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:41.370757 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9ab1e-fed7-4015-9653-1e3c1d90d8ad None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:41.418782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 313/653] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:41.419686 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154cd66-cca2-4460-8142-ede55c089ae1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:41.472567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9ab1e-fed7-4015-9653-1e3c1d90d8ad None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:41.506896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362250e5-33b0-422c-9f4b-bc6317f89afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:41.507554 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362250e5-33b0-422c-9f4b-bc6317f89afc None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:41.507838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362250e5-33b0-422c-9f4b-bc6317f89afc None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:41.508113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362250e5-33b0-422c-9f4b-bc6317f89afc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:41.508945 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362250e5-33b0-422c-9f4b-bc6317f89afc None admin] RBAC: Adding query filter params (role.id=ea9f1b43d91c4665ba5af180f55c663c, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=b1b66b55e0374152828913910c4002f4) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:41.509257 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362250e5-33b0-422c-9f4b-bc6317f89afc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:41.510737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362250e5-33b0-422c-9f4b-bc6317f89afc None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:41.515777 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154cd66-cca2-4460-8142-ede55c089ae1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:41.516549 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 341/654] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:04:41 2022] GET /identity/v3/role_assignments?user.id=b1b66b55e0374152828913910c4002f4&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=ea9f1b43d91c4665ba5af180f55c663c => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:41.517423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362250e5-33b0-422c-9f4b-bc6317f89afc None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:41.519009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:41.559173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a66a57-af63-45d6-94c6-ce612dd7d02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:41.559891 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a66a57-af63-45d6-94c6-ce612dd7d02c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:41.560175 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a66a57-af63-45d6-94c6-ce612dd7d02c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:41.560442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a66a57-af63-45d6-94c6-ce612dd7d02c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:41.569416 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a66a57-af63-45d6-94c6-ce612dd7d02c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:41.570978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a66a57-af63-45d6-94c6-ce612dd7d02c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:41.578804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:41.588017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-79a66a57-af63-45d6-94c6-ce612dd7d02c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 14:04:41.588017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:41.588017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:41.588017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:41.588017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:41.588017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:41.588017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:41.588017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:41.588017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:41.588017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:41.588017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:41.588017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:41.588017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:41.588017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:41.588017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:41.588017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:41.589230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:41.590411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:41.590411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:41.590411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:41.590411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:41.590411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:41.590411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:41.590411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:41.590411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:41.590411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 14:04:41.590411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:41.591457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 314/655] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:41.592852 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24311856-8761-4320-82cc-79378ea02ece None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:41.593142 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24311856-8761-4320-82cc-79378ea02ece None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:41.593414 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24311856-8761-4320-82cc-79378ea02ece None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:41.599533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 315/656] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:41.599533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24311856-8761-4320-82cc-79378ea02ece None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:41.644802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362250e5-33b0-422c-9f4b-bc6317f89afc None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:41.681977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ab635-527a-4c4c-8632-b0f910934e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:41.682955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ab635-527a-4c4c-8632-b0f910934e93 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:41.683408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ab635-527a-4c4c-8632-b0f910934e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:41.683857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ab635-527a-4c4c-8632-b0f910934e93 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:41.684623 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ab635-527a-4c4c-8632-b0f910934e93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:41.684936 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ab635-527a-4c4c-8632-b0f910934e93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:41.686323 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ab635-527a-4c4c-8632-b0f910934e93 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:41.699773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 342/657] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:41.700456 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ab635-527a-4c4c-8632-b0f910934e93 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:41.720724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24311856-8761-4320-82cc-79378ea02ece None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:41.761802 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bc35c-d8f1-48a1-bbc8-a8babc1d4675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:41.762788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bc35c-d8f1-48a1-bbc8-a8babc1d4675 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:41.763070 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bc35c-d8f1-48a1-bbc8-a8babc1d4675 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:41.763345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bc35c-d8f1-48a1-bbc8-a8babc1d4675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:41.773824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bc35c-d8f1-48a1-bbc8-a8babc1d4675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:41.775354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bc35c-d8f1-48a1-bbc8-a8babc1d4675 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:41.793810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-7d3bc35c-d8f1-48a1-bbc8-a8babc1d4675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:41.793810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:41.793810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:41.793810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:41.793810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:41.793810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:41.793810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:41.793810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:41.793810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:41.793810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:41.793810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:41.793810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:41.793810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:41.793810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:41.793810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:41.794787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:41.795679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:41.795679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:41.795679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:41.795679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:41.798468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 316/658] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:41.799991 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f8014-86ad-4b38-a6d5-e060dbb47bdf None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:41.800427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f8014-86ad-4b38-a6d5-e060dbb47bdf None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:41.800701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f8014-86ad-4b38-a6d5-e060dbb47bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:41.814041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ab635-527a-4c4c-8632-b0f910934e93 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:41.816942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-dd9f8014-86ad-4b38-a6d5-e060dbb47bdf None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:41.818164 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dd9f8014-86ad-4b38-a6d5-e060dbb47bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:41.826674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:41.829656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:41.853171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb759a4-89de-4a2c-a298-54186a61eb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:41.853960 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb759a4-89de-4a2c-a298-54186a61eb3a None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:41.854246 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb759a4-89de-4a2c-a298-54186a61eb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:41.855181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb759a4-89de-4a2c-a298-54186a61eb3a None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:41.855400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb759a4-89de-4a2c-a298-54186a61eb3a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:41.855726 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb759a4-89de-4a2c-a298-54186a61eb3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:41.857144 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb759a4-89de-4a2c-a298-54186a61eb3a None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:41.876162 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 343/659] 10.222.0.99 () {56 vars in 1137 bytes} [Mon Jul 18 14:04:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:41.881334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb759a4-89de-4a2c-a298-54186a61eb3a None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:41.898410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 317/660] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:41.898410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f8014-86ad-4b38-a6d5-e060dbb47bdf None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:41.993348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb759a4-89de-4a2c-a298-54186a61eb3a None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:41.993942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f8014-86ad-4b38-a6d5-e060dbb47bdf None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:42.027371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d73fb-5bdf-48ee-b6bf-d6f5422653a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:42.027709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2019a-1fe4-4862-8b52-bad2b923aab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:42.028171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d73fb-5bdf-48ee-b6bf-d6f5422653a8 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:42.028337 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2019a-1fe4-4862-8b52-bad2b923aab8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:42.028435 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d73fb-5bdf-48ee-b6bf-d6f5422653a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:42.028615 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2019a-1fe4-4862-8b52-bad2b923aab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:42.028708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d73fb-5bdf-48ee-b6bf-d6f5422653a8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:42.028873 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2019a-1fe4-4862-8b52-bad2b923aab8 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:42.029579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2019a-1fe4-4862-8b52-bad2b923aab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:42.029883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2019a-1fe4-4862-8b52-bad2b923aab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:42.031301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2019a-1fe4-4862-8b52-bad2b923aab8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:42.036229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d73fb-5bdf-48ee-b6bf-d6f5422653a8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:42.038527 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d73fb-5bdf-48ee-b6bf-d6f5422653a8 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:42.044874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 318/661] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:42.045204 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2019a-1fe4-4862-8b52-bad2b923aab8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:42.054322 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:42.057764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-397d73fb-5bdf-48ee-b6bf-d6f5422653a8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 14:04:42.057764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:42.057764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:42.057764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:42.057764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:42.057764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:42.057764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:42.057764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:42.057764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:42.057764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:42.057764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:42.057764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:42.057764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:42.057764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:42.057764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:42.057764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:42.059208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:42.060352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:42.060352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:42.060352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:42.060352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:42.060352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:42.060352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:42.060352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:42.060352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:42.060352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 14:04:42.060352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:42.063699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 344/662] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:42.064313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d73fb-5bdf-48ee-b6bf-d6f5422653a8 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:42.091910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:42.162403 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2019a-1fe4-4862-8b52-bad2b923aab8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:42.173048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d73fb-5bdf-48ee-b6bf-d6f5422653a8 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:42.198236 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9507477-b90e-4c3c-80a5-7497cb3d8844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:42.198911 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9507477-b90e-4c3c-80a5-7497cb3d8844 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:42.199186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9507477-b90e-4c3c-80a5-7497cb3d8844 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:42.199459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9507477-b90e-4c3c-80a5-7497cb3d8844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:42.208277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211deb1-75a7-48e4-933c-8a08d3a659bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:42.209074 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211deb1-75a7-48e4-933c-8a08d3a659bf None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:42.209363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211deb1-75a7-48e4-933c-8a08d3a659bf None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:42.209621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211deb1-75a7-48e4-933c-8a08d3a659bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:42.220033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211deb1-75a7-48e4-933c-8a08d3a659bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:42.227829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-5211deb1-75a7-48e4-933c-8a08d3a659bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:42.227829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:42.227829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:42.227829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:42.227829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:42.227829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:42.227829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:42.227829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:42.227829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:42.227829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:42.227829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:42.227829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:42.227829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:42.227829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:42.227829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:42.227829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:42.228763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:42.228763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:42.228763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:42.228763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:42.228763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:42.228763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:42.228763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:42.228763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:42.228763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:42.228763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:42.228763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:42.228763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:42.228763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:42.228763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:42.228763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:42.228763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:42.229574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:42.229574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:42.229574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:42.229574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:42.229574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:42.229574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:42.229574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:42.229574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:42.229574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:42.229574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:42.229574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:42.229574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:42.229574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 345/663] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:42.230252 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211deb1-75a7-48e4-933c-8a08d3a659bf None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:42.274148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9507477-b90e-4c3c-80a5-7497cb3d8844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:42.275671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9507477-b90e-4c3c-80a5-7497cb3d8844 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:42.284187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:42.327079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:42.340589 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211deb1-75a7-48e4-933c-8a08d3a659bf None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:42.376803 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 319/664] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:42.377874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9507477-b90e-4c3c-80a5-7497cb3d8844 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:42.383744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71500a-bd62-4f05-9897-0e69d55f45f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:42.384624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71500a-bd62-4f05-9897-0e69d55f45f1 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:42.384973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71500a-bd62-4f05-9897-0e69d55f45f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:42.385313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71500a-bd62-4f05-9897-0e69d55f45f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:42.392446 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71500a-bd62-4f05-9897-0e69d55f45f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:42.394155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71500a-bd62-4f05-9897-0e69d55f45f1 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:42.408876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-3b71500a-bd62-4f05-9897-0e69d55f45f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:42.408876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:42.408876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:42.408876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:42.408876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:42.408876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:42.408876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:42.408876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:42.408876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:42.408876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:42.408876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:42.408876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:42.408876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:42.408876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:42.408876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:42.409926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:42.410971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:42.410971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:42.410971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:42.410971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:42.410971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:42.410971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:42.410971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:42.410971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:42.410971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 346/665] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:42.415244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71500a-bd62-4f05-9897-0e69d55f45f1 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:42.484975 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9507477-b90e-4c3c-80a5-7497cb3d8844 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:42.492928 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:42.521602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71500a-bd62-4f05-9897-0e69d55f45f1 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:42.522278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6010d4-6dbb-499e-989b-852d6a5a99ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:42.523087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6010d4-6dbb-499e-989b-852d6a5a99ac None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:42.523543 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6010d4-6dbb-499e-989b-852d6a5a99ac None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:42.523818 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6010d4-6dbb-499e-989b-852d6a5a99ac None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:42.525438 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6010d4-6dbb-499e-989b-852d6a5a99ac None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:42.525749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6010d4-6dbb-499e-989b-852d6a5a99ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:42.527224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6010d4-6dbb-499e-989b-852d6a5a99ac None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:42.547080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 320/666] 10.222.0.99 () {56 vars in 1139 bytes} [Mon Jul 18 14:04:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:42.552229 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6010d4-6dbb-499e-989b-852d6a5a99ac None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:42.556351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49df3a-7bee-4d39-ab32-61590051b828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:42.557142 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49df3a-7bee-4d39-ab32-61590051b828 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:42.557517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49df3a-7bee-4d39-ab32-61590051b828 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:42.557885 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49df3a-7bee-4d39-ab32-61590051b828 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:42.558766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49df3a-7bee-4d39-ab32-61590051b828 None admin] RBAC: Adding query filter params (name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:42.559168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49df3a-7bee-4d39-ab32-61590051b828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:42.560774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49df3a-7bee-4d39-ab32-61590051b828 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:42.570252 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 347/667] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:42.571760 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49df3a-7bee-4d39-ab32-61590051b828 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:42.587030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:42.667669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6010d4-6dbb-499e-989b-852d6a5a99ac None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:42.680319 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49df3a-7bee-4d39-ab32-61590051b828 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:42.705631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c8477-295f-40cf-8ffb-1795e99d0b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:42.706456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c8477-295f-40cf-8ffb-1795e99d0b04 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:42.706738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c8477-295f-40cf-8ffb-1795e99d0b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:42.707012 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c8477-295f-40cf-8ffb-1795e99d0b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:42.716873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541e1e0-36c5-4c5c-bb41-6c74f527821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:42.717545 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541e1e0-36c5-4c5c-bb41-6c74f527821f None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:42.717656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c8477-295f-40cf-8ffb-1795e99d0b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:42.717811 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541e1e0-36c5-4c5c-bb41-6c74f527821f None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:42.718076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541e1e0-36c5-4c5c-bb41-6c74f527821f None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:42.718892 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541e1e0-36c5-4c5c-bb41-6c74f527821f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:42.719059 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c8477-295f-40cf-8ffb-1795e99d0b04 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:42.719217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541e1e0-36c5-4c5c-bb41-6c74f527821f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:42.720874 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541e1e0-36c5-4c5c-bb41-6c74f527821f None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:42.738506 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 348/668] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:42.738506 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541e1e0-36c5-4c5c-bb41-6c74f527821f None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:42.738771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-1d1c8477-295f-40cf-8ffb-1795e99d0b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:42.738771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:42.738771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:42.738771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:42.738771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:42.738771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:42.738771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:42.738771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:42.738771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:42.738771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:42.738771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:42.738771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:42.738771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:42.738771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:42.738771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:42.739792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:42.740925 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:42.740925 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:42.740925 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:42.740925 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:42.742803 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 321/669] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:42.743606 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c8477-295f-40cf-8ffb-1795e99d0b04 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:42.762721 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:42.817294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:42.855360 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c8477-295f-40cf-8ffb-1795e99d0b04 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:42.856411 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541e1e0-36c5-4c5c-bb41-6c74f527821f None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:42.890024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5e3b3-c3e4-4656-b15b-01322cb4d448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:42.890857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5e3b3-c3e4-4656-b15b-01322cb4d448 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:42.891172 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5e3b3-c3e4-4656-b15b-01322cb4d448 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:42.891446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5e3b3-c3e4-4656-b15b-01322cb4d448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:42.895548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92207eb6-a980-4abb-9004-7c68666da432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:42.896302 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92207eb6-a980-4abb-9004-7c68666da432 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:42.896702 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92207eb6-a980-4abb-9004-7c68666da432 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:42.897076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92207eb6-a980-4abb-9004-7c68666da432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:42.903313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5e3b3-c3e4-4656-b15b-01322cb4d448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:42.904770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5e3b3-c3e4-4656-b15b-01322cb4d448 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:42.922467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d3a5e3b3-c3e4-4656-b15b-01322cb4d448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:42.922467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:42.922467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:42.922467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:42.922467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:42.922467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:42.922467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:42.922467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:42.922467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:42.922467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:42.922467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:42.922467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:42.922467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:42.922467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:42.922467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:42.923624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:42.924797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:42.924797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:42.924797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:42.924797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:42.928797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 322/670] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:42.929564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5e3b3-c3e4-4656-b15b-01322cb4d448 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:42.968697 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92207eb6-a980-4abb-9004-7c68666da432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:42.970312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92207eb6-a980-4abb-9004-7c68666da432 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:43.004562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:43.040864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:43.043867 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5e3b3-c3e4-4656-b15b-01322cb4d448 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:43.079618 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 349/671] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:43.079618 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92207eb6-a980-4abb-9004-7c68666da432 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:43.085467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ecc2e-1c12-4fe4-8103-a26bbf3b4bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:43.086541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ecc2e-1c12-4fe4-8103-a26bbf3b4bfe None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:43.086895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ecc2e-1c12-4fe4-8103-a26bbf3b4bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:43.087511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ecc2e-1c12-4fe4-8103-a26bbf3b4bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:43.088420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ecc2e-1c12-4fe4-8103-a26bbf3b4bfe None admin] RBAC: Adding query filter params (role.id=ea9f1b43d91c4665ba5af180f55c663c, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=19eb97598f774389ad927867a7023fc8) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:43.088797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ecc2e-1c12-4fe4-8103-a26bbf3b4bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:43.090313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ecc2e-1c12-4fe4-8103-a26bbf3b4bfe None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:43.097009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 323/672] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:04:42 2022] GET /identity/v3/role_assignments?user.id=19eb97598f774389ad927867a7023fc8&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=ea9f1b43d91c4665ba5af180f55c663c => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:43.097688 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ecc2e-1c12-4fe4-8103-a26bbf3b4bfe None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:43.198901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92207eb6-a980-4abb-9004-7c68666da432 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:43.238509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d9c39-f84f-4639-a00e-5f288d49ed0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:43.239698 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d9c39-f84f-4639-a00e-5f288d49ed0a None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:43.240134 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d9c39-f84f-4639-a00e-5f288d49ed0a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:43.240804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d9c39-f84f-4639-a00e-5f288d49ed0a None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:43.241736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d9c39-f84f-4639-a00e-5f288d49ed0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:43.242293 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d9c39-f84f-4639-a00e-5f288d49ed0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:43.244848 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d9c39-f84f-4639-a00e-5f288d49ed0a None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:43.252496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ecc2e-1c12-4fe4-8103-a26bbf3b4bfe None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:43.259309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 350/673] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:43.260518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d9c39-f84f-4639-a00e-5f288d49ed0a None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:43.304083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:43.305739 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:43.310412 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3320f54-26f9-4413-9686-500c4c12fcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:43.311229 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320f54-26f9-4413-9686-500c4c12fcfd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:43.312340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320f54-26f9-4413-9686-500c4c12fcfd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:43.313257 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320f54-26f9-4413-9686-500c4c12fcfd None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:43.313797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3320f54-26f9-4413-9686-500c4c12fcfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:43.314253 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3320f54-26f9-4413-9686-500c4c12fcfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:43.315865 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3320f54-26f9-4413-9686-500c4c12fcfd None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:43.334521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 324/674] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:43.334521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3320f54-26f9-4413-9686-500c4c12fcfd None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:43.392270 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d9c39-f84f-4639-a00e-5f288d49ed0a None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:43.427884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340738b-3d99-4cf4-96fb-f3d0ecd40f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:43.428606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340738b-3d99-4cf4-96fb-f3d0ecd40f18 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:43.428889 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340738b-3d99-4cf4-96fb-f3d0ecd40f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:43.429168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340738b-3d99-4cf4-96fb-f3d0ecd40f18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:43.442217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340738b-3d99-4cf4-96fb-f3d0ecd40f18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:43.443614 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340738b-3d99-4cf4-96fb-f3d0ecd40f18 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:43.462785 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3320f54-26f9-4413-9686-500c4c12fcfd None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:43.462982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-1340738b-3d99-4cf4-96fb-f3d0ecd40f18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:43.462982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:43.462982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:43.462982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:43.462982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:43.462982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:43.462982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:43.462982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:43.462982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:43.462982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:43.462982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:43.462982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:43.462982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:43.462982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:43.462982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:43.463868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:43.464741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:43.464741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:43.464741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:43.464741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:43.468971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 351/675] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:43.469973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340738b-3d99-4cf4-96fb-f3d0ecd40f18 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:43.508768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1a2f8-e3f1-47b5-9244-3994e1271836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:43.510161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1a2f8-e3f1-47b5-9244-3994e1271836 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:43.511592 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1a2f8-e3f1-47b5-9244-3994e1271836 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:43.512050 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d1a2f8-e3f1-47b5-9244-3994e1271836 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:43.521838 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1a2f8-e3f1-47b5-9244-3994e1271836 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:43.523361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d1a2f8-e3f1-47b5-9244-3994e1271836 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:43.543842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-84d1a2f8-e3f1-47b5-9244-3994e1271836 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:43.543842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:43.543842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:43.543842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:43.543842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:43.543842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:43.543842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:43.543842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:43.543842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:43.543842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:43.543842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:43.543842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:43.543842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:43.543842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:43.543842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:43.544788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:43.545679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:43.545679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:43.545679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:43.545679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:43.545679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:43.545679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:43.545679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:43.545679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:43.550043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 325/676] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:43.550984 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1a2f8-e3f1-47b5-9244-3994e1271836 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:43.575696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:43.598116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340738b-3d99-4cf4-96fb-f3d0ecd40f18 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:43.608443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:43.633065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f573f0-5312-492a-a406-efc63f5f4f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:43.633859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f573f0-5312-492a-a406-efc63f5f4f40 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:43.634139 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f573f0-5312-492a-a406-efc63f5f4f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:43.634429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f573f0-5312-492a-a406-efc63f5f4f40 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:43.642059 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f573f0-5312-492a-a406-efc63f5f4f40 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:43.643551 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f573f0-5312-492a-a406-efc63f5f4f40 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:43.657583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-15f573f0-5312-492a-a406-efc63f5f4f40 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 14:04:43.657583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:43.657583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:43.657583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:43.657583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:43.657583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:43.657583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:43.657583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:43.657583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:43.657583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:43.657583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:43.657583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:43.657583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:43.657583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:43.657583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:43.657583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:43.658576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:43.659727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:43.659727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:43.659727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:43.659727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:43.659727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:43.659727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:43.659727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:43.659727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:43.659727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 14:04:43.659727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:43.659727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 352/677] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:04:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:43.660347 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f573f0-5312-492a-a406-efc63f5f4f40 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:43.667939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d1a2f8-e3f1-47b5-9244-3994e1271836 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:43.703494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead35c0-dcaa-43c0-a713-620f338085b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:43.704079 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead35c0-dcaa-43c0-a713-620f338085b6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:43.704500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead35c0-dcaa-43c0-a713-620f338085b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:43.704786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead35c0-dcaa-43c0-a713-620f338085b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:43.705518 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead35c0-dcaa-43c0-a713-620f338085b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:43.705830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead35c0-dcaa-43c0-a713-620f338085b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:43.707390 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead35c0-dcaa-43c0-a713-620f338085b6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:43.724317 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 326/678] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:43.725946 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2bffa-ecfa-4d47-9c15-bc44a2931512 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:43.726063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2bffa-ecfa-4d47-9c15-bc44a2931512 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:43.726278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d2bffa-ecfa-4d47-9c15-bc44a2931512 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:43.731579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 327/679] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:43.731579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2bffa-ecfa-4d47-9c15-bc44a2931512 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:43.772937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f573f0-5312-492a-a406-efc63f5f4f40 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:43.807475 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699b5e1-7906-4674-aec3-e8b81249aa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:43.808600 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699b5e1-7906-4674-aec3-e8b81249aa7d None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:43.808960 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699b5e1-7906-4674-aec3-e8b81249aa7d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:43.809310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699b5e1-7906-4674-aec3-e8b81249aa7d None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:43.810580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699b5e1-7906-4674-aec3-e8b81249aa7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:43.810967 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699b5e1-7906-4674-aec3-e8b81249aa7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:43.812795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699b5e1-7906-4674-aec3-e8b81249aa7d None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:43.831306 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 353/680] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:43.831306 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699b5e1-7906-4674-aec3-e8b81249aa7d None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:43.831306 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:43.839445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d2bffa-ecfa-4d47-9c15-bc44a2931512 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:43.856009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:43.880118 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358c83f-ca2a-4ff4-aced-6721241f869d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:43.881056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358c83f-ca2a-4ff4-aced-6721241f869d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:43.881526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358c83f-ca2a-4ff4-aced-6721241f869d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:43.881876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358c83f-ca2a-4ff4-aced-6721241f869d None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:43.882838 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358c83f-ca2a-4ff4-aced-6721241f869d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:43.883215 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358c83f-ca2a-4ff4-aced-6721241f869d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:43.884847 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358c83f-ca2a-4ff4-aced-6721241f869d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:43.905526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 328/681] 10.222.0.99 () {56 vars in 1135 bytes} [Mon Jul 18 14:04:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:43.906949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a0ace-e3fd-4a63-ab3e-d4988d6cf0d7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:43.907307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a0ace-e3fd-4a63-ab3e-d4988d6cf0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:43.907714 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a0ace-e3fd-4a63-ab3e-d4988d6cf0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:43.924881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-583a0ace-e3fd-4a63-ab3e-d4988d6cf0d7 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:43.926143 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-583a0ace-e3fd-4a63-ab3e-d4988d6cf0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:43.935369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699b5e1-7906-4674-aec3-e8b81249aa7d None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:43.973558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26576827-36f0-4ee3-a9d8-9097848a9b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:43.974267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26576827-36f0-4ee3-a9d8-9097848a9b79 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:43.974610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26576827-36f0-4ee3-a9d8-9097848a9b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:43.974872 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26576827-36f0-4ee3-a9d8-9097848a9b79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:43.981717 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26576827-36f0-4ee3-a9d8-9097848a9b79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:43.983195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26576827-36f0-4ee3-a9d8-9097848a9b79 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:43.998694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-26576827-36f0-4ee3-a9d8-9097848a9b79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:43.998694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:43.998694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:43.998694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:43.998694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:43.998694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:43.998694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:43.998694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:43.998694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:43.998694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:43.998694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:43.998694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:43.998694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:43.998694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:43.998694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:43.999902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:44.000779 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:44.000779 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:44.000779 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:44.000779 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:44.000779 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:44.000779 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:44.000779 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:44.000779 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:44.010472 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 329/682] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:44.010472 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a0ace-e3fd-4a63-ab3e-d4988d6cf0d7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:44.010695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 354/683] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:44.010695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26576827-36f0-4ee3-a9d8-9097848a9b79 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:44.077314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:44.112772 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:44.115989 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a0ace-e3fd-4a63-ab3e-d4988d6cf0d7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:44.121944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26576827-36f0-4ee3-a9d8-9097848a9b79 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:44.154169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a69b2-2063-416f-a5d9-3e50e9dccadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:44.155170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a69b2-2063-416f-a5d9-3e50e9dccadc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:44.155458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a69b2-2063-416f-a5d9-3e50e9dccadc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:44.155876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a69b2-2063-416f-a5d9-3e50e9dccadc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:44.156823 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a69b2-2063-416f-a5d9-3e50e9dccadc None admin] RBAC: Adding query filter params (role.id=ea9f1b43d91c4665ba5af180f55c663c, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=927543219de847b88b97fbe4f343d2be) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:44.157034 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a69b2-2063-416f-a5d9-3e50e9dccadc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:44.158571 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a69b2-2063-416f-a5d9-3e50e9dccadc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:44.174425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 330/684] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:04:44 2022] GET /identity/v3/role_assignments?user.id=927543219de847b88b97fbe4f343d2be&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=ea9f1b43d91c4665ba5af180f55c663c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:44.174425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a69b2-2063-416f-a5d9-3e50e9dccadc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:44.176414 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce80b53-67fc-42d1-a657-e66ef6a80de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:44.177417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce80b53-67fc-42d1-a657-e66ef6a80de6 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:44.177767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce80b53-67fc-42d1-a657-e66ef6a80de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:44.178119 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce80b53-67fc-42d1-a657-e66ef6a80de6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:44.276092 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce80b53-67fc-42d1-a657-e66ef6a80de6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:44.278200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce80b53-67fc-42d1-a657-e66ef6a80de6 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:44.297147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a69b2-2063-416f-a5d9-3e50e9dccadc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:44.339829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5347fb3-a1f0-4663-8e5e-0b342a086729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:44.340704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5347fb3-a1f0-4663-8e5e-0b342a086729 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:44.341398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5347fb3-a1f0-4663-8e5e-0b342a086729 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:44.341684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5347fb3-a1f0-4663-8e5e-0b342a086729 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:44.342811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5347fb3-a1f0-4663-8e5e-0b342a086729 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:44.343127 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5347fb3-a1f0-4663-8e5e-0b342a086729 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:44.345094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5347fb3-a1f0-4663-8e5e-0b342a086729 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:44.359388 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:44.363083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 331/685] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:44.363952 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5347fb3-a1f0-4663-8e5e-0b342a086729 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:44.398121 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:44.418926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 355/686] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:44.420076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce80b53-67fc-42d1-a657-e66ef6a80de6 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:44.488119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5347fb3-a1f0-4663-8e5e-0b342a086729 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:44.533727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d3dff-4ce5-455f-bf04-b42a3543faee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:44.534511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d3dff-4ce5-455f-bf04-b42a3543faee None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:44.534767 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d3dff-4ce5-455f-bf04-b42a3543faee None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:44.535047 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d3dff-4ce5-455f-bf04-b42a3543faee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:44.541865 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce80b53-67fc-42d1-a657-e66ef6a80de6 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:44.548358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d3dff-4ce5-455f-bf04-b42a3543faee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:44.558576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ea4d3dff-4ce5-455f-bf04-b42a3543faee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:04:44.558576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:44.558576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:44.558576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:44.558576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:44.558576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:44.558576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:44.558576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:44.558576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:44.558576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:44.558576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:44.558576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:44.558576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:44.558576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:44.558576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:44.558576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:44.559547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:44.559547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:44.559547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:44.559547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:44.559547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:44.559547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:44.559547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:44.559547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:44.559547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:44.559547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:44.559547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:44.559547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:44.559547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:44.559547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:44.559547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:44.559547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:44.560421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:44.560421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:44.560421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:44.560421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:44.560421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:44.560421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:44.560421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:44.560421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:44.560421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:44.560421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:44.560421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:04:44.560421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:44.564170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 332/687] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:04:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:44.569936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d3dff-4ce5-455f-bf04-b42a3543faee None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:44.583332 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf082b33-34b3-4bda-ad94-e4f15845da35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:44.583987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf082b33-34b3-4bda-ad94-e4f15845da35 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:44.584279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf082b33-34b3-4bda-ad94-e4f15845da35 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:44.584754 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf082b33-34b3-4bda-ad94-e4f15845da35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:44.585395 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf082b33-34b3-4bda-ad94-e4f15845da35 None admin] RBAC: Adding query filter params (role.id=ea9f1b43d91c4665ba5af180f55c663c, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=abc51e98d0054609b6ce10723f70bf49) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:44.585708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf082b33-34b3-4bda-ad94-e4f15845da35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:44.587172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf082b33-34b3-4bda-ad94-e4f15845da35 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:44.593661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 356/688] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:04:44 2022] GET /identity/v3/role_assignments?user.id=abc51e98d0054609b6ce10723f70bf49&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=ea9f1b43d91c4665ba5af180f55c663c => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:44.594487 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf082b33-34b3-4bda-ad94-e4f15845da35 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:44.624417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:44.666190 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:44.685101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d3dff-4ce5-455f-bf04-b42a3543faee None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:44.703554 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf082b33-34b3-4bda-ad94-e4f15845da35 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:44.723094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9901d6f-6e4e-4cf0-a853-fd6be5b210a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:44.724294 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9901d6f-6e4e-4cf0-a853-fd6be5b210a1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:44.724805 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9901d6f-6e4e-4cf0-a853-fd6be5b210a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:44.725326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9901d6f-6e4e-4cf0-a853-fd6be5b210a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:44.738331 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9901d6f-6e4e-4cf0-a853-fd6be5b210a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:44.740174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6342f7e-1834-4407-9d2e-1b9682fbd100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:44.740557 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9901d6f-6e4e-4cf0-a853-fd6be5b210a1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:44.740856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6342f7e-1834-4407-9d2e-1b9682fbd100 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:44.741142 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6342f7e-1834-4407-9d2e-1b9682fbd100 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:44.741421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6342f7e-1834-4407-9d2e-1b9682fbd100 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:44.742378 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6342f7e-1834-4407-9d2e-1b9682fbd100 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:44.742735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6342f7e-1834-4407-9d2e-1b9682fbd100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:44.744122 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6342f7e-1834-4407-9d2e-1b9682fbd100 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:44.754183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 357/689] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:44.760094 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6342f7e-1834-4407-9d2e-1b9682fbd100 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:44.762329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a9901d6f-6e4e-4cf0-a853-fd6be5b210a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:44.762329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:44.762329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:44.762329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:44.762329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:44.762329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:44.762329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:44.762329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:44.762329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:44.762329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:44.762329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:44.762329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:44.762329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:44.762329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:44.762329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:44.763420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:44.764541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:44.764541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:44.764541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:44.764541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:44.770720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 333/690] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:44.772832 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9901d6f-6e4e-4cf0-a853-fd6be5b210a1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:44.868506 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6342f7e-1834-4407-9d2e-1b9682fbd100 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:44.883399 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9901d6f-6e4e-4cf0-a853-fd6be5b210a1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:44.886802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:44.926227 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df554a9-b1cc-4433-85a4-95507c3879f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:44.926933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df554a9-b1cc-4433-85a4-95507c3879f8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:44.927218 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df554a9-b1cc-4433-85a4-95507c3879f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:44.927504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df554a9-b1cc-4433-85a4-95507c3879f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:44.928370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df554a9-b1cc-4433-85a4-95507c3879f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:44.928689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df554a9-b1cc-4433-85a4-95507c3879f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:44.930504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df554a9-b1cc-4433-85a4-95507c3879f8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:44.931105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddc972-0eda-4f28-98e6-c39b1a90cad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:44.932011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddc972-0eda-4f28-98e6-c39b1a90cad2 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:44.932391 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddc972-0eda-4f28-98e6-c39b1a90cad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:44.932773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ddc972-0eda-4f28-98e6-c39b1a90cad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:44.933159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:44.945047 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 334/691] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:44.946506 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddc972-0eda-4f28-98e6-c39b1a90cad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:44.947063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ddc972-0eda-4f28-98e6-c39b1a90cad2 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:44.950915 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df554a9-b1cc-4433-85a4-95507c3879f8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:44.970363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-61ddc972-0eda-4f28-98e6-c39b1a90cad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:44.970363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:44.970363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:44.970363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:44.970363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:44.970363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:44.970363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:44.970363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:44.970363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:44.970363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:44.970363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:44.970363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:44.970363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:44.970363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:44.970363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:44.971495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:44.972554 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:44.972554 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:44.972554 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:44.972554 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:44.974195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 358/692] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:44.979753 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddc972-0eda-4f28-98e6-c39b1a90cad2 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:45.071579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df554a9-b1cc-4433-85a4-95507c3879f8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:45.085120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ddc972-0eda-4f28-98e6-c39b1a90cad2 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:45.116267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872626a-23e5-4ad4-8718-65e7b39230ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:45.117069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872626a-23e5-4ad4-8718-65e7b39230ff None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:45.117348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872626a-23e5-4ad4-8718-65e7b39230ff None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:45.117619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872626a-23e5-4ad4-8718-65e7b39230ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:45.120617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc782382-e618-4075-9b3e-c337a818f288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:45.121400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc782382-e618-4075-9b3e-c337a818f288 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:45.121782 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc782382-e618-4075-9b3e-c337a818f288 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:45.122163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc782382-e618-4075-9b3e-c337a818f288 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:45.123055 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc782382-e618-4075-9b3e-c337a818f288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:45.123466 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc782382-e618-4075-9b3e-c337a818f288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:45.125263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc782382-e618-4075-9b3e-c337a818f288 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:45.126022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872626a-23e5-4ad4-8718-65e7b39230ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:45.129227 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872626a-23e5-4ad4-8718-65e7b39230ff None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:45.135572 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:45.140139 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 359/693] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:45.145775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc782382-e618-4075-9b3e-c337a818f288 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:45.146841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-e872626a-23e5-4ad4-8718-65e7b39230ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:45.146841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:45.146841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:45.146841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:45.146841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:45.146841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:45.146841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:45.146841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:45.146841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:45.146841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:45.146841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:45.146841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:45.146841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:45.146841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:45.146841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:45.147881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:45.149454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:45.149454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:45.149454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:45.149454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:45.149454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:45.149454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:45.149454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:45.149454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:45.151583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 335/694] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:45.158719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872626a-23e5-4ad4-8718-65e7b39230ff None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:45.222858 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:45.258749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc782382-e618-4075-9b3e-c337a818f288 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:45.266520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872626a-23e5-4ad4-8718-65e7b39230ff None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:45.295811 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36d5d6-ba2e-4f24-83b4-0022e01371a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:45.296799 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36d5d6-ba2e-4f24-83b4-0022e01371a0 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:45.297182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36d5d6-ba2e-4f24-83b4-0022e01371a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:45.297561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36d5d6-ba2e-4f24-83b4-0022e01371a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:45.302185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78d4dd-f6c3-424a-9e39-f9fb5d09c23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:45.303051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78d4dd-f6c3-424a-9e39-f9fb5d09c23f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:45.303473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78d4dd-f6c3-424a-9e39-f9fb5d09c23f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:45.303910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78d4dd-f6c3-424a-9e39-f9fb5d09c23f None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:45.304845 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78d4dd-f6c3-424a-9e39-f9fb5d09c23f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:45.305342 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78d4dd-f6c3-424a-9e39-f9fb5d09c23f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:45.306147 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36d5d6-ba2e-4f24-83b4-0022e01371a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:45.307183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78d4dd-f6c3-424a-9e39-f9fb5d09c23f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:45.307863 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36d5d6-ba2e-4f24-83b4-0022e01371a0 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:45.320112 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 336/695] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:45.325290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-ef36d5d6-ba2e-4f24-83b4-0022e01371a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:04:45.325290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:45.325290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:45.325290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:45.325290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:45.325290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:45.325290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:45.325290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:45.325290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:45.325290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:45.325290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:45.325290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:45.325290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:45.325290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:45.325290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:45.325290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:45.326250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:45.327239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:45.327239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:45.327239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:45.327239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:45.327239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:45.327239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:45.327239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:45.327239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:45.327239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:04:45.327239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:45.327239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 360/696] 10.222.0.99 () {56 vars in 1093 bytes} [Mon Jul 18 14:04:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:45.329005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78d4dd-f6c3-424a-9e39-f9fb5d09c23f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:45.331468 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36d5d6-ba2e-4f24-83b4-0022e01371a0 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:45.393868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:45.435735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36d5d6-ba2e-4f24-83b4-0022e01371a0 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:45.450403 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78d4dd-f6c3-424a-9e39-f9fb5d09c23f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:45.475777 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:45.485825 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243a96d-edfe-4060-9dd5-e892300c0945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:45.486904 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243a96d-edfe-4060-9dd5-e892300c0945 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:45.487183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243a96d-edfe-4060-9dd5-e892300c0945 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:45.487455 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243a96d-edfe-4060-9dd5-e892300c0945 None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:45.488611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243a96d-edfe-4060-9dd5-e892300c0945 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:45.488920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243a96d-edfe-4060-9dd5-e892300c0945 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:45.490350 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243a96d-edfe-4060-9dd5-e892300c0945 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:45.503820 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54f714-4a34-44ca-afa7-cae39fa69342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:45.504798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54f714-4a34-44ca-afa7-cae39fa69342 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:45.505284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54f714-4a34-44ca-afa7-cae39fa69342 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:45.505783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54f714-4a34-44ca-afa7-cae39fa69342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:45.506869 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54f714-4a34-44ca-afa7-cae39fa69342 None admin] RBAC: Adding query filter params (role.id=ea9f1b43d91c4665ba5af180f55c663c, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=55fe1a286c2045d5bcd49895a878a3bf) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:45.507487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54f714-4a34-44ca-afa7-cae39fa69342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:45.509144 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54f714-4a34-44ca-afa7-cae39fa69342 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:45.514428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 361/697] 10.222.0.99 () {56 vars in 1133 bytes} [Mon Jul 18 14:04:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:45.514428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bd59d-55af-4fa9-9194-6d7e5fb6c4b7 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:45.514428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bd59d-55af-4fa9-9194-6d7e5fb6c4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:45.514428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bd59d-55af-4fa9-9194-6d7e5fb6c4b7 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:45.514428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 362/698] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:45.522459 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bd59d-55af-4fa9-9194-6d7e5fb6c4b7 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:45.529559 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 337/699] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:04:45 2022] GET /identity/v3/role_assignments?user.id=55fe1a286c2045d5bcd49895a878a3bf&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=ea9f1b43d91c4665ba5af180f55c663c => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:45.531586 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08f4f0-936d-4807-bc45-bafac23ada5f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:45.531982 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08f4f0-936d-4807-bc45-bafac23ada5f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:45.532356 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08f4f0-936d-4807-bc45-bafac23ada5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:45.556024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2d08f4f0-936d-4807-bc45-bafac23ada5f None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:45.557623 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2d08f4f0-936d-4807-bc45-bafac23ada5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:45.702488 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 338/700] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:45.712288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bd59d-55af-4fa9-9194-6d7e5fb6c4b7 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:45.736508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:45.755120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08f4f0-936d-4807-bc45-bafac23ada5f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:45.764186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce48356-2a1b-4ebc-9625-b2d58e235238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:45.765232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce48356-2a1b-4ebc-9625-b2d58e235238 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:45.765712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce48356-2a1b-4ebc-9625-b2d58e235238 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:45.766179 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce48356-2a1b-4ebc-9625-b2d58e235238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:45.845177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce48356-2a1b-4ebc-9625-b2d58e235238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:45.847150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce48356-2a1b-4ebc-9625-b2d58e235238 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:45.858597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08f4f0-936d-4807-bc45-bafac23ada5f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:45.870449 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:45.895359 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf5c51-4212-42cc-9a38-71eb9ed7fd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:45.896677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf5c51-4212-42cc-9a38-71eb9ed7fd27 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:45.896960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf5c51-4212-42cc-9a38-71eb9ed7fd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:45.897235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf5c51-4212-42cc-9a38-71eb9ed7fd27 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:45.897898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf5c51-4212-42cc-9a38-71eb9ed7fd27 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:45.899868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf5c51-4212-42cc-9a38-71eb9ed7fd27 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:45.917694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-7abf5c51-4212-42cc-9a38-71eb9ed7fd27 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 14:04:45.917694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:45.917694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:04:45.917694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:04:45.917694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:04:45.917694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:04:45.917694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:04:45.917694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:04:45.917694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 14:04:45.917694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:45.917694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:04:45.917694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:45.917694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:45.917694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:45.917694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:45.917694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:45.918735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:45.918735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:45.918735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:45.918735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:45.918735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:45.918735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:45.918735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:45.918735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:04:45.918735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:04:45.918735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:04:45.918735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:04:45.918735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:45.918735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:45.918735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:45.918735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:45.918735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:45.924807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:45.924807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:45.924807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:45.924807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:45.924807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:45.924807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:45.924807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:45.924807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:45.924807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:45.924807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:45.924807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:45.924807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:04:45.924807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:04:45.924807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 14:04:45.924807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:45.924807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 339/701] 10.222.0.99 () {56 vars in 1129 bytes} [Mon Jul 18 14:04:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:45.928334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf5c51-4212-42cc-9a38-71eb9ed7fd27 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:45.971741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 363/702] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 14:04:45.977918 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce48356-2a1b-4ebc-9625-b2d58e235238 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:45.998735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:46.053814 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf5c51-4212-42cc-9a38-71eb9ed7fd27 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:46.091355 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4ad54-e68c-4e50-a88a-d4352a934a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:46.092564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4ad54-e68c-4e50-a88a-d4352a934a14 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:46.093056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4ad54-e68c-4e50-a88a-d4352a934a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:46.093582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4ad54-e68c-4e50-a88a-d4352a934a14 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:46.094620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4ad54-e68c-4e50-a88a-d4352a934a14 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:46.095266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4ad54-e68c-4e50-a88a-d4352a934a14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:46.096896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4ad54-e68c-4e50-a88a-d4352a934a14 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:46.101207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce48356-2a1b-4ebc-9625-b2d58e235238 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:46.108487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 340/703] 10.222.0.99 () {56 vars in 1124 bytes} [Mon Jul 18 14:04:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:46.110104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4ad54-e68c-4e50-a88a-d4352a934a14 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:46.140419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522eb813-642f-43a8-98b8-e657eae58c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:46.141215 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eb813-642f-43a8-98b8-e657eae58c59 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:46.141493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eb813-642f-43a8-98b8-e657eae58c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:46.141798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522eb813-642f-43a8-98b8-e657eae58c59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:46.153106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522eb813-642f-43a8-98b8-e657eae58c59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:46.154595 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522eb813-642f-43a8-98b8-e657eae58c59 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:46.156469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:46.175470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-522eb813-642f-43a8-98b8-e657eae58c59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:46.175470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:46.175470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:46.175470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:46.175470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:46.175470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:46.175470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:46.175470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:46.175470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:46.175470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:46.175470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:46.175470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:46.175470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:46.175470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:46.175470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:46.176429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:46.177305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:46.177305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:46.177305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:46.177305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:46.177305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 364/704] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:46.183457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522eb813-642f-43a8-98b8-e657eae58c59 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:46.225891 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4ad54-e68c-4e50-a88a-d4352a934a14 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:46.268444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:46.275732 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ba66b-3e33-46b6-8051-ad3974fe8ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:46.276410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ba66b-3e33-46b6-8051-ad3974fe8ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:46.276692 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ba66b-3e33-46b6-8051-ad3974fe8ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:46.276969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ba66b-3e33-46b6-8051-ad3974fe8ca7 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:46.277696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ba66b-3e33-46b6-8051-ad3974fe8ca7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:46.278003 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ba66b-3e33-46b6-8051-ad3974fe8ca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:46.279444 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ba66b-3e33-46b6-8051-ad3974fe8ca7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:46.292988 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 341/705] 10.222.0.99 () {56 vars in 1124 bytes} [Mon Jul 18 14:04:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:46.300307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522eb813-642f-43a8-98b8-e657eae58c59 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:46.365949 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f44993-c52f-40a4-8041-39476e4be6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:46.366701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f44993-c52f-40a4-8041-39476e4be6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:46.366988 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f44993-c52f-40a4-8041-39476e4be6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:46.367264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f44993-c52f-40a4-8041-39476e4be6c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:46.368019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f44993-c52f-40a4-8041-39476e4be6c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:46.368330 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f44993-c52f-40a4-8041-39476e4be6c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:46.369761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f44993-c52f-40a4-8041-39476e4be6c3 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:46.388711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 365/706] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:46.394063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ba66b-3e33-46b6-8051-ad3974fe8ca7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:46.536223 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ba66b-3e33-46b6-8051-ad3974fe8ca7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:46.538315 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:46.577687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00ceda-ff9d-467a-9aa6-ec8804cd0559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:46.579470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00ceda-ff9d-467a-9aa6-ec8804cd0559 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:46.579948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00ceda-ff9d-467a-9aa6-ec8804cd0559 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:46.580441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00ceda-ff9d-467a-9aa6-ec8804cd0559 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:46.587555 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00ceda-ff9d-467a-9aa6-ec8804cd0559 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:46.589221 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00ceda-ff9d-467a-9aa6-ec8804cd0559 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:46.607711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ae00ceda-ff9d-467a-9aa6-ec8804cd0559 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:46.607711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:46.607711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:46.607711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:46.607711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:46.607711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:46.607711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:46.607711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:46.607711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:46.607711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:46.607711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:46.607711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:46.607711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:46.607711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:46.607711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:46.608645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:46.609536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:46.609536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:46.609536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:46.609536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:46.609536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:46.609536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:46.609536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:46.609536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:46.612079 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 342/707] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:46.617671 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f44993-c52f-40a4-8041-39476e4be6c3 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:46.782154 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f44993-c52f-40a4-8041-39476e4be6c3 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:46.816545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7e064-208b-4bc4-8718-50f2d408ecb4 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:46.816545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7e064-208b-4bc4-8718-50f2d408ecb4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:46.816545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7e064-208b-4bc4-8718-50f2d408ecb4 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:46.822523 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 343/708] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:46.827123 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:46.828392 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e4953-6b0c-4a45-9005-716ff25137b9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:46.829012 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e4953-6b0c-4a45-9005-716ff25137b9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:46.829012 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e4953-6b0c-4a45-9005-716ff25137b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:46.833720 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f42598-df29-4664-a845-16ffd6b41d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:46.834409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f42598-df29-4664-a845-16ffd6b41d53 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:46.834704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f42598-df29-4664-a845-16ffd6b41d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:46.835200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f42598-df29-4664-a845-16ffd6b41d53 None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:46.836296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f42598-df29-4664-a845-16ffd6b41d53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:46.837547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f42598-df29-4664-a845-16ffd6b41d53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:46.839084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f42598-df29-4664-a845-16ffd6b41d53 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:46.848551 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-726e4953-6b0c-4a45-9005-716ff25137b9 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:46.849742 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-726e4953-6b0c-4a45-9005-716ff25137b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:46.852249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 366/709] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:46.858073 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f42598-df29-4664-a845-16ffd6b41d53 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:46.956663 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 344/710] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:04:46.981555 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e4953-6b0c-4a45-9005-716ff25137b9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:47.005518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f42598-df29-4664-a845-16ffd6b41d53 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:47.071280 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0d57c-a7a1-4b11-975d-5f35987b2e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:47.071857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0d57c-a7a1-4b11-975d-5f35987b2e96 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:47.072135 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0d57c-a7a1-4b11-975d-5f35987b2e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:47.072410 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0d57c-a7a1-4b11-975d-5f35987b2e96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:47.073248 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0d57c-a7a1-4b11-975d-5f35987b2e96 None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=b1b66b55e0374152828913910c4002f4) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:47.073559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0d57c-a7a1-4b11-975d-5f35987b2e96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:47.075021 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0d57c-a7a1-4b11-975d-5f35987b2e96 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:47.086773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 367/711] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:04:46 2022] GET /identity/v3/role_assignments?user.id=b1b66b55e0374152828913910c4002f4&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:47.136270 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:47.139740 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e4953-6b0c-4a45-9005-716ff25137b9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:47.178591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091c818-7a65-48fe-ba8c-08ae068906d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:47.179414 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091c818-7a65-48fe-ba8c-08ae068906d6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:47.179695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091c818-7a65-48fe-ba8c-08ae068906d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:47.179968 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091c818-7a65-48fe-ba8c-08ae068906d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:47.191727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091c818-7a65-48fe-ba8c-08ae068906d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:47.193205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091c818-7a65-48fe-ba8c-08ae068906d6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:47.213589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a091c818-7a65-48fe-ba8c-08ae068906d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:47.213589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:47.213589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:47.213589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:47.213589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:47.213589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:47.213589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:47.213589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:47.213589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:47.213589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:47.213589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:47.213589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:47.213589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:47.213589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:47.213589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:47.214620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:47.215585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:47.215585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:47.215585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:47.215585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:47.220043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 345/712] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:47.223174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0d57c-a7a1-4b11-975d-5f35987b2e96 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:47.297638 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:47.357969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8ecc5-e769-4cbe-acc8-2012e6a27b10 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:47.358259 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8ecc5-e769-4cbe-acc8-2012e6a27b10 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:47.358489 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8ecc5-e769-4cbe-acc8-2012e6a27b10 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:47.360144 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 346/713] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:47.361667 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0d57c-a7a1-4b11-975d-5f35987b2e96 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:47.365863 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f87908-c7dd-4b9c-8a6e-d34bdbff6f8b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:47.366146 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f87908-c7dd-4b9c-8a6e-d34bdbff6f8b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:47.366464 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f87908-c7dd-4b9c-8a6e-d34bdbff6f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:47.401260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-46f87908-c7dd-4b9c-8a6e-d34bdbff6f8b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:47.402487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-46f87908-c7dd-4b9c-8a6e-d34bdbff6f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:47.408655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a35eb-5a12-41c4-80a9-82c11c4291e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:47.409550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a35eb-5a12-41c4-80a9-82c11c4291e1 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:47.409836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a35eb-5a12-41c4-80a9-82c11c4291e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:47.410115 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a35eb-5a12-41c4-80a9-82c11c4291e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:47.410881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a35eb-5a12-41c4-80a9-82c11c4291e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:47.411191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a35eb-5a12-41c4-80a9-82c11c4291e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:47.415085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a35eb-5a12-41c4-80a9-82c11c4291e1 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:47.439706 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 368/714] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:47.447398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a35eb-5a12-41c4-80a9-82c11c4291e1 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:47.519371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 347/715] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:04:47.541253 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f87908-c7dd-4b9c-8a6e-d34bdbff6f8b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:47.620187 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a35eb-5a12-41c4-80a9-82c11c4291e1 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:47.644911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:47.663202 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:47.677953 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1998f8-0cc6-488e-932f-791c4d060077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:47.678918 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1998f8-0cc6-488e-932f-791c4d060077 None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:47.680304 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1998f8-0cc6-488e-932f-791c4d060077 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:47.680820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1998f8-0cc6-488e-932f-791c4d060077 None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:47.682983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1998f8-0cc6-488e-932f-791c4d060077 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:47.685718 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1998f8-0cc6-488e-932f-791c4d060077 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:47.701460 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f87908-c7dd-4b9c-8a6e-d34bdbff6f8b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:47.729439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 369/716] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:04:47 2022] POST /identity/v3/users => generated 254 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:04:47.738750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd2c2c-3576-4210-b33b-f2d2a8069737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:47.739831 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd2c2c-3576-4210-b33b-f2d2a8069737 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:47.740289 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd2c2c-3576-4210-b33b-f2d2a8069737 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:47.740750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd2c2c-3576-4210-b33b-f2d2a8069737 None admin] PATH_INFO: `/v3/services/network` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:47.741564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd2c2c-3576-4210-b33b-f2d2a8069737 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:47.743178 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd2c2c-3576-4210-b33b-f2d2a8069737 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-18dd2c2c-3576-4210-b33b-f2d2a8069737 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:47.756827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:47.758234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:47.758234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:47.758234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:47.758234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:47.758234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:47.758234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:47.758234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:04:47.758234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:04:47.758234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:04:47.758234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:04:47.758234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:47.758234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:47.758234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:47.758234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:47.758234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:47.758234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:47.759361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:47.759361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:47.759361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:47.759361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:47.759361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:47.759361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:47.759361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:47.759361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:47.759361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:47.759361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:47.759361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:04:47.759361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:04:47.759361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 14:04:47.759361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:47.762039 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 348/717] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:47 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:47.768503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1998f8-0cc6-488e-932f-791c4d060077 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:47.910757 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1998f8-0cc6-488e-932f-791c4d060077 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:47.947898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295015ae-bdb5-4b2e-908d-4a6d39a39805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:47.948563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295015ae-bdb5-4b2e-908d-4a6d39a39805 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:47.948844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295015ae-bdb5-4b2e-908d-4a6d39a39805 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:47.949116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295015ae-bdb5-4b2e-908d-4a6d39a39805 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:47.949832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295015ae-bdb5-4b2e-908d-4a6d39a39805 None admin] RBAC: Adding query filter params (name=network) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:47.950138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295015ae-bdb5-4b2e-908d-4a6d39a39805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:47.951562 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295015ae-bdb5-4b2e-908d-4a6d39a39805 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:47.957221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 370/718] 10.222.0.99 () {56 vars in 1112 bytes} [Mon Jul 18 14:04:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:47.962805 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd2c2c-3576-4210-b33b-f2d2a8069737 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:48.073474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd2c2c-3576-4210-b33b-f2d2a8069737 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:48.107575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047780e-347f-4a80-b440-22d7e4cff286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:48.108233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047780e-347f-4a80-b440-22d7e4cff286 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:48.108513 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047780e-347f-4a80-b440-22d7e4cff286 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:48.108788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047780e-347f-4a80-b440-22d7e4cff286 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:48.109498 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047780e-347f-4a80-b440-22d7e4cff286 None admin] RBAC: Adding query filter params (type=network) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:48.109800 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047780e-347f-4a80-b440-22d7e4cff286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:48.111267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047780e-347f-4a80-b440-22d7e4cff286 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:48.116228 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 349/719] 10.222.0.99 () {56 vars in 1112 bytes} [Mon Jul 18 14:04:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:48.584488 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1b976-329c-4a02-b58a-b3f85a73b5da None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:48.585518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1b976-329c-4a02-b58a-b3f85a73b5da None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:48.586029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1b976-329c-4a02-b58a-b3f85a73b5da None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:48.587907 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 371/720] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:48.593459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad1509-9247-41af-810c-78807c8afa35 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:48.594002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad1509-9247-41af-810c-78807c8afa35 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:48.594511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad1509-9247-41af-810c-78807c8afa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:48.599883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:48.614319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6fad1509-9247-41af-810c-78807c8afa35 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:48.615884 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6fad1509-9247-41af-810c-78807c8afa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:48.686598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 350/721] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:48.731569 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1b976-329c-4a02-b58a-b3f85a73b5da None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:48.778776 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:48.814015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c145ef-6ea9-4d4a-9be2-4765853107ad None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:48.814704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c145ef-6ea9-4d4a-9be2-4765853107ad None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:48.815398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c145ef-6ea9-4d4a-9be2-4765853107ad None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:48.818743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 351/722] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:04:48.824168 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae768ff-7cb7-4c0f-9795-6bbbc452990a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:48.824717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae768ff-7cb7-4c0f-9795-6bbbc452990a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:48.825191 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae768ff-7cb7-4c0f-9795-6bbbc452990a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:48.843014 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6ae768ff-7cb7-4c0f-9795-6bbbc452990a None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:48.844618 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6ae768ff-7cb7-4c0f-9795-6bbbc452990a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:48.900021 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1b976-329c-4a02-b58a-b3f85a73b5da None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:48.930261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 352/723] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 14:04:48.949541 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d9649-d419-4468-93df-f3e7149f5eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:48.950547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d9649-d419-4468-93df-f3e7149f5eff None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:48.950792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d9649-d419-4468-93df-f3e7149f5eff None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:48.951065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d9649-d419-4468-93df-f3e7149f5eff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:48.962033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d9649-d419-4468-93df-f3e7149f5eff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:48.969884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-bd0d9649-d419-4468-93df-f3e7149f5eff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:04:48.969884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:48.969884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:48.969884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:48.969884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:48.969884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:48.969884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:48.969884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:48.969884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:48.969884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:48.969884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:48.969884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:48.969884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:48.969884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:48.969884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:48.969884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:48.970847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:48.970847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:48.970847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:48.970847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:48.970847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:48.970847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:48.970847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:48.970847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:48.970847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:48.970847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:48.970847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:48.970847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:48.970847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:48.970847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:48.970847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:48.970847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:48.972081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:48.972081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:48.972081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:48.972081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:48.972081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:48.972081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:48.972081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:48.972081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:48.972081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:48.972081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:48.972081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:04:48.972081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:48.972081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 372/724] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:04:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:48.975743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae768ff-7cb7-4c0f-9795-6bbbc452990a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:48.979962 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d9649-d419-4468-93df-f3e7149f5eff None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:49.074227 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:49.117813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:49.130251 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d9649-d419-4468-93df-f3e7149f5eff None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:49.155533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae768ff-7cb7-4c0f-9795-6bbbc452990a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:49.207100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b17e0-6c6d-48e5-b326-6ff14f5222d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:49.208054 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b17e0-6c6d-48e5-b326-6ff14f5222d3 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:49.208489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b17e0-6c6d-48e5-b326-6ff14f5222d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:49.208947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b17e0-6c6d-48e5-b326-6ff14f5222d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:49.209865 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b17e0-6c6d-48e5-b326-6ff14f5222d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:49.210319 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b17e0-6c6d-48e5-b326-6ff14f5222d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:49.211086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abefb1f-98d0-4849-8207-a63a1efe336a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:49.211847 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abefb1f-98d0-4849-8207-a63a1efe336a None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:49.212222 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abefb1f-98d0-4849-8207-a63a1efe336a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:49.212419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b17e0-6c6d-48e5-b326-6ff14f5222d3 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:49.212675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abefb1f-98d0-4849-8207-a63a1efe336a None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:49.213499 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abefb1f-98d0-4849-8207-a63a1efe336a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:49.218408 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abefb1f-98d0-4849-8207-a63a1efe336a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:49.228692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 373/725] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:49.241611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 353/726] 10.222.0.99 () {60 vars in 1141 bytes} [Mon Jul 18 14:04:48 2022] POST /identity/v3/services => generated 251 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:04:49.243140 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b17e0-6c6d-48e5-b326-6ff14f5222d3 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:49.371431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b17e0-6c6d-48e5-b326-6ff14f5222d3 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:49.386845 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04785f-b6f8-4cd8-9917-7a9b2435be94 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:49.387171 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04785f-b6f8-4cd8-9917-7a9b2435be94 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:49.387412 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04785f-b6f8-4cd8-9917-7a9b2435be94 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:49.389115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 354/727] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:49.394980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb9492-3390-4a31-b7f8-5c68f7bda742 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:49.395288 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb9492-3390-4a31-b7f8-5c68f7bda742 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:49.395551 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb9492-3390-4a31-b7f8-5c68f7bda742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:49.423468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3ddb9492-3390-4a31-b7f8-5c68f7bda742 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:49.424961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3ddb9492-3390-4a31-b7f8-5c68f7bda742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:49.445013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640875b-5fc3-4eca-9bef-70f4fc215af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:49.445816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640875b-5fc3-4eca-9bef-70f4fc215af0 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:49.446098 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640875b-5fc3-4eca-9bef-70f4fc215af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:49.446372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640875b-5fc3-4eca-9bef-70f4fc215af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:49.458727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640875b-5fc3-4eca-9bef-70f4fc215af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:49.460343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f640875b-5fc3-4eca-9bef-70f4fc215af0 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:49.481158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-f640875b-5fc3-4eca-9bef-70f4fc215af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:49.481158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:49.481158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:49.481158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:49.481158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:49.481158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:49.481158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:49.481158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:49.481158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:49.481158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:49.481158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:49.481158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:49.481158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:49.481158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:49.481158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:49.482268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:49.483501 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:49.483501 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:49.483501 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:49.483501 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:49.483501 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 374/728] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:49.490576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640875b-5fc3-4eca-9bef-70f4fc215af0 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:49.495301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:49.523779 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 355/729] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:49.545454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb9492-3390-4a31-b7f8-5c68f7bda742 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:49.613203 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:49.615176 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640875b-5fc3-4eca-9bef-70f4fc215af0 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:49.658156 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2fede-5366-4702-9c87-2c9533eec0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:49.658779 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2fede-5366-4702-9c87-2c9533eec0ee None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:49.659050 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2fede-5366-4702-9c87-2c9533eec0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:49.659335 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2fede-5366-4702-9c87-2c9533eec0ee None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:49.660071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2fede-5366-4702-9c87-2c9533eec0ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:49.660379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2fede-5366-4702-9c87-2c9533eec0ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:49.661778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2fede-5366-4702-9c87-2c9533eec0ee None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:49.684329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb9492-3390-4a31-b7f8-5c68f7bda742 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:49.698328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 375/730] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:49.701557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2fede-5366-4702-9c87-2c9533eec0ee None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:49.767200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7c4e9-5dd1-4762-a28b-1263c4669dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:49.768014 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7c4e9-5dd1-4762-a28b-1263c4669dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:49.768336 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7c4e9-5dd1-4762-a28b-1263c4669dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:49.768714 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7c4e9-5dd1-4762-a28b-1263c4669dc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:49.792058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7c4e9-5dd1-4762-a28b-1263c4669dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:49.802734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:49.803660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-64b7c4e9-5dd1-4762-a28b-1263c4669dc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:04:49.803660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:49.803660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:49.803660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:49.803660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:49.803660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:49.803660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:49.803660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:49.803660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:49.803660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:49.803660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:49.803660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:49.803660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:49.803660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:49.803660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:49.803660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:49.804648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:49.804648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:49.804648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:49.804648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:49.804648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:49.804648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:49.804648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:49.804648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:49.804648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:49.804648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:49.804648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:49.804648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:49.804648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:49.804648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:49.804648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:49.804648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:49.805470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:49.805470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:49.805470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:49.805470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:49.805470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:49.805470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:49.805470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:49.805470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:49.805470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:49.805470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:49.805470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:04:49.805470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:49.805470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 356/731] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:04:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:49.810464 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7c4e9-5dd1-4762-a28b-1263c4669dc1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:49.875434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2fede-5366-4702-9c87-2c9533eec0ee None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:49.924715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e367c-b31e-4f8f-91e3-573eeed6b585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:49.925313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e367c-b31e-4f8f-91e3-573eeed6b585 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:49.925599 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e367c-b31e-4f8f-91e3-573eeed6b585 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:49.925879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e367c-b31e-4f8f-91e3-573eeed6b585 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:49.934934 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e367c-b31e-4f8f-91e3-573eeed6b585 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:49.936398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e367c-b31e-4f8f-91e3-573eeed6b585 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:49.964152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7c4e9-5dd1-4762-a28b-1263c4669dc1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:49.965908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-d17e367c-b31e-4f8f-91e3-573eeed6b585 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 14:04:49.965908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:49.965908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:49.965908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:49.965908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:49.965908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:49.965908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:49.965908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:49.965908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:49.965908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:49.965908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:49.965908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:49.965908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:49.965908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:49.965908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:49.965908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:49.966839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:49.967772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:49.967772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:49.967772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:49.967772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:49.967772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:49.967772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:49.967772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:49.967772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:49.967772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 14:04:49.967772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:49.968299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 376/732] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:04:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:49.974134 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e367c-b31e-4f8f-91e3-573eeed6b585 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:49.989520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:50.022951 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a0aff-e6ce-443d-8c60-a901448b0d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:50.023619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a0aff-e6ce-443d-8c60-a901448b0d19 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:50.023897 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a0aff-e6ce-443d-8c60-a901448b0d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:50.024168 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a0aff-e6ce-443d-8c60-a901448b0d19 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:50.025161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a0aff-e6ce-443d-8c60-a901448b0d19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:50.025465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a0aff-e6ce-443d-8c60-a901448b0d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:50.027671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a0aff-e6ce-443d-8c60-a901448b0d19 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:50.040441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 357/733] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:50.045835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a0aff-e6ce-443d-8c60-a901448b0d19 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:50.185433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a0aff-e6ce-443d-8c60-a901448b0d19 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:50.188151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e367c-b31e-4f8f-91e3-573eeed6b585 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:50.227301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35de08-5e4a-472d-96e7-34de2d86a27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:50.228104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35de08-5e4a-472d-96e7-34de2d86a27a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:50.228380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35de08-5e4a-472d-96e7-34de2d86a27a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:50.228651 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35de08-5e4a-472d-96e7-34de2d86a27a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:50.243057 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:50.256158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35de08-5e4a-472d-96e7-34de2d86a27a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:50.257626 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35de08-5e4a-472d-96e7-34de2d86a27a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:50.262320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2843f5-d1b6-467b-b91b-66bfe0d8d5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:50.263019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2843f5-d1b6-467b-b91b-66bfe0d8d5ae None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:50.263299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2843f5-d1b6-467b-b91b-66bfe0d8d5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:50.263821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2843f5-d1b6-467b-b91b-66bfe0d8d5ae None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:50.265510 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2843f5-d1b6-467b-b91b-66bfe0d8d5ae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:50.265822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2843f5-d1b6-467b-b91b-66bfe0d8d5ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:50.267345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2843f5-d1b6-467b-b91b-66bfe0d8d5ae None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:50.297440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-fa35de08-5e4a-472d-96e7-34de2d86a27a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:50.297440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:50.297440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:50.297440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:50.297440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:50.297440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:50.297440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:50.297440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:50.297440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:50.297440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:50.297440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:50.297440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:50.297440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:50.297440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:50.297440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:50.298487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:50.299460 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:50.299460 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:50.299460 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:50.299460 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:50.299918 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 377/734] 10.222.0.99 () {56 vars in 1135 bytes} [Mon Jul 18 14:04:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:50.302040 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 358/735] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:50.306515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2843f5-d1b6-467b-b91b-66bfe0d8d5ae None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:50.308689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35de08-5e4a-472d-96e7-34de2d86a27a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:50.367864 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:50.410290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2843f5-d1b6-467b-b91b-66bfe0d8d5ae None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:50.446348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476a66a-4cb3-4cc5-a110-ae0cd55d7c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:50.446943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476a66a-4cb3-4cc5-a110-ae0cd55d7c33 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:50.447224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476a66a-4cb3-4cc5-a110-ae0cd55d7c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:50.447498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476a66a-4cb3-4cc5-a110-ae0cd55d7c33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:50.498996 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:50.518605 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476a66a-4cb3-4cc5-a110-ae0cd55d7c33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:50.520071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476a66a-4cb3-4cc5-a110-ae0cd55d7c33 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:50.572575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35de08-5e4a-472d-96e7-34de2d86a27a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:50.643612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe750013-7539-4356-8760-6c338f814d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:50.644721 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe750013-7539-4356-8760-6c338f814d0f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:50.645235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe750013-7539-4356-8760-6c338f814d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:50.645717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe750013-7539-4356-8760-6c338f814d0f None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:50.646760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe750013-7539-4356-8760-6c338f814d0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:50.647280 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe750013-7539-4356-8760-6c338f814d0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:50.648917 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe750013-7539-4356-8760-6c338f814d0f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:50.663388 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 359/736] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:50.665136 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9270b-c265-4418-988f-33f35b25e530 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:50.665662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9270b-c265-4418-988f-33f35b25e530 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:50.666148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9270b-c265-4418-988f-33f35b25e530 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:50.668172 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 360/737] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:50.678420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9270b-c265-4418-988f-33f35b25e530 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:50.752992 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 378/738] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:50 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 14:04:50.754247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af82da-991d-4da9-8651-96dc94b84254 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:50.757763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af82da-991d-4da9-8651-96dc94b84254 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:50.758307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af82da-991d-4da9-8651-96dc94b84254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:50.768674 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:50.776503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-c9af82da-991d-4da9-8651-96dc94b84254 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:50.777775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c9af82da-991d-4da9-8651-96dc94b84254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:50.786371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9270b-c265-4418-988f-33f35b25e530 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:50.822044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269ee16-b752-4769-8291-0eb6a4e69d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:50.822873 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269ee16-b752-4769-8291-0eb6a4e69d0c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:50.823156 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269ee16-b752-4769-8291-0eb6a4e69d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:50.823426 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269ee16-b752-4769-8291-0eb6a4e69d0c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:50.831604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269ee16-b752-4769-8291-0eb6a4e69d0c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:50.833220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269ee16-b752-4769-8291-0eb6a4e69d0c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:50.849347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-3269ee16-b752-4769-8291-0eb6a4e69d0c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:04:50.849347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:50.849347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:50.849347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:50.849347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:50.849347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:50.849347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:50.849347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:50.849347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:50.849347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:50.849347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:50.849347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:50.849347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:50.849347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:50.849347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:50.849347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:50.850312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:50.851943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:50.851943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:50.851943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:50.851943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:50.851943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:50.851943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:50.851943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:50.851943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:50.851943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:04:50.851943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:50.851943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 361/739] 10.222.0.99 () {56 vars in 1093 bytes} [Mon Jul 18 14:04:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:50.852537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de580818-5c95-4af2-bda0-6bc478219d2e None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:50.852537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de580818-5c95-4af2-bda0-6bc478219d2e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:50.852842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de580818-5c95-4af2-bda0-6bc478219d2e None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:50.854135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 362/740] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:50.862910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 379/741] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:50.862910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af82da-991d-4da9-8651-96dc94b84254 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:50.863285 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de580818-5c95-4af2-bda0-6bc478219d2e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:50.877000 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:50.972786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de580818-5c95-4af2-bda0-6bc478219d2e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:50.973430 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af82da-991d-4da9-8651-96dc94b84254 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:51.008344 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b7adf-bd60-46be-8de6-330a5629d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:51.009056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b7adf-bd60-46be-8de6-330a5629d191 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:51.009361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b7adf-bd60-46be-8de6-330a5629d191 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:51.009614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b7adf-bd60-46be-8de6-330a5629d191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:51.012733 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061de78e-56d2-4997-b75d-6bf0a0f946bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:51.013411 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de78e-56d2-4997-b75d-6bf0a0f946bf None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:51.013686 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de78e-56d2-4997-b75d-6bf0a0f946bf None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:51.013953 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de78e-56d2-4997-b75d-6bf0a0f946bf None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:51.014823 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061de78e-56d2-4997-b75d-6bf0a0f946bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:51.015126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061de78e-56d2-4997-b75d-6bf0a0f946bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:51.016744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061de78e-56d2-4997-b75d-6bf0a0f946bf None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:51.020774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b7adf-bd60-46be-8de6-330a5629d191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:51.022237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b7adf-bd60-46be-8de6-330a5629d191 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:51.029151 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:51.040619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 380/742] 10.222.0.99 () {56 vars in 1133 bytes} [Mon Jul 18 14:04:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:51.040619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371726a-78b6-4a19-9683-6be49a0c1412 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:51.040619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371726a-78b6-4a19-9683-6be49a0c1412 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:51.040619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371726a-78b6-4a19-9683-6be49a0c1412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:51.040998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d48b7adf-bd60-46be-8de6-330a5629d191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:51.040998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:51.040998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:51.040998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:51.040998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:51.040998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:51.040998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:51.040998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:51.040998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:51.040998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:51.040998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:51.040998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:51.040998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:51.040998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:51.040998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:51.041822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:51.043461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:51.043461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:51.043461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:51.043461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:51.043461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 363/743] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:51.043461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b7adf-bd60-46be-8de6-330a5629d191 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:51.059169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-5371726a-78b6-4a19-9683-6be49a0c1412 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:51.060336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5371726a-78b6-4a19-9683-6be49a0c1412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:51.127736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:51.132390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 381/744] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:51 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 14:04:51.133548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371726a-78b6-4a19-9683-6be49a0c1412 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:51.164089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b7adf-bd60-46be-8de6-330a5629d191 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:51.199538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901b9cd-e33f-44d5-99ef-f1f74bb1d30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:51.200330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901b9cd-e33f-44d5-99ef-f1f74bb1d30e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:51.200614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901b9cd-e33f-44d5-99ef-f1f74bb1d30e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:51.200885 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901b9cd-e33f-44d5-99ef-f1f74bb1d30e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:51.211938 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901b9cd-e33f-44d5-99ef-f1f74bb1d30e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:51.219677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-2901b9cd-e33f-44d5-99ef-f1f74bb1d30e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:51.219677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:51.219677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:51.219677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:51.219677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:51.219677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:51.219677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:51.219677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:51.219677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:51.219677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:51.219677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:51.219677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:51.219677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:51.219677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:51.219677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:51.219677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:51.220687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:51.220687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:51.220687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:51.220687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:51.220687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:51.220687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:51.220687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:51.220687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:51.220687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:51.220687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:51.220687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:51.220687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:51.220687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:51.220687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:51.220687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:51.220687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:51.221773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:51.221773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:51.221773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:51.221773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:51.221773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:51.221773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:51.221773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:51.221773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:51.221773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:51.221773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:51.221773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:51.221773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:51.221773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 364/745] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:51.221773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901b9cd-e33f-44d5-99ef-f1f74bb1d30e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:51.255972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371726a-78b6-4a19-9683-6be49a0c1412 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:51.282763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:51.294667 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac2f53-0184-485a-8906-1af63e0e7103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:51.295568 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac2f53-0184-485a-8906-1af63e0e7103 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:51.295908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac2f53-0184-485a-8906-1af63e0e7103 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:51.296214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac2f53-0184-485a-8906-1af63e0e7103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:51.306756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac2f53-0184-485a-8906-1af63e0e7103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:51.308186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac2f53-0184-485a-8906-1af63e0e7103 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:51.326291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-81ac2f53-0184-485a-8906-1af63e0e7103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:51.326291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:51.326291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:51.326291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:51.326291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:51.326291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:51.326291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:51.326291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:51.326291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:51.326291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:51.326291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:51.326291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:51.326291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:51.326291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:51.326291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:51.327340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:51.328220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:51.328220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:51.328220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:51.328220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:51.328220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 382/746] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:51.329179 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac2f53-0184-485a-8906-1af63e0e7103 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:51.333816 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901b9cd-e33f-44d5-99ef-f1f74bb1d30e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:51.373349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec774a86-dcbb-4c95-ba48-fd4889db51a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:51.374008 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec774a86-dcbb-4c95-ba48-fd4889db51a1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:51.374310 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec774a86-dcbb-4c95-ba48-fd4889db51a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:51.374900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec774a86-dcbb-4c95-ba48-fd4889db51a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:51.375629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec774a86-dcbb-4c95-ba48-fd4889db51a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:51.375934 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec774a86-dcbb-4c95-ba48-fd4889db51a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:51.377371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec774a86-dcbb-4c95-ba48-fd4889db51a1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:51.386453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:51.389842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 365/747] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:51.391857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec774a86-dcbb-4c95-ba48-fd4889db51a1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:51.440737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac2f53-0184-485a-8906-1af63e0e7103 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:51.475584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f18a34-16ed-4e0d-b2d7-56ba34f7dea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:51.476246 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f18a34-16ed-4e0d-b2d7-56ba34f7dea4 None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:51.476532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f18a34-16ed-4e0d-b2d7-56ba34f7dea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:51.476788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f18a34-16ed-4e0d-b2d7-56ba34f7dea4 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:51.477511 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f18a34-16ed-4e0d-b2d7-56ba34f7dea4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:51.478901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f18a34-16ed-4e0d-b2d7-56ba34f7dea4 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:51.502434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 383/748] 10.222.0.99 () {60 vars in 1141 bytes} [Mon Jul 18 14:04:51 2022] POST /identity/v3/services => generated 240 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:04:51.502434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f18a34-16ed-4e0d-b2d7-56ba34f7dea4 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:51.502725 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec774a86-dcbb-4c95-ba48-fd4889db51a1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:51.523205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:51.555304 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d6791-3aca-4c59-a6b2-4a13ddb7571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:51.556033 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d6791-3aca-4c59-a6b2-4a13ddb7571d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:51.556594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d6791-3aca-4c59-a6b2-4a13ddb7571d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:51.556875 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d6791-3aca-4c59-a6b2-4a13ddb7571d None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:51.558032 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d6791-3aca-4c59-a6b2-4a13ddb7571d None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:51.558341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d6791-3aca-4c59-a6b2-4a13ddb7571d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:51.559765 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d6791-3aca-4c59-a6b2-4a13ddb7571d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:51.578235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 366/749] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:51.580074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d6791-3aca-4c59-a6b2-4a13ddb7571d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:51.620565 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f18a34-16ed-4e0d-b2d7-56ba34f7dea4 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:51.635773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:51.666556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb42708-b0e0-4c79-aa02-8c50707434cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:51.667222 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb42708-b0e0-4c79-aa02-8c50707434cc None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:51.667501 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb42708-b0e0-4c79-aa02-8c50707434cc None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:51.667773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb42708-b0e0-4c79-aa02-8c50707434cc None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:51.669303 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb42708-b0e0-4c79-aa02-8c50707434cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:51.669610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb42708-b0e0-4c79-aa02-8c50707434cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:51.671149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb42708-b0e0-4c79-aa02-8c50707434cc None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:51.685335 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 384/750] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:51.685335 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb42708-b0e0-4c79-aa02-8c50707434cc None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:51.699487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d6791-3aca-4c59-a6b2-4a13ddb7571d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:51.735166 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e531ade-dcca-4725-9770-e34e542416bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:51.736067 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e531ade-dcca-4725-9770-e34e542416bb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:51.736345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e531ade-dcca-4725-9770-e34e542416bb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:51.736614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e531ade-dcca-4725-9770-e34e542416bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:51.744121 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e531ade-dcca-4725-9770-e34e542416bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:51.745722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e531ade-dcca-4725-9770-e34e542416bb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:51.760995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-2e531ade-dcca-4725-9770-e34e542416bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:51.760995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:51.760995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:51.760995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:51.760995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:51.760995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:51.760995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:51.760995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:51.760995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:51.760995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:51.760995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:51.760995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:51.760995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:51.760995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:51.760995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:51.762199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:51.763196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:51.763196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:51.763196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:51.763196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:51.763196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:51.763196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:51.763196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:51.763196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:51.763196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 367/751] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:51.763673 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdad3a-c461-45cb-9a6d-9e067d70e30f None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:51.763673 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdad3a-c461-45cb-9a6d-9e067d70e30f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:51.763863 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdad3a-c461-45cb-9a6d-9e067d70e30f None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:51.765374 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 368/752] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:51.765789 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdad3a-c461-45cb-9a6d-9e067d70e30f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:51.797426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb42708-b0e0-4c79-aa02-8c50707434cc None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:51.806315 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:51.835369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83fa67-e9f3-4968-8d42-bb5590d686a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:51.836540 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83fa67-e9f3-4968-8d42-bb5590d686a0 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:51.837059 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83fa67-e9f3-4968-8d42-bb5590d686a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:51.837397 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83fa67-e9f3-4968-8d42-bb5590d686a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:51.850464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83fa67-e9f3-4968-8d42-bb5590d686a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:51.852295 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83fa67-e9f3-4968-8d42-bb5590d686a0 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:51.875022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-4c83fa67-e9f3-4968-8d42-bb5590d686a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:51.875022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:51.875022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:51.875022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:51.875022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:51.875022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:51.875022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:51.875022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:51.875022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:51.875022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:51.875022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:51.875022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:51.875022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:51.875022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:51.875022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:51.875946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:51.876885 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:51.876885 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:51.876885 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:51.876885 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:51.877107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdad3a-c461-45cb-9a6d-9e067d70e30f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:51.877837 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 385/753] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:51.878706 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83fa67-e9f3-4968-8d42-bb5590d686a0 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:51.915258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:51.929922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521db0d-6fe3-444d-98b8-1c251dab5578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:51.931210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521db0d-6fe3-444d-98b8-1c251dab5578 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:51.932159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521db0d-6fe3-444d-98b8-1c251dab5578 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:51.932159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521db0d-6fe3-444d-98b8-1c251dab5578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:51.942135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521db0d-6fe3-444d-98b8-1c251dab5578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:51.944525 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521db0d-6fe3-444d-98b8-1c251dab5578 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:51.967895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-e521db0d-6fe3-444d-98b8-1c251dab5578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:51.967895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:51.967895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:51.967895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:51.967895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:51.967895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:51.967895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:51.967895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:51.967895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:51.967895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:51.967895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:51.967895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:51.967895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:51.967895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:51.967895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:51.968815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:51.969700 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:51.969700 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:51.969700 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:51.969700 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:51.969700 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:51.969700 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:51.969700 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:51.969700 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:51.969700 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 369/754] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:51.971563 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c933fd-2612-4664-8ce6-a65c239d67fc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:51.972041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c933fd-2612-4664-8ce6-a65c239d67fc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:51.972515 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c933fd-2612-4664-8ce6-a65c239d67fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:51.999135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-57c933fd-2612-4664-8ce6-a65c239d67fc None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:52.001303 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-57c933fd-2612-4664-8ce6-a65c239d67fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:52.037866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83fa67-e9f3-4968-8d42-bb5590d686a0 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:52.091465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e530-4c19-43f9-aa23-9b778fac9ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:52.092123 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e530-4c19-43f9-aa23-9b778fac9ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:52.092410 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e530-4c19-43f9-aa23-9b778fac9ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:52.092694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e530-4c19-43f9-aa23-9b778fac9ab5 None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:52.093493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e530-4c19-43f9-aa23-9b778fac9ab5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:52.093808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e530-4c19-43f9-aa23-9b778fac9ab5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:52.095501 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4e530-4c19-43f9-aa23-9b778fac9ab5 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:52.099596 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 370/755] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:04:52.101244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c933fd-2612-4664-8ce6-a65c239d67fc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:52.113980 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 386/756] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:52.115085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e530-4c19-43f9-aa23-9b778fac9ab5 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:52.149430 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:52.214810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:52.231060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c933fd-2612-4664-8ce6-a65c239d67fc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:52.233432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e530-4c19-43f9-aa23-9b778fac9ab5 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:52.267691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b05d4-71d0-4661-a5bc-7fd62ccc2f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:52.268361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b05d4-71d0-4661-a5bc-7fd62ccc2f02 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:52.268649 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b05d4-71d0-4661-a5bc-7fd62ccc2f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:52.268930 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b05d4-71d0-4661-a5bc-7fd62ccc2f02 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:52.269662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b05d4-71d0-4661-a5bc-7fd62ccc2f02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:52.269980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b05d4-71d0-4661-a5bc-7fd62ccc2f02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:52.270616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef215a95-0723-4834-9687-7f74d55ff593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:52.271281 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef215a95-0723-4834-9687-7f74d55ff593 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:52.271374 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b05d4-71d0-4661-a5bc-7fd62ccc2f02 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:52.271560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef215a95-0723-4834-9687-7f74d55ff593 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:52.271835 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef215a95-0723-4834-9687-7f74d55ff593 None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:52.272617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef215a95-0723-4834-9687-7f74d55ff593 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:52.272924 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef215a95-0723-4834-9687-7f74d55ff593 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:52.274339 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef215a95-0723-4834-9687-7f74d55ff593 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:52.291296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 387/757] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:52.291296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef215a95-0723-4834-9687-7f74d55ff593 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:52.291542 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 371/758] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:52.291542 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b05d4-71d0-4661-a5bc-7fd62ccc2f02 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:52.380376 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:52.392619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef215a95-0723-4834-9687-7f74d55ff593 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:52.393023 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b05d4-71d0-4661-a5bc-7fd62ccc2f02 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:52.429089 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9f7af-ae54-402a-a118-3387b1d33424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:52.429884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f7af-ae54-402a-a118-3387b1d33424 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:52.429884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f7af-ae54-402a-a118-3387b1d33424 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:52.429884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f7af-ae54-402a-a118-3387b1d33424 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:52.431516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9f7af-ae54-402a-a118-3387b1d33424 None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=55fe1a286c2045d5bcd49895a878a3bf) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:52.431516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9f7af-ae54-402a-a118-3387b1d33424 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:52.432383 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa7054-a33e-4966-ac87-00cca4c34e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:52.432529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9f7af-ae54-402a-a118-3387b1d33424 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:52.433481 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa7054-a33e-4966-ac87-00cca4c34e42 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:52.433909 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa7054-a33e-4966-ac87-00cca4c34e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:52.434328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa7054-a33e-4966-ac87-00cca4c34e42 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:52.435154 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa7054-a33e-4966-ac87-00cca4c34e42 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:52.436704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa7054-a33e-4966-ac87-00cca4c34e42 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:52.438312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 388/759] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:04:52 2022] GET /identity/v3/role_assignments?user.id=55fe1a286c2045d5bcd49895a878a3bf&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:52.439264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9f7af-ae54-402a-a118-3387b1d33424 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:52.461300 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:52.464277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ceaa7054-a33e-4966-ac87-00cca4c34e42 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 14:04:52.464277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:52.464277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:04:52.464277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:04:52.464277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:04:52.464277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:04:52.464277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:04:52.464277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:04:52.464277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 14:04:52.464277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:52.464277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:04:52.464277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:52.464277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:52.464277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:52.464277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:52.464277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:52.465465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:52.465465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:52.465465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:52.465465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:52.465465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:52.465465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:52.465465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:52.465465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:04:52.465465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:04:52.465465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:04:52.465465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:04:52.465465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:52.465465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:52.465465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:52.465465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:52.465465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:52.466458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:52.466458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:52.466458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:52.466458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:52.466458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:52.466458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:52.466458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:52.466458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:52.466458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:52.466458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:52.466458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:52.466458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:04:52.466458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:04:52.466458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 14:04:52.466458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:52.470579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 372/760] 10.222.0.99 () {56 vars in 1129 bytes} [Mon Jul 18 14:04:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:52.471706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa7054-a33e-4966-ac87-00cca4c34e42 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:52.582272 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9f7af-ae54-402a-a118-3387b1d33424 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:52.607226 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa7054-a33e-4966-ac87-00cca4c34e42 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:52.620805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38af71-b39e-4975-aacf-c57875a9c933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:52.621732 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38af71-b39e-4975-aacf-c57875a9c933 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:52.622023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38af71-b39e-4975-aacf-c57875a9c933 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:52.622300 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38af71-b39e-4975-aacf-c57875a9c933 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:52.631523 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38af71-b39e-4975-aacf-c57875a9c933 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:52.633010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38af71-b39e-4975-aacf-c57875a9c933 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:52.645375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc010ed8-afef-4a4f-b7a0-c6304975ffa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:52.646579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc010ed8-afef-4a4f-b7a0-c6304975ffa5 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:52.647004 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc010ed8-afef-4a4f-b7a0-c6304975ffa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:52.647418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc010ed8-afef-4a4f-b7a0-c6304975ffa5 None admin] PATH_INFO: `/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/b1b66b55e0374152828913910c4002f4/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:52.649822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc010ed8-afef-4a4f-b7a0-c6304975ffa5 None admin] RBAC: Authorizing `identity:create_grant(project_id=50b78e16c86b4e6cac3a725f536a8274, user_id=b1b66b55e0374152828913910c4002f4, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:52.650181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-0f38af71-b39e-4975-aacf-c57875a9c933 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 14:04:52.650181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:52.650181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:52.650181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:52.650181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:52.650181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:52.650181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:52.650181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:52.650181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:52.650181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:52.650181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:52.650181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:52.650181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:52.650181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:52.650181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:52.650181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:52.651297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:52.652454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:52.652454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:52.652454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:52.652454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:52.652454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:52.652454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:52.652454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:52.652454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:52.652454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 14:04:52.652454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:52.654546 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc010ed8-afef-4a4f-b7a0-c6304975ffa5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:52.656218 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 389/761] 10.222.0.99 () {56 vars in 1117 bytes} [Mon Jul 18 14:04:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:52.657431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38af71-b39e-4975-aacf-c57875a9c933 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:52.671954 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 373/762] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:04:52 2022] PUT /identity/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/b1b66b55e0374152828913910c4002f4/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:04:52.673006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc010ed8-afef-4a4f-b7a0-c6304975ffa5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:52.698269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:52.812343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:52.816948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc010ed8-afef-4a4f-b7a0-c6304975ffa5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:52.862169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c590e0b-2079-46ab-a031-5aaa95ee6d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:52.863176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c590e0b-2079-46ab-a031-5aaa95ee6d4d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:52.863814 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c590e0b-2079-46ab-a031-5aaa95ee6d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:52.864344 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c590e0b-2079-46ab-a031-5aaa95ee6d4d None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:52.865646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c590e0b-2079-46ab-a031-5aaa95ee6d4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:52.866171 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c590e0b-2079-46ab-a031-5aaa95ee6d4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:52.867933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c590e0b-2079-46ab-a031-5aaa95ee6d4d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:52.889692 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 374/763] 10.222.0.99 () {56 vars in 1149 bytes} [Mon Jul 18 14:04:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:52.896786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c590e0b-2079-46ab-a031-5aaa95ee6d4d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:52.897545 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38af71-b39e-4975-aacf-c57875a9c933 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:52.944777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116ae07-56eb-4d4a-a483-3f9c091156e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:52.945774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116ae07-56eb-4d4a-a483-3f9c091156e8 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:52.946248 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116ae07-56eb-4d4a-a483-3f9c091156e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:52.946742 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116ae07-56eb-4d4a-a483-3f9c091156e8 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:52.947659 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116ae07-56eb-4d4a-a483-3f9c091156e8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:52.948112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116ae07-56eb-4d4a-a483-3f9c091156e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:52.949747 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116ae07-56eb-4d4a-a483-3f9c091156e8 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:52.959578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 390/764] 10.222.0.99 () {56 vars in 1124 bytes} [Mon Jul 18 14:04:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:52.962118 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116ae07-56eb-4d4a-a483-3f9c091156e8 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:52.980511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:53.038071 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c590e0b-2079-46ab-a031-5aaa95ee6d4d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:53.076339 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116ae07-56eb-4d4a-a483-3f9c091156e8 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:53.090338 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a15872-745f-4f14-85ab-3338c9cdef98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:53.091017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a15872-745f-4f14-85ab-3338c9cdef98 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:53.091297 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a15872-745f-4f14-85ab-3338c9cdef98 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:53.091567 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a15872-745f-4f14-85ab-3338c9cdef98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:53.110121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:53.116375 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b966af-3a0f-4419-9937-27ca8a7d89e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:53.117331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b966af-3a0f-4419-9937-27ca8a7d89e7 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:53.117852 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b966af-3a0f-4419-9937-27ca8a7d89e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:53.118406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b966af-3a0f-4419-9937-27ca8a7d89e7 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:53.125782 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b966af-3a0f-4419-9937-27ca8a7d89e7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:53.126552 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b966af-3a0f-4419-9937-27ca8a7d89e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:53.128215 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b966af-3a0f-4419-9937-27ca8a7d89e7 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:53.140645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 391/765] 10.222.0.99 () {56 vars in 1124 bytes} [Mon Jul 18 14:04:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:53.145351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b966af-3a0f-4419-9937-27ca8a7d89e7 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:53.255446 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b966af-3a0f-4419-9937-27ca8a7d89e7 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:53.279486 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a15872-745f-4f14-85ab-3338c9cdef98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:53.280978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a15872-745f-4f14-85ab-3338c9cdef98 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:53.293469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00669b64-f696-4818-866e-decf5993fb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:53.294715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00669b64-f696-4818-866e-decf5993fb37 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:53.295324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00669b64-f696-4818-866e-decf5993fb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:53.295800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00669b64-f696-4818-866e-decf5993fb37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:53.296796 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00669b64-f696-4818-866e-decf5993fb37 None admin] RBAC: Adding query filter params (interface=public, service_id=85e3a992936d4a79aa7c1fe148697dae, region_id=RegionOne) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:53.297324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00669b64-f696-4818-866e-decf5993fb37 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:53.299151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00669b64-f696-4818-866e-decf5993fb37 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:53.312428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 392/766] 10.222.0.99 () {56 vars in 1251 bytes} [Mon Jul 18 14:04:53 2022] GET /identity/v3/endpoints?service_id=85e3a992936d4a79aa7c1fe148697dae&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:53.314142 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00669b64-f696-4818-866e-decf5993fb37 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:53.379048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:53.424682 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00669b64-f696-4818-866e-decf5993fb37 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:53.439779 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:53.464314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45143af-2c87-4440-833f-5e2353a7bf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:53.465350 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45143af-2c87-4440-833f-5e2353a7bf63 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:53.465839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45143af-2c87-4440-833f-5e2353a7bf63 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:53.466317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45143af-2c87-4440-833f-5e2353a7bf63 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:53.467250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45143af-2c87-4440-833f-5e2353a7bf63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:53.468935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45143af-2c87-4440-833f-5e2353a7bf63 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:53.482481 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 393/767] 10.222.0.99 () {56 vars in 1087 bytes} [Mon Jul 18 14:04:53 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:53.508211 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 375/768] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 14:04:53.513852 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45143af-2c87-4440-833f-5e2353a7bf63 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:53.573327 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efc394-6963-4675-a7c6-9b0a94746144 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:53.573675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efc394-6963-4675-a7c6-9b0a94746144 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:53.573880 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efc394-6963-4675-a7c6-9b0a94746144 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:53.575323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 376/769] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:53.581778 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7608a2-d06d-4092-900c-04d282e1735a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:53.582103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7608a2-d06d-4092-900c-04d282e1735a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:53.582329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7608a2-d06d-4092-900c-04d282e1735a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:53.613760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1f7608a2-d06d-4092-900c-04d282e1735a None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:53.614987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1f7608a2-d06d-4092-900c-04d282e1735a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:53.708348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45143af-2c87-4440-833f-5e2353a7bf63 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:53.726715 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 377/770] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:04:53.747110 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:53.748809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7608a2-d06d-4092-900c-04d282e1735a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:53.749934 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0560898-b791-4dfc-b863-2ce0a1ea061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:53.751169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0560898-b791-4dfc-b863-2ce0a1ea061c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:53.751690 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0560898-b791-4dfc-b863-2ce0a1ea061c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:53.752218 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0560898-b791-4dfc-b863-2ce0a1ea061c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:53.765255 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0560898-b791-4dfc-b863-2ce0a1ea061c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:53.766838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0560898-b791-4dfc-b863-2ce0a1ea061c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:53.784422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-a0560898-b791-4dfc-b863-2ce0a1ea061c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:53.784422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:53.784422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:53.784422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:53.784422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:53.784422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:53.784422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:53.784422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:53.784422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:53.784422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:53.784422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:53.784422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:53.784422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:53.784422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:53.784422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:53.785371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:53.786695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:53.786695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:53.786695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:53.786695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:53.786695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 394/771] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:53.791486 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0560898-b791-4dfc-b863-2ce0a1ea061c None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:53.913485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:53.917961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7608a2-d06d-4092-900c-04d282e1735a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:53.951148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0560898-b791-4dfc-b863-2ce0a1ea061c None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:53.981027 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c266328-e46c-4b51-b790-b6b30597e913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:53.981751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c266328-e46c-4b51-b790-b6b30597e913 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:53.982031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c266328-e46c-4b51-b790-b6b30597e913 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:53.982302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c266328-e46c-4b51-b790-b6b30597e913 None admin] PATH_INFO: `/v3/services/network` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:53.982995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c266328-e46c-4b51-b790-b6b30597e913 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:53.984445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c266328-e46c-4b51-b790-b6b30597e913 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-4c266328-e46c-4b51-b790-b6b30597e913 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:54.005441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:54.006520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:54.006520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:54.006520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:54.006520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:54.006520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:54.006520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:54.006520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:04:54.006520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:04:54.006520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:04:54.006520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:04:54.006520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:54.006520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:54.006520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:54.006520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:54.006520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:54.006520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:54.007349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:54.007349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:54.007349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:54.007349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:54.007349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:54.007349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:54.007349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:54.007349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:54.007349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:54.007349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:54.007349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:04:54.007349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:04:54.007349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 14:04:54.007349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:54.015098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 378/772] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:53 2022] GET /identity/v3/services/network => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:54.018939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c266328-e46c-4b51-b790-b6b30597e913 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:54.023249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adbf6a-4492-4151-b5ea-00e3bbe05a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:54.023954 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adbf6a-4492-4151-b5ea-00e3bbe05a33 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:54.024245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adbf6a-4492-4151-b5ea-00e3bbe05a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:54.024532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adbf6a-4492-4151-b5ea-00e3bbe05a33 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:54.025284 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89adbf6a-4492-4151-b5ea-00e3bbe05a33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:54.025599 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89adbf6a-4492-4151-b5ea-00e3bbe05a33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:54.027043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89adbf6a-4492-4151-b5ea-00e3bbe05a33 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:54.057981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 395/773] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:54.063355 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adbf6a-4492-4151-b5ea-00e3bbe05a33 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:54.139801 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c266328-e46c-4b51-b790-b6b30597e913 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:54.162266 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:54.199121 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcdc0f-1ce6-4525-b927-74ce11175738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:54.199829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcdc0f-1ce6-4525-b927-74ce11175738 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:54.200138 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcdc0f-1ce6-4525-b927-74ce11175738 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:54.200441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcdc0f-1ce6-4525-b927-74ce11175738 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:54.201214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcdc0f-1ce6-4525-b927-74ce11175738 None admin] RBAC: Adding query filter params (name=network) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:54.201525 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcdc0f-1ce6-4525-b927-74ce11175738 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:54.202970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcdc0f-1ce6-4525-b927-74ce11175738 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:54.208031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 379/774] 10.222.0.99 () {56 vars in 1112 bytes} [Mon Jul 18 14:04:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:54.215247 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcdc0f-1ce6-4525-b927-74ce11175738 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:54.251042 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adbf6a-4492-4151-b5ea-00e3bbe05a33 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:54.262787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:54.321882 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99699d-c7b3-4d5a-a3a3-f3ed215763e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:54.322850 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99699d-c7b3-4d5a-a3a3-f3ed215763e9 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:54.323221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99699d-c7b3-4d5a-a3a3-f3ed215763e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:54.323469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99699d-c7b3-4d5a-a3a3-f3ed215763e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:54.330776 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99699d-c7b3-4d5a-a3a3-f3ed215763e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:54.332383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99699d-c7b3-4d5a-a3a3-f3ed215763e9 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:54.347542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-9e99699d-c7b3-4d5a-a3a3-f3ed215763e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:54.347542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:54.347542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:54.347542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:54.347542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:54.347542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:54.347542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:54.347542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:54.347542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:54.347542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:54.347542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:54.347542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:54.347542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:54.347542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:54.347542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:54.348448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:54.349329 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:54.349329 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:54.349329 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:54.349329 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:54.349329 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:54.349329 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:54.349329 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:54.349329 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:54.349329 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 396/775] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:54.355798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcdc0f-1ce6-4525-b927-74ce11175738 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:54.356613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99699d-c7b3-4d5a-a3a3-f3ed215763e9 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:54.416323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac0759-0680-44f2-886b-013f19c68865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:54.419221 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac0759-0680-44f2-886b-013f19c68865 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:54.419724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac0759-0680-44f2-886b-013f19c68865 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:54.420225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac0759-0680-44f2-886b-013f19c68865 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:54.421310 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac0759-0680-44f2-886b-013f19c68865 None admin] RBAC: Adding query filter params (type=network) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:54.422604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac0759-0680-44f2-886b-013f19c68865 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:54.426625 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac0759-0680-44f2-886b-013f19c68865 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:54.437275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 380/776] 10.222.0.99 () {56 vars in 1112 bytes} [Mon Jul 18 14:04:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:54.444327 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac0759-0680-44f2-886b-013f19c68865 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:54.536493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:54.544347 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99699d-c7b3-4d5a-a3a3-f3ed215763e9 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:54.596667 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e220d-5a7e-45be-b41a-42fcb23e8bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:54.597721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e220d-5a7e-45be-b41a-42fcb23e8bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:54.598902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e220d-5a7e-45be-b41a-42fcb23e8bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:54.599373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e220d-5a7e-45be-b41a-42fcb23e8bc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:54.600448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e220d-5a7e-45be-b41a-42fcb23e8bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:54.601085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e220d-5a7e-45be-b41a-42fcb23e8bc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:54.603515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e220d-5a7e-45be-b41a-42fcb23e8bc5 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:54.617911 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:54.631862 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 397/777] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:54.634971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e220d-5a7e-45be-b41a-42fcb23e8bc5 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:54.637324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac0759-0680-44f2-886b-013f19c68865 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:54.701085 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d9b17-3550-4120-aed3-a5a97a7380f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:54.706222 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9b17-3550-4120-aed3-a5a97a7380f9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:54.706776 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9b17-3550-4120-aed3-a5a97a7380f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:54.707248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d9b17-3550-4120-aed3-a5a97a7380f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:54.708241 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d9b17-3550-4120-aed3-a5a97a7380f9 None admin] RBAC: Adding query filter params (interface=public, service_id=7ee517b1839c4147abe84f251e5ab25c, region_id=RegionOne) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:54.708742 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d9b17-3550-4120-aed3-a5a97a7380f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:54.710453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d9b17-3550-4120-aed3-a5a97a7380f9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:54.723160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 381/778] 10.222.0.99 () {56 vars in 1251 bytes} [Mon Jul 18 14:04:54 2022] GET /identity/v3/endpoints?service_id=7ee517b1839c4147abe84f251e5ab25c&interface=public®ion_id=RegionOne => generated 194 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:04:54.728244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d9b17-3550-4120-aed3-a5a97a7380f9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:54.827863 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e220d-5a7e-45be-b41a-42fcb23e8bc5 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:54.895359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cd572-cf3a-4bfe-8dbe-8eb8961c6a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:54.896024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cd572-cf3a-4bfe-8dbe-8eb8961c6a7e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:54.896308 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cd572-cf3a-4bfe-8dbe-8eb8961c6a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:54.896587 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cd572-cf3a-4bfe-8dbe-8eb8961c6a7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:54.897426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cd572-cf3a-4bfe-8dbe-8eb8961c6a7e None admin] RBAC: Adding query filter params (role.id=ea9f1b43d91c4665ba5af180f55c663c, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=8f3ee6a031214346a20cdfcb7fb551d3) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:54.897740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cd572-cf3a-4bfe-8dbe-8eb8961c6a7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:54.899211 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6cd572-cf3a-4bfe-8dbe-8eb8961c6a7e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:54.910425 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 398/779] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:04:54 2022] GET /identity/v3/role_assignments?user.id=8f3ee6a031214346a20cdfcb7fb551d3&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=ea9f1b43d91c4665ba5af180f55c663c => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:54.955065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d9b17-3550-4120-aed3-a5a97a7380f9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:55.017518 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50036b-15c3-4e23-80dd-125128708feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:55.018208 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50036b-15c3-4e23-80dd-125128708feb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:55.018523 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50036b-15c3-4e23-80dd-125128708feb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:55.018914 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50036b-15c3-4e23-80dd-125128708feb None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:55.019628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50036b-15c3-4e23-80dd-125128708feb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:55.021043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50036b-15c3-4e23-80dd-125128708feb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:55.031386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 382/780] 10.222.0.99 () {56 vars in 1087 bytes} [Mon Jul 18 14:04:54 2022] GET /identity/v3/services => generated 772 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:55.076011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3000f-4d7c-4a4b-9c84-30048b2344c0 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:55.076544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3000f-4d7c-4a4b-9c84-30048b2344c0 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:55.076544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3000f-4d7c-4a4b-9c84-30048b2344c0 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:55.078262 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 399/781] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:55.084343 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9eb913-e4c2-4bd2-9993-9757d59636a1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:55.084675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9eb913-e4c2-4bd2-9993-9757d59636a1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:55.084913 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9eb913-e4c2-4bd2-9993-9757d59636a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:55.098435 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee093fd8-0561-4c02-81a4-68d91bb3bb46 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:55.099155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee093fd8-0561-4c02-81a4-68d91bb3bb46 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:55.099641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee093fd8-0561-4c02-81a4-68d91bb3bb46 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:55.101652 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 400/782] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:04:55.106907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cc9eb913-e4c2-4bd2-9993-9757d59636a1 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:55.108010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0b245-0090-4fb7-8d3e-767ef8993f79 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:55.108124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cc9eb913-e4c2-4bd2-9993-9757d59636a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:55.108606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0b245-0090-4fb7-8d3e-767ef8993f79 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:55.109124 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0b245-0090-4fb7-8d3e-767ef8993f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:55.133169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-05a0b245-0090-4fb7-8d3e-767ef8993f79 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:55.134424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-05a0b245-0090-4fb7-8d3e-767ef8993f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:55.134901 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:55.160110 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:55.209330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 383/783] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:04:55.236638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9eb913-e4c2-4bd2-9993-9757d59636a1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:55.238535 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 401/784] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:04:55.261417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0b245-0090-4fb7-8d3e-767ef8993f79 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:55.406270 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0b245-0090-4fb7-8d3e-767ef8993f79 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:55.419909 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9eb913-e4c2-4bd2-9993-9757d59636a1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:55.448865 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5e88c-6513-41b0-8ee9-22df19398468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:55.449674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5e88c-6513-41b0-8ee9-22df19398468 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:55.449957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5e88c-6513-41b0-8ee9-22df19398468 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:55.450235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5e88c-6513-41b0-8ee9-22df19398468 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:55.475741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5e88c-6513-41b0-8ee9-22df19398468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:55.489465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-7ac5e88c-6513-41b0-8ee9-22df19398468 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:04:55.489465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:55.489465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:55.489465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:55.489465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:55.489465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:55.489465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:55.489465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:55.489465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:55.489465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:55.489465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:55.489465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:55.489465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:55.489465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:55.489465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:55.489465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:55.490445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:55.490445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:55.490445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:55.490445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:55.490445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:55.490445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:55.490445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:55.490445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:55.490445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:55.490445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:55.490445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:55.490445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:55.490445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:55.490445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:55.490445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:55.490445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:55.491286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:55.491286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:55.491286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:55.491286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:55.491286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:55.491286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:55.491286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:55.491286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:55.491286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:55.491286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:55.491286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:04:55.491286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:55.491286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 402/785] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:04:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:55.498215 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47cd96-7cd8-44c4-a578-a14ab72c55d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:55.499332 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5e88c-6513-41b0-8ee9-22df19398468 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:55.499855 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47cd96-7cd8-44c4-a578-a14ab72c55d5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:55.500322 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47cd96-7cd8-44c4-a578-a14ab72c55d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:55.500783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47cd96-7cd8-44c4-a578-a14ab72c55d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:55.517368 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47cd96-7cd8-44c4-a578-a14ab72c55d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:55.525325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-5b47cd96-7cd8-44c4-a578-a14ab72c55d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:04:55.525325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:55.525325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:55.525325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:55.525325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:55.525325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:55.525325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:55.525325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:55.525325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:55.525325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:55.525325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:55.525325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:55.525325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:55.525325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:55.525325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:55.525325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:55.526240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:55.526240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:55.526240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:55.526240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:55.526240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:55.526240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:55.526240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:55.526240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:55.526240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:55.526240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:55.526240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:55.526240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:55.526240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:55.526240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:55.526240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:55.526240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:55.527103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:55.527103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:55.527103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:55.527103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:55.527103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:55.527103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:55.527103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:55.527103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:55.527103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:55.527103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:55.527103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:04:55.527103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:55.529869 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 384/786] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:04:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:55.541731 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47cd96-7cd8-44c4-a578-a14ab72c55d5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:55.541926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:55.560730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:55.702354 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5e88c-6513-41b0-8ee9-22df19398468 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:55.716869 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47cd96-7cd8-44c4-a578-a14ab72c55d5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:55.760448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622266c-1146-407b-8161-0fe0801cce5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:55.761125 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622266c-1146-407b-8161-0fe0801cce5a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:55.761410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622266c-1146-407b-8161-0fe0801cce5a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:55.761687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622266c-1146-407b-8161-0fe0801cce5a None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:55.762471 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622266c-1146-407b-8161-0fe0801cce5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:55.762780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622266c-1146-407b-8161-0fe0801cce5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:55.764186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622266c-1146-407b-8161-0fe0801cce5a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:55.778483 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfed763-7af8-410a-a0b0-7e0181d367ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:55.779164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfed763-7af8-410a-a0b0-7e0181d367ff None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:55.779449 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfed763-7af8-410a-a0b0-7e0181d367ff None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:55.779731 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfed763-7af8-410a-a0b0-7e0181d367ff None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:55.780491 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfed763-7af8-410a-a0b0-7e0181d367ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:55.780803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfed763-7af8-410a-a0b0-7e0181d367ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:55.782251 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfed763-7af8-410a-a0b0-7e0181d367ff None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:55.787182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 385/787] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:55.792478 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622266c-1146-407b-8161-0fe0801cce5a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:55.798853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 403/788] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:04:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:55.807819 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfed763-7af8-410a-a0b0-7e0181d367ff None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:55.880933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:55.908311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:55.917076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622266c-1146-407b-8161-0fe0801cce5a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:55.951194 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfed763-7af8-410a-a0b0-7e0181d367ff None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:55.952704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df8178-27ed-47b3-9a86-c03f1463b139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:55.953551 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df8178-27ed-47b3-9a86-c03f1463b139 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:55.953941 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df8178-27ed-47b3-9a86-c03f1463b139 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:55.954382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df8178-27ed-47b3-9a86-c03f1463b139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:55.967230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df8178-27ed-47b3-9a86-c03f1463b139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:55.968952 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df8178-27ed-47b3-9a86-c03f1463b139 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:55.987533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b8df8178-27ed-47b3-9a86-c03f1463b139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:55.987533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:55.987533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:55.987533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:55.987533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:55.987533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:55.987533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:55.987533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:55.987533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:55.987533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:55.987533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:55.987533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:55.987533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:55.987533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:55.987533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:55.988669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:55.989790 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:55.989790 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:55.989790 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:55.989790 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:55.995801 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 386/789] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:55.995801 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d43a2-7dd2-4554-adf1-ba1fae3d7405 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:55.995801 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d43a2-7dd2-4554-adf1-ba1fae3d7405 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:55.995801 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d43a2-7dd2-4554-adf1-ba1fae3d7405 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:55.995801 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 387/790] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:55.996936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d43a2-7dd2-4554-adf1-ba1fae3d7405 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:56.000660 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a112fe-8730-4265-b78c-b9a648c8d3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:56.002736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a112fe-8730-4265-b78c-b9a648c8d3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:56.003161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a112fe-8730-4265-b78c-b9a648c8d3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:56.003538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a112fe-8730-4265-b78c-b9a648c8d3e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:56.015200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a112fe-8730-4265-b78c-b9a648c8d3e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:56.016841 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a112fe-8730-4265-b78c-b9a648c8d3e6 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:56.035493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-55a112fe-8730-4265-b78c-b9a648c8d3e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:56.035493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:56.035493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:56.035493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:56.035493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:56.035493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:56.035493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:56.035493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:56.035493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:56.035493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:56.035493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:56.035493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:56.035493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:56.035493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:56.035493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:56.036645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:56.037795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:56.037795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:56.037795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:56.037795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:56.043883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 404/791] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:56.043883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a34ef-f553-44da-975c-60d1f86c2f6e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:56.043883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a34ef-f553-44da-975c-60d1f86c2f6e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:56.043883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a34ef-f553-44da-975c-60d1f86c2f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:56.060183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-216a34ef-f553-44da-975c-60d1f86c2f6e None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:56.061504 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-216a34ef-f553-44da-975c-60d1f86c2f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:56.134374 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d43a2-7dd2-4554-adf1-ba1fae3d7405 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:56.139613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 405/792] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:04:56.140982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a34ef-f553-44da-975c-60d1f86c2f6e None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:56.184174 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:56.198321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ead613-d25b-4378-b015-634a9eebdbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:56.199246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ead613-d25b-4378-b015-634a9eebdbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:56.199674 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ead613-d25b-4378-b015-634a9eebdbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:56.200120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ead613-d25b-4378-b015-634a9eebdbd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:56.200998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ead613-d25b-4378-b015-634a9eebdbd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:56.201449 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ead613-d25b-4378-b015-634a9eebdbd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:56.203071 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ead613-d25b-4378-b015-634a9eebdbd1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:56.216103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 388/793] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:56.221660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ead613-d25b-4378-b015-634a9eebdbd1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:56.222092 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:56.281417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a34ef-f553-44da-975c-60d1f86c2f6e None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:56.329593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89c00e-b3ee-4ca9-8a54-615ebec87b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:56.330288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89c00e-b3ee-4ca9-8a54-615ebec87b44 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:56.330670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89c00e-b3ee-4ca9-8a54-615ebec87b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:56.330949 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89c00e-b3ee-4ca9-8a54-615ebec87b44 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:56.331758 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89c00e-b3ee-4ca9-8a54-615ebec87b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:56.332064 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89c00e-b3ee-4ca9-8a54-615ebec87b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:56.332398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ead613-d25b-4378-b015-634a9eebdbd1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:56.333522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89c00e-b3ee-4ca9-8a54-615ebec87b44 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:56.349935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 406/794] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:56.351153 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89c00e-b3ee-4ca9-8a54-615ebec87b44 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:56.371822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d032bd-ac4d-4f0d-97ed-9c4fd900d9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:56.372641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d032bd-ac4d-4f0d-97ed-9c4fd900d9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:56.372924 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d032bd-ac4d-4f0d-97ed-9c4fd900d9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:56.373200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d032bd-ac4d-4f0d-97ed-9c4fd900d9c8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:56.373966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d032bd-ac4d-4f0d-97ed-9c4fd900d9c8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:56.375819 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d032bd-ac4d-4f0d-97ed-9c4fd900d9c8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:56.389007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-71d032bd-ac4d-4f0d-97ed-9c4fd900d9c8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 14:04:56.389007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:56.389007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:04:56.389007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:04:56.389007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:04:56.389007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:04:56.389007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:04:56.389007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:04:56.389007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 14:04:56.389007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:56.389007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:04:56.389007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:56.389007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:56.389007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:56.389007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:56.389007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:56.389950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:56.389950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:56.389950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:56.389950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:56.389950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:56.389950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:56.389950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:56.389950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:04:56.389950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:04:56.389950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:04:56.389950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:04:56.389950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:56.389950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:56.389950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:56.389950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:56.389950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:56.390879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:56.390879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:56.390879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:56.390879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:56.390879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:56.390879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:56.390879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:56.390879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:56.390879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:56.390879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:56.390879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:56.390879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:04:56.390879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:04:56.390879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 14:04:56.390879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:56.390879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 389/795] 10.222.0.99 () {56 vars in 1129 bytes} [Mon Jul 18 14:04:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:56.392522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d032bd-ac4d-4f0d-97ed-9c4fd900d9c8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:56.452404 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:56.463076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89c00e-b3ee-4ca9-8a54-615ebec87b44 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:56.477394 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:56.501493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ccee8-a0a7-4bc9-908c-ba6ea23076ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:56.502579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ccee8-a0a7-4bc9-908c-ba6ea23076ef None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:56.503007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ccee8-a0a7-4bc9-908c-ba6ea23076ef None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:56.503455 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ccee8-a0a7-4bc9-908c-ba6ea23076ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:56.511670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ccee8-a0a7-4bc9-908c-ba6ea23076ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:56.513292 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ccee8-a0a7-4bc9-908c-ba6ea23076ef None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:56.518843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d032bd-ac4d-4f0d-97ed-9c4fd900d9c8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:56.528164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-a25ccee8-a0a7-4bc9-908c-ba6ea23076ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:04:56.528164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:56.528164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:56.528164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:56.528164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:56.528164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:56.528164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:56.528164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:56.528164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:56.528164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:56.528164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:56.528164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:56.528164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:56.528164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:56.528164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:56.528164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:56.529297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:56.530349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:56.530349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:56.530349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:56.530349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:56.530349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:56.530349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:56.530349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:56.530349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:56.530349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:04:56.530349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:56.532354 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 407/796] 10.222.0.99 () {56 vars in 1093 bytes} [Mon Jul 18 14:04:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:56.533263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ccee8-a0a7-4bc9-908c-ba6ea23076ef None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:56.556112 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff60dd-5ed6-4524-86ac-ffc1e708056d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:56.557242 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff60dd-5ed6-4524-86ac-ffc1e708056d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:56.557625 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff60dd-5ed6-4524-86ac-ffc1e708056d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:56.557902 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff60dd-5ed6-4524-86ac-ffc1e708056d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:56.567483 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff60dd-5ed6-4524-86ac-ffc1e708056d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:56.569108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff60dd-5ed6-4524-86ac-ffc1e708056d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:56.584106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-7cff60dd-5ed6-4524-86ac-ffc1e708056d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 14:04:56.584106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:56.584106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:56.584106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:56.584106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:56.584106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:56.584106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:56.584106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:56.584106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:56.584106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:56.584106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:56.584106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:56.584106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:56.584106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:56.584106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:56.584106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:56.585065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:56.586000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:56.586000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:56.586000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:56.586000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:56.586000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:56.586000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:56.586000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:56.586000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:56.586000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 14:04:56.586000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:56.586000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 390/797] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:04:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:56.586918 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff60dd-5ed6-4524-86ac-ffc1e708056d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:56.639408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ccee8-a0a7-4bc9-908c-ba6ea23076ef None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:56.674037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5e086-ec16-40c8-9eb0-5b63c44d7d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:56.675078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e086-ec16-40c8-9eb0-5b63c44d7d1e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:56.675580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e086-ec16-40c8-9eb0-5b63c44d7d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:56.676064 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5e086-ec16-40c8-9eb0-5b63c44d7d1e None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:56.677000 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5e086-ec16-40c8-9eb0-5b63c44d7d1e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:56.677530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5e086-ec16-40c8-9eb0-5b63c44d7d1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:56.679137 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5e086-ec16-40c8-9eb0-5b63c44d7d1e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:56.684534 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 408/798] 10.222.0.99 () {56 vars in 1124 bytes} [Mon Jul 18 14:04:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:56.685568 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5e086-ec16-40c8-9eb0-5b63c44d7d1e None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:56.699321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff60dd-5ed6-4524-86ac-ffc1e708056d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:56.707262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:56.734013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:56.743627 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f03d5-1fb9-4b53-9615-824e5d660dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:56.744304 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f03d5-1fb9-4b53-9615-824e5d660dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:56.744584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f03d5-1fb9-4b53-9615-824e5d660dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:56.744855 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f03d5-1fb9-4b53-9615-824e5d660dc5 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:56.745807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f03d5-1fb9-4b53-9615-824e5d660dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:56.746161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f03d5-1fb9-4b53-9615-824e5d660dc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:56.747814 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f03d5-1fb9-4b53-9615-824e5d660dc5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:56.767451 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 391/799] 10.222.0.99 () {56 vars in 1133 bytes} [Mon Jul 18 14:04:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:56.768548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f03d5-1fb9-4b53-9615-824e5d660dc5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:56.798835 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5e086-ec16-40c8-9eb0-5b63c44d7d1e None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:56.833774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684f411-fb3e-4faa-9f42-e193579462c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:56.834899 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684f411-fb3e-4faa-9f42-e193579462c9 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:56.835392 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684f411-fb3e-4faa-9f42-e193579462c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:56.835870 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684f411-fb3e-4faa-9f42-e193579462c9 None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:56.836939 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684f411-fb3e-4faa-9f42-e193579462c9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:56.837452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684f411-fb3e-4faa-9f42-e193579462c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:56.839117 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684f411-fb3e-4faa-9f42-e193579462c9 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:56.857357 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 409/800] 10.222.0.99 () {56 vars in 1135 bytes} [Mon Jul 18 14:04:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:56.858561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684f411-fb3e-4faa-9f42-e193579462c9 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:56.877562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f03d5-1fb9-4b53-9615-824e5d660dc5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:56.914589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ade7c-1d40-4adf-92fd-359fe8da804b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:56.915174 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ade7c-1d40-4adf-92fd-359fe8da804b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:56.915453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ade7c-1d40-4adf-92fd-359fe8da804b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:56.915723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ade7c-1d40-4adf-92fd-359fe8da804b None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:56.916428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ade7c-1d40-4adf-92fd-359fe8da804b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:56.916819 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ade7c-1d40-4adf-92fd-359fe8da804b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:56.918167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ade7c-1d40-4adf-92fd-359fe8da804b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:56.924014 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 392/801] 10.222.0.99 () {56 vars in 1124 bytes} [Mon Jul 18 14:04:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:56.924604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ade7c-1d40-4adf-92fd-359fe8da804b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:56.958646 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:56.960217 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:56.965427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684f411-fb3e-4faa-9f42-e193579462c9 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:57.005036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90105a5-4120-4603-a8df-302b649a5c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:57.006035 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90105a5-4120-4603-a8df-302b649a5c8a None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:57.006559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90105a5-4120-4603-a8df-302b649a5c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:57.007040 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90105a5-4120-4603-a8df-302b649a5c8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:57.058111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ade7c-1d40-4adf-92fd-359fe8da804b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:57.094111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90105a5-4120-4603-a8df-302b649a5c8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:57.095958 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90105a5-4120-4603-a8df-302b649a5c8a None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:57.109003 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b53b4-8466-4430-bfd7-15ff60746c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:57.109798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b53b4-8466-4430-bfd7-15ff60746c15 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:57.110075 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b53b4-8466-4430-bfd7-15ff60746c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:57.110417 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b53b4-8466-4430-bfd7-15ff60746c15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:57.121880 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b53b4-8466-4430-bfd7-15ff60746c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:57.123373 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b53b4-8466-4430-bfd7-15ff60746c15 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:57.141671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-7c0b53b4-8466-4430-bfd7-15ff60746c15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:57.141671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:57.141671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:57.141671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:57.141671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:57.141671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:57.141671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:57.141671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:57.141671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:57.141671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:57.141671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:57.141671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:57.141671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:57.141671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:57.141671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:57.144696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:57.145594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:57.145594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:57.145594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:57.145594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:57.145594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 393/802] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:57.145594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b53b4-8466-4430-bfd7-15ff60746c15 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:57.207687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:57.215616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 410/803] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:04:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 14:04:57.216949 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c2dc4-3dea-4ee7-a136-8f311f5cc284 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:57.217235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c2dc4-3dea-4ee7-a136-8f311f5cc284 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:57.217507 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c2dc4-3dea-4ee7-a136-8f311f5cc284 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:57.218948 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 411/804] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:57.219433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c2dc4-3dea-4ee7-a136-8f311f5cc284 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:57.239382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:57.260128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b53b4-8466-4430-bfd7-15ff60746c15 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:57.295466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf88be-7b20-4cdb-a0b5-33f7234ead9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:57.296133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf88be-7b20-4cdb-a0b5-33f7234ead9b None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:57.296421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf88be-7b20-4cdb-a0b5-33f7234ead9b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:57.296928 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf88be-7b20-4cdb-a0b5-33f7234ead9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:57.297445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf88be-7b20-4cdb-a0b5-33f7234ead9b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:57.298930 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf88be-7b20-4cdb-a0b5-33f7234ead9b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:57.320548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 394/805] 10.222.0.99 () {60 vars in 1144 bytes} [Mon Jul 18 14:04:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:04:57.321375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf88be-7b20-4cdb-a0b5-33f7234ead9b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:57.341282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c2dc4-3dea-4ee7-a136-8f311f5cc284 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:57.389384 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e82693-47e3-4d0d-a032-6aff7b723c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:57.390619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e82693-47e3-4d0d-a032-6aff7b723c9c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:57.391150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e82693-47e3-4d0d-a032-6aff7b723c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:57.391697 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e82693-47e3-4d0d-a032-6aff7b723c9c None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:57.393128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e82693-47e3-4d0d-a032-6aff7b723c9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:57.393774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e82693-47e3-4d0d-a032-6aff7b723c9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:57.395666 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e82693-47e3-4d0d-a032-6aff7b723c9c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:57.410236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 412/806] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:57.411744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d376521-c100-4177-9602-31d4f56dbf65 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:57.412038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d376521-c100-4177-9602-31d4f56dbf65 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:57.412321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d376521-c100-4177-9602-31d4f56dbf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:57.429589 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-5d376521-c100-4177-9602-31d4f56dbf65 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:57.430859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5d376521-c100-4177-9602-31d4f56dbf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:57.452248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf88be-7b20-4cdb-a0b5-33f7234ead9b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:57.485426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:57.496914 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63205f-a5a1-4f15-8e62-23a0079d9154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:57.497799 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63205f-a5a1-4f15-8e62-23a0079d9154 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:57.498088 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63205f-a5a1-4f15-8e62-23a0079d9154 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:57.498368 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63205f-a5a1-4f15-8e62-23a0079d9154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:57.501714 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:57.512090 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63205f-a5a1-4f15-8e62-23a0079d9154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:57.513494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63205f-a5a1-4f15-8e62-23a0079d9154 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:57.514479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 413/807] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:04:57.515877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662ba0d-dc91-4beb-ab09-f86aea9deb7c None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:57.516168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662ba0d-dc91-4beb-ab09-f86aea9deb7c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:57.516477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662ba0d-dc91-4beb-ab09-f86aea9deb7c None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:57.517950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 414/808] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:57.519505 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662ba0d-dc91-4beb-ab09-f86aea9deb7c None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:57.536330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-5a63205f-a5a1-4f15-8e62-23a0079d9154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:57.536330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:57.536330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:57.536330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:57.536330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:57.536330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:57.536330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:57.536330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:57.536330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:57.536330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:57.536330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:57.536330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:57.536330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:57.536330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:57.536330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:57.537450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:57.538379 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:57.538379 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:57.538379 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:57.538379 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:57.538379 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 395/809] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:57.539104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28980953-ddc4-4bfa-8ac2-f5da87c08add None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:57.539382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28980953-ddc4-4bfa-8ac2-f5da87c08add None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:57.539654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28980953-ddc4-4bfa-8ac2-f5da87c08add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:57.558049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-28980953-ddc4-4bfa-8ac2-f5da87c08add None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:57.559279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-28980953-ddc4-4bfa-8ac2-f5da87c08add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:57.628328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662ba0d-dc91-4beb-ab09-f86aea9deb7c None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:57.634475 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 396/810] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:04:57.634475 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28980953-ddc4-4bfa-8ac2-f5da87c08add None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:57.668906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9b7b5-bb44-4729-be91-46308ce1f3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:57.669707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9b7b5-bb44-4729-be91-46308ce1f3cc None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:57.669987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9b7b5-bb44-4729-be91-46308ce1f3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:57.670257 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9b7b5-bb44-4729-be91-46308ce1f3cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:57.677238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9b7b5-bb44-4729-be91-46308ce1f3cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:57.678713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9b7b5-bb44-4729-be91-46308ce1f3cc None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:57.692692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-31b9b7b5-bb44-4729-be91-46308ce1f3cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:57.692692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:57.692692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:57.692692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:57.692692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:57.692692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:57.692692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:57.692692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:57.692692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:57.692692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:57.692692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:57.692692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:57.692692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:57.692692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:57.692692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:57.693621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:57.694529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:57.694529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:57.694529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:57.694529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:57.694529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:57.694529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:57.694529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:57.694529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:57.694529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 415/811] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:57.695129 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9b7b5-bb44-4729-be91-46308ce1f3cc None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:57.741244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:57.755697 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28980953-ddc4-4bfa-8ac2-f5da87c08add None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:57.774288 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:57.793024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c70de8-24a8-4fb2-9796-4a6326677484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:57.793681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c70de8-24a8-4fb2-9796-4a6326677484 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:57.793958 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c70de8-24a8-4fb2-9796-4a6326677484 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:57.794228 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c70de8-24a8-4fb2-9796-4a6326677484 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:57.794980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c70de8-24a8-4fb2-9796-4a6326677484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:57.795534 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c70de8-24a8-4fb2-9796-4a6326677484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:57.796659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c70de8-24a8-4fb2-9796-4a6326677484 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:57.804231 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9b7b5-bb44-4729-be91-46308ce1f3cc None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:57.808395 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 397/812] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:57.811306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c70de8-24a8-4fb2-9796-4a6326677484 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:57.839317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413e893-fe8f-4705-b6f8-c120cfb0678a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:57.840111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413e893-fe8f-4705-b6f8-c120cfb0678a None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:57.840395 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413e893-fe8f-4705-b6f8-c120cfb0678a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:57.840669 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413e893-fe8f-4705-b6f8-c120cfb0678a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:57.850920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413e893-fe8f-4705-b6f8-c120cfb0678a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:04:57.858508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-3413e893-fe8f-4705-b6f8-c120cfb0678a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:57.858508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:57.858508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:57.858508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:57.858508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:57.858508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:57.858508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:57.858508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:57.858508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:57.858508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:57.858508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:57.858508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:57.858508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:04:57.858508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:04:57.858508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:04:57.858508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:04:57.859464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:04:57.859464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:04:57.859464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:04:57.859464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:04:57.859464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:57.859464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:57.859464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:57.859464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:57.859464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:57.859464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:57.859464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:57.859464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:57.859464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:57.859464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:57.859464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:57.859464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:57.860383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:57.860383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:57.860383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:57.860383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:57.860383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:04:57.860383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:04:57.860383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:04:57.860383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:04:57.860383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:04:57.860383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:04:57.860383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:04:57.860383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:57.860383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 416/813] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:04:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:57.861700 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413e893-fe8f-4705-b6f8-c120cfb0678a None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:57.931521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c70de8-24a8-4fb2-9796-4a6326677484 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:57.967785 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6baf2-ac75-4b79-9459-d41e5215b47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:57.968619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6baf2-ac75-4b79-9459-d41e5215b47a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:57.968913 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6baf2-ac75-4b79-9459-d41e5215b47a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:57.969190 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6baf2-ac75-4b79-9459-d41e5215b47a None admin] PATH_INFO: `/v3/services/network` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:57.969902 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6baf2-ac75-4b79-9459-d41e5215b47a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:57.970568 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413e893-fe8f-4705-b6f8-c120cfb0678a None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:57.971339 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6baf2-ac75-4b79-9459-d41e5215b47a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:57.972301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-7df6baf2-ac75-4b79-9459-d41e5215b47a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:57.984405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:57.985536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:57.985536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:57.985536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:57.985536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:57.985536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:57.985536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:57.985536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:04:57.985536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:04:57.985536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:04:57.985536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:04:57.985536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:57.985536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:57.985536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:57.985536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:57.985536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:57.985536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:57.987158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:57.987158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:57.987158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:57.987158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:57.987158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:57.987158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:57.987158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:57.987158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:57.987158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:57.987158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:57.987158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:04:57.987158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:04:57.987158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 14:04:57.987158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:57.987158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 398/814] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:57 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:57.987985 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6baf2-ac75-4b79-9459-d41e5215b47a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:58.013837 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a44b9a-168b-42a9-acd5-a2bd1981a0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:58.014626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44b9a-168b-42a9-acd5-a2bd1981a0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:58.014988 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44b9a-168b-42a9-acd5-a2bd1981a0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:58.015350 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44b9a-168b-42a9-acd5-a2bd1981a0a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:58.016217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a44b9a-168b-42a9-acd5-a2bd1981a0a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:58.016633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a44b9a-168b-42a9-acd5-a2bd1981a0a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:58.018128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a44b9a-168b-42a9-acd5-a2bd1981a0a7 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:58.035328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 417/815] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:58.035328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a44b9a-168b-42a9-acd5-a2bd1981a0a7 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:58.038182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:58.103334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6baf2-ac75-4b79-9459-d41e5215b47a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:58.142209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a44b9a-168b-42a9-acd5-a2bd1981a0a7 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:58.145970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc2773-a913-4577-b021-d46eee49eb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:58.146982 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc2773-a913-4577-b021-d46eee49eb5d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:58.147334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc2773-a913-4577-b021-d46eee49eb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:58.147681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc2773-a913-4577-b021-d46eee49eb5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:58.155016 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc2773-a913-4577-b021-d46eee49eb5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:58.156608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc2773-a913-4577-b021-d46eee49eb5d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:58.172634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-74fc2773-a913-4577-b021-d46eee49eb5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:58.172634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:58.172634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:58.172634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:58.172634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:58.172634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:58.172634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:58.172634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:58.172634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:58.172634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:58.172634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:58.172634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:58.172634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:58.172634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:58.172634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:58.173647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:58.174593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:58.174593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:58.174593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:58.174593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:58.174593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:58.174593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:58.174593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:58.174593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:58.174593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 399/816] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:58.175085 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc2773-a913-4577-b021-d46eee49eb5d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:58.184529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6058d3d-994f-432e-a29f-c5daa7c76898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:58.185202 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6058d3d-994f-432e-a29f-c5daa7c76898 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:58.185485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6058d3d-994f-432e-a29f-c5daa7c76898 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:58.185761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6058d3d-994f-432e-a29f-c5daa7c76898 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:58.186538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6058d3d-994f-432e-a29f-c5daa7c76898 None admin] RBAC: Adding query filter params (name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:58.186847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6058d3d-994f-432e-a29f-c5daa7c76898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:58.188211 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6058d3d-994f-432e-a29f-c5daa7c76898 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:58.196474 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 418/817] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:04:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:58.197239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6058d3d-994f-432e-a29f-c5daa7c76898 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:58.222867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:58.287659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc2773-a913-4577-b021-d46eee49eb5d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:58.289316 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:58.301386 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6058d3d-994f-432e-a29f-c5daa7c76898 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:58.325231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fa345-b36b-4bad-bd07-af2ca95f039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:58.325895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fa345-b36b-4bad-bd07-af2ca95f039e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:58.326179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fa345-b36b-4bad-bd07-af2ca95f039e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:58.326559 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fa345-b36b-4bad-bd07-af2ca95f039e None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:58.327273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fa345-b36b-4bad-bd07-af2ca95f039e None admin] RBAC: Adding query filter params (name=network) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:58.327579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fa345-b36b-4bad-bd07-af2ca95f039e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:58.328988 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fa345-b36b-4bad-bd07-af2ca95f039e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:58.339375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 400/818] 10.222.0.99 () {56 vars in 1112 bytes} [Mon Jul 18 14:04:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:58.339375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fa345-b36b-4bad-bd07-af2ca95f039e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:58.346893 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b5df6-90b4-473b-8997-376ca3e099a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:58.347799 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b5df6-90b4-473b-8997-376ca3e099a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:58.348082 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b5df6-90b4-473b-8997-376ca3e099a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:58.348360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b5df6-90b4-473b-8997-376ca3e099a1 None admin] PATH_INFO: `/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/55fe1a286c2045d5bcd49895a878a3bf/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:58.351064 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b5df6-90b4-473b-8997-376ca3e099a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=50b78e16c86b4e6cac3a725f536a8274, user_id=55fe1a286c2045d5bcd49895a878a3bf, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:58.353457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b5df6-90b4-473b-8997-376ca3e099a1 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:58.369476 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 419/819] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:04:58 2022] PUT /identity/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/55fe1a286c2045d5bcd49895a878a3bf/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:04:58.379617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b5df6-90b4-473b-8997-376ca3e099a1 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:58.463568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fa345-b36b-4bad-bd07-af2ca95f039e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:58.502898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eae46a-873f-45f0-9c9a-4c437f304330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:58.503922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eae46a-873f-45f0-9c9a-4c437f304330 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:58.504426 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eae46a-873f-45f0-9c9a-4c437f304330 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:58.504856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eae46a-873f-45f0-9c9a-4c437f304330 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:58.505827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eae46a-873f-45f0-9c9a-4c437f304330 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:58.506285 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eae46a-873f-45f0-9c9a-4c437f304330 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:58.507928 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eae46a-873f-45f0-9c9a-4c437f304330 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:58.513489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:58.524098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 401/820] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:58.526167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eae46a-873f-45f0-9c9a-4c437f304330 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:58.534841 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b5df6-90b4-473b-8997-376ca3e099a1 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:58.562472 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:58.577224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ff69e-7ffb-4ccb-89ef-679f51879130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:58.578167 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ff69e-7ffb-4ccb-89ef-679f51879130 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:58.579223 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ff69e-7ffb-4ccb-89ef-679f51879130 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:58.579223 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ff69e-7ffb-4ccb-89ef-679f51879130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:58.592365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ff69e-7ffb-4ccb-89ef-679f51879130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:58.593823 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ff69e-7ffb-4ccb-89ef-679f51879130 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:58.615591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-773ff69e-7ffb-4ccb-89ef-679f51879130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:58.615591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:58.615591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:58.615591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:58.615591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:58.615591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:58.615591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:58.615591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:58.615591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:58.615591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:58.615591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:58.615591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:58.615591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:58.615591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:58.615591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:58.616778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:58.617873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:58.617873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:58.617873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:58.617873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:58.619450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 420/821] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:58.620350 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ff69e-7ffb-4ccb-89ef-679f51879130 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:58.654903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eae46a-873f-45f0-9c9a-4c437f304330 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:58.690552 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b8ebe-c7bf-4b96-bf3d-ef3b80fd72aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:58.691329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b8ebe-c7bf-4b96-bf3d-ef3b80fd72aa None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:58.691616 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b8ebe-c7bf-4b96-bf3d-ef3b80fd72aa None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:58.691892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b8ebe-c7bf-4b96-bf3d-ef3b80fd72aa None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:58.692705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b8ebe-c7bf-4b96-bf3d-ef3b80fd72aa None admin] RBAC: Adding query filter params (type=network) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:58.693044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b8ebe-c7bf-4b96-bf3d-ef3b80fd72aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:58.694459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b8ebe-c7bf-4b96-bf3d-ef3b80fd72aa None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:58.700030 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 402/822] 10.222.0.99 () {56 vars in 1112 bytes} [Mon Jul 18 14:04:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:58.700898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b8ebe-c7bf-4b96-bf3d-ef3b80fd72aa None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:58.724590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ff69e-7ffb-4ccb-89ef-679f51879130 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:58.761098 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3313a7-ec99-4d18-b16d-f59631d21872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:58.761911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3313a7-ec99-4d18-b16d-f59631d21872 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:58.762296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3313a7-ec99-4d18-b16d-f59631d21872 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:58.762699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3313a7-ec99-4d18-b16d-f59631d21872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:58.763692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3313a7-ec99-4d18-b16d-f59631d21872 None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=b1b66b55e0374152828913910c4002f4) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:58.764124 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3313a7-ec99-4d18-b16d-f59631d21872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:58.765755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3313a7-ec99-4d18-b16d-f59631d21872 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:58.769045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:58.773401 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 421/823] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:04:58 2022] GET /identity/v3/role_assignments?user.id=b1b66b55e0374152828913910c4002f4&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:58.774689 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3313a7-ec99-4d18-b16d-f59631d21872 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:58.807378 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:58.819981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b8ebe-c7bf-4b96-bf3d-ef3b80fd72aa None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:58.866206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb2712-b898-4dea-9467-8ac766684a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:58.867219 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb2712-b898-4dea-9467-8ac766684a2e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:58.867742 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb2712-b898-4dea-9467-8ac766684a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:58.868184 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb2712-b898-4dea-9467-8ac766684a2e None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:58.869201 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb2712-b898-4dea-9467-8ac766684a2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:58.869665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb2712-b898-4dea-9467-8ac766684a2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:58.875898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb2712-b898-4dea-9467-8ac766684a2e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:58.891979 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 403/824] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:58.904675 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3313a7-ec99-4d18-b16d-f59631d21872 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:58.907556 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb2712-b898-4dea-9467-8ac766684a2e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:58.943832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c262ce-8b81-42ff-a0b7-719d416158a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:58.944672 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c262ce-8b81-42ff-a0b7-719d416158a7 None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:58.944957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c262ce-8b81-42ff-a0b7-719d416158a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:58.945339 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c262ce-8b81-42ff-a0b7-719d416158a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:58.946120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c262ce-8b81-42ff-a0b7-719d416158a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:58.947578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c262ce-8b81-42ff-a0b7-719d416158a7 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:58.974642 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 422/825] 10.222.0.99 () {60 vars in 1144 bytes} [Mon Jul 18 14:04:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:04:59.057044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb2712-b898-4dea-9467-8ac766684a2e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:59.102113 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2c7dd-2d73-4b16-b6ea-cfe6cf3bad98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:59.102898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2c7dd-2d73-4b16-b6ea-cfe6cf3bad98 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:59.103186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2c7dd-2d73-4b16-b6ea-cfe6cf3bad98 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:59.103463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2c7dd-2d73-4b16-b6ea-cfe6cf3bad98 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:59.112040 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2c7dd-2d73-4b16-b6ea-cfe6cf3bad98 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:59.113611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2c7dd-2d73-4b16-b6ea-cfe6cf3bad98 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:59.132603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-6cd2c7dd-2d73-4b16-b6ea-cfe6cf3bad98 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 14:04:59.132603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:59.132603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:59.132603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:59.132603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:59.132603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:59.132603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:59.132603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:59.132603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:59.132603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:59.132603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:59.132603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:59.132603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:04:59.132603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:04:59.132603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:04:59.132603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:59.133601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:59.134587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:59.134587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:59.134587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:04:59.134587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:04:59.134587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:04:59.134587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:04:59.134587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:04:59.134587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:04:59.134587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 14:04:59.134587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:59.141022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 404/826] 10.222.0.99 () {56 vars in 1117 bytes} [Mon Jul 18 14:04:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:59.142622 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c262ce-8b81-42ff-a0b7-719d416158a7 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:59.207034 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:59.253455 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c262ce-8b81-42ff-a0b7-719d416158a7 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:59.288028 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f92af-aa35-4af0-b166-8a86549e67e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:59.288711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f92af-aa35-4af0-b166-8a86549e67e5 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:59.288997 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f92af-aa35-4af0-b166-8a86549e67e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:59.289276 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f92af-aa35-4af0-b166-8a86549e67e5 None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:59.290132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f92af-aa35-4af0-b166-8a86549e67e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:59.290467 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f92af-aa35-4af0-b166-8a86549e67e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:59.291911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f92af-aa35-4af0-b166-8a86549e67e5 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:59.314504 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 423/827] 10.222.0.99 () {56 vars in 1149 bytes} [Mon Jul 18 14:04:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:59.316263 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2c7dd-2d73-4b16-b6ea-cfe6cf3bad98 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:59.326296 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:59.430853 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2c7dd-2d73-4b16-b6ea-cfe6cf3bad98 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:59.466882 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a52bf1-a076-4583-a896-a7de6f45e8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:59.467683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a52bf1-a076-4583-a896-a7de6f45e8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:59.467963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a52bf1-a076-4583-a896-a7de6f45e8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:59.468238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a52bf1-a076-4583-a896-a7de6f45e8f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:59.479021 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a52bf1-a076-4583-a896-a7de6f45e8f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:59.480502 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a52bf1-a076-4583-a896-a7de6f45e8f5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:59.498516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-e0a52bf1-a076-4583-a896-a7de6f45e8f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:59.498516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:59.498516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:59.498516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:59.498516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:59.498516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:59.498516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:59.498516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:59.498516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:59.498516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:59.498516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:59.498516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:59.498516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:04:59.498516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:04:59.498516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:59.499447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:59.500668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:04:59.500668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:04:59.500668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:04:59.500668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:59.503479 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 405/828] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:04:59.506409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f92af-aa35-4af0-b166-8a86549e67e5 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:59.568953 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed8577-bebb-4d85-b1b8-d17deaf534d5 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:59.569465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed8577-bebb-4d85-b1b8-d17deaf534d5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:59.569645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed8577-bebb-4d85-b1b8-d17deaf534d5 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:59.571034 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 406/829] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:04:59.577727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ba768-eb72-4dd8-a999-9d489f0716a6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:59.578562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ba768-eb72-4dd8-a999-9d489f0716a6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:59.579109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ba768-eb72-4dd8-a999-9d489f0716a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:59.603199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-355ba768-eb72-4dd8-a999-9d489f0716a6 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:04:59.605249 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-355ba768-eb72-4dd8-a999-9d489f0716a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:04:59.616352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f92af-aa35-4af0-b166-8a86549e67e5 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:59.633224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:59.655746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4518b-3ba9-4e4e-9562-48861f2407c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:59.656409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4518b-3ba9-4e4e-9562-48861f2407c4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:59.656691 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4518b-3ba9-4e4e-9562-48861f2407c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:59.656967 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4518b-3ba9-4e4e-9562-48861f2407c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:59.657721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4518b-3ba9-4e4e-9562-48861f2407c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:04:59.658027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4518b-3ba9-4e4e-9562-48861f2407c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:59.659421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4518b-3ba9-4e4e-9562-48861f2407c4 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:59.671508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 424/830] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:04:59.676836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4518b-3ba9-4e4e-9562-48861f2407c4 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:59.683728 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:59.702621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 407/831] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:04:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:04:59.725108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ba768-eb72-4dd8-a999-9d489f0716a6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:59.796595 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4518b-3ba9-4e4e-9562-48861f2407c4 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:59.833725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02de355-99f9-4515-abec-5893f790ba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:59.834919 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de355-99f9-4515-abec-5893f790ba4c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:59.835404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de355-99f9-4515-abec-5893f790ba4c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:59.835900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02de355-99f9-4515-abec-5893f790ba4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:59.843952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02de355-99f9-4515-abec-5893f790ba4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:59.845685 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02de355-99f9-4515-abec-5893f790ba4c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:59.856110 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ba768-eb72-4dd8-a999-9d489f0716a6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:04:59.860810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-f02de355-99f9-4515-abec-5893f790ba4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:59.860810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:59.860810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:59.860810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:59.860810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:59.860810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:59.860810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:59.860810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:59.860810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:59.860810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:59.860810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:59.860810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:59.860810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:04:59.860810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:04:59.860810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:59.861679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:59.862591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:04:59.862591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:04:59.862591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:04:59.862591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:04:59.862591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:04:59.862591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:04:59.862591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:04:59.862591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:04:59.869590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 425/832] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:04:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:59.871138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02de355-99f9-4515-abec-5893f790ba4c None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:59.896420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70bd39-ee1b-4282-8dfc-dfd861196456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:04:59.897474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70bd39-ee1b-4282-8dfc-dfd861196456 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:04:59.897763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70bd39-ee1b-4282-8dfc-dfd861196456 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:04:59.898036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70bd39-ee1b-4282-8dfc-dfd861196456 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:04:59.899130 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70bd39-ee1b-4282-8dfc-dfd861196456 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:04:59.900798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70bd39-ee1b-4282-8dfc-dfd861196456 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:04:59.908964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-8d70bd39-ee1b-4282-8dfc-dfd861196456 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:04:59.917405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:04:59.918429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:04:59.918429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:04:59.918429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:04:59.918429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:04:59.918429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:04:59.918429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:04:59.918429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:04:59.918429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:04:59.918429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:04:59.918429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:04:59.918429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:04:59.918429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:04:59.918429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:04:59.918429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:04:59.918429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:04:59.918429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:04:59.919279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:04:59.919279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:04:59.919279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:04:59.919279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:04:59.919279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:04:59.919279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:04:59.919279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:04:59.919279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:04:59.919279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:04:59.919279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:04:59.919279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:04:59.919279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:04:59.919279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 14:04:59.919279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:04:59.926826 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 408/833] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:04:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:04:59.928387 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70bd39-ee1b-4282-8dfc-dfd861196456 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:04:59.983346 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:04:59.996732 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02de355-99f9-4515-abec-5893f790ba4c None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:00.034135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70bd39-ee1b-4282-8dfc-dfd861196456 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:00.041231 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a46ba5-265f-4a65-a832-a402e4771f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:00.041905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a46ba5-265f-4a65-a832-a402e4771f69 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:00.042187 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a46ba5-265f-4a65-a832-a402e4771f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:00.042566 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a46ba5-265f-4a65-a832-a402e4771f69 None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:00.043823 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a46ba5-265f-4a65-a832-a402e4771f69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:00.044143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a46ba5-265f-4a65-a832-a402e4771f69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:00.045649 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a46ba5-265f-4a65-a832-a402e4771f69 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:00.062484 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 426/834] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:04:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:00.066539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a46ba5-265f-4a65-a832-a402e4771f69 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:00.079130 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f6ed7-1235-41d6-88c0-ed43a3c77f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:00.081099 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f6ed7-1235-41d6-88c0-ed43a3c77f0b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:00.081595 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f6ed7-1235-41d6-88c0-ed43a3c77f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:00.082090 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f6ed7-1235-41d6-88c0-ed43a3c77f0b None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:00.083349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f6ed7-1235-41d6-88c0-ed43a3c77f0b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:00.083903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f6ed7-1235-41d6-88c0-ed43a3c77f0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:00.085672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f6ed7-1235-41d6-88c0-ed43a3c77f0b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:00.094299 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 409/835] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:04:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:00.102985 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f6ed7-1235-41d6-88c0-ed43a3c77f0b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:00.198672 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:00.209458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a46ba5-265f-4a65-a832-a402e4771f69 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:00.229782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f6ed7-1235-41d6-88c0-ed43a3c77f0b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:00.247686 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:00.257398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a414f2-44d5-4a0d-ae3b-c06045b86df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:00.258252 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a414f2-44d5-4a0d-ae3b-c06045b86df2 None admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:00.258517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a414f2-44d5-4a0d-ae3b-c06045b86df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:00.258796 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a414f2-44d5-4a0d-ae3b-c06045b86df2 None admin] PATH_INFO: `/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/8f3ee6a031214346a20cdfcb7fb551d3/roles/ea9f1b43d91c4665ba5af180f55c663c` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:00.268538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776e7b6-d0c7-47b9-921d-4f9fbe3b0780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:00.269464 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776e7b6-d0c7-47b9-921d-4f9fbe3b0780 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:00.269966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776e7b6-d0c7-47b9-921d-4f9fbe3b0780 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:00.270507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776e7b6-d0c7-47b9-921d-4f9fbe3b0780 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:00.271424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776e7b6-d0c7-47b9-921d-4f9fbe3b0780 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:00.271940 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776e7b6-d0c7-47b9-921d-4f9fbe3b0780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:00.273506 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776e7b6-d0c7-47b9-921d-4f9fbe3b0780 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:00.275085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a414f2-44d5-4a0d-ae3b-c06045b86df2 None admin] RBAC: Authorizing `identity:create_grant(project_id=50b78e16c86b4e6cac3a725f536a8274, user_id=8f3ee6a031214346a20cdfcb7fb551d3, role_id=ea9f1b43d91c4665ba5af180f55c663c)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:00.276636 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a414f2-44d5-4a0d-ae3b-c06045b86df2 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:00.279296 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 410/836] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:05:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:00.300629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 427/837] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:05:00 2022] PUT /identity/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/8f3ee6a031214346a20cdfcb7fb551d3/roles/ea9f1b43d91c4665ba5af180f55c663c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:05:00.542604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e85338-b025-43b8-8009-7737b2511d80 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:00.542954 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e85338-b025-43b8-8009-7737b2511d80 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:00.543171 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e85338-b025-43b8-8009-7737b2511d80 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:00.544737 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 411/838] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:00.550304 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037418b-1683-4620-b956-9ab200664396 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:00.550874 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037418b-1683-4620-b956-9ab200664396 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:00.551342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037418b-1683-4620-b956-9ab200664396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:00.570756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-7037418b-1683-4620-b956-9ab200664396 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:00.572276 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-7037418b-1683-4620-b956-9ab200664396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:00.640844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 428/839] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:00.664245 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e85338-b025-43b8-8009-7737b2511d80 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:00.773509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e85338-b025-43b8-8009-7737b2511d80 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:00.809752 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ffd8b-c693-4fc2-a9c7-fccca547f984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:00.810506 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ffd8b-c693-4fc2-a9c7-fccca547f984 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:00.810793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ffd8b-c693-4fc2-a9c7-fccca547f984 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:00.811072 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ffd8b-c693-4fc2-a9c7-fccca547f984 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:00.823960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ffd8b-c693-4fc2-a9c7-fccca547f984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:05:00.832058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-057ffd8b-c693-4fc2-a9c7-fccca547f984 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:05:00.832058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:00.832058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:00.832058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:00.832058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:00.832058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:00.832058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:00.832058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:00.832058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:00.832058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:00.832058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:00.832058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:00.832058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:05:00.832058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:05:00.832058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:05:00.832058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:05:00.833002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:05:00.833002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:05:00.833002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:05:00.833002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:05:00.833002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:00.833002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:00.833002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:00.833002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:00.833002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:00.833002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:00.833002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:00.833002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:00.833002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:00.833002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:00.833002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:00.833002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:00.833834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:00.833834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:00.833834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:00.833834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:00.833834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:05:00.833834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:05:00.833834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:05:00.833834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:05:00.833834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:05:00.833834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:05:00.833834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:05:00.833834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:00.833834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 412/840] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:05:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:00.840981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037418b-1683-4620-b956-9ab200664396 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:00.922985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:00.952653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037418b-1683-4620-b956-9ab200664396 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:00.989020 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6361a3-b7a0-4b56-b689-c36fd053f66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:00.989701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6361a3-b7a0-4b56-b689-c36fd053f66a None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:00.989985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6361a3-b7a0-4b56-b689-c36fd053f66a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:00.990264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6361a3-b7a0-4b56-b689-c36fd053f66a None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:00.991129 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6361a3-b7a0-4b56-b689-c36fd053f66a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:00.991449 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6361a3-b7a0-4b56-b689-c36fd053f66a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:00.992824 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6361a3-b7a0-4b56-b689-c36fd053f66a None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:01.002705 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 429/841] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:05:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:01.008214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ffd8b-c693-4fc2-a9c7-fccca547f984 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:01.058288 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:01.116095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fb53d-6889-4d3a-8b08-eb675e6a8b67 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:01.116404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fb53d-6889-4d3a-8b08-eb675e6a8b67 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:01.116655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fb53d-6889-4d3a-8b08-eb675e6a8b67 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:01.117891 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ffd8b-c693-4fc2-a9c7-fccca547f984 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:01.118256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 430/842] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:05:01.124983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ab757-430f-49d4-896c-871b86406ad1 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:01.125262 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ab757-430f-49d4-896c-871b86406ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:01.126011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ab757-430f-49d4-896c-871b86406ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:01.142665 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-3f1ab757-430f-49d4-896c-871b86406ad1 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:01.143955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3f1ab757-430f-49d4-896c-871b86406ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:01.162537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1c59a-8ea8-4d76-8516-72a53e5e26b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:01.163897 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1c59a-8ea8-4d76-8516-72a53e5e26b5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:01.164400 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1c59a-8ea8-4d76-8516-72a53e5e26b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:01.164683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1c59a-8ea8-4d76-8516-72a53e5e26b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:01.179163 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1c59a-8ea8-4d76-8516-72a53e5e26b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:01.180629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1c59a-8ea8-4d76-8516-72a53e5e26b5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:01.199307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a3a1c59a-8ea8-4d76-8516-72a53e5e26b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:01.199307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:01.199307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:01.199307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:01.199307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:01.199307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:01.199307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:01.199307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:01.199307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:01.199307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:01.199307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:01.199307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:01.199307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:01.199307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:01.199307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:01.200214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:01.201515 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:01.201515 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:01.201515 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:01.201515 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:01.201515 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 413/843] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:01.206484 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1c59a-8ea8-4d76-8516-72a53e5e26b5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:01.232499 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 431/844] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:05:01.253816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ab757-430f-49d4-896c-871b86406ad1 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:01.303840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:01.312964 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1c59a-8ea8-4d76-8516-72a53e5e26b5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:01.319908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:01.347264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568ea13-5572-462a-929c-b4ec27b12a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:01.347995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568ea13-5572-462a-929c-b4ec27b12a09 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:01.348293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568ea13-5572-462a-929c-b4ec27b12a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:01.349698 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568ea13-5572-462a-929c-b4ec27b12a09 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:01.350622 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568ea13-5572-462a-929c-b4ec27b12a09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:01.351126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568ea13-5572-462a-929c-b4ec27b12a09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:01.352508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568ea13-5572-462a-929c-b4ec27b12a09 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:01.360317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ab757-430f-49d4-896c-871b86406ad1 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:01.369069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 414/845] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:01.370036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568ea13-5572-462a-929c-b4ec27b12a09 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:01.398736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d87d5-89b4-49e3-9882-bc1581dc82f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:01.399895 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d87d5-89b4-49e3-9882-bc1581dc82f2 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:01.400320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d87d5-89b4-49e3-9882-bc1581dc82f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:01.400741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d87d5-89b4-49e3-9882-bc1581dc82f2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:01.401672 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d87d5-89b4-49e3-9882-bc1581dc82f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:01.403337 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d87d5-89b4-49e3-9882-bc1581dc82f2 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:01.417529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-1e6d87d5-89b4-49e3-9882-bc1581dc82f2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 14:05:01.417529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:01.417529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:05:01.417529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:05:01.417529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:05:01.417529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:05:01.417529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:05:01.417529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:01.417529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 14:05:01.417529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:01.417529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:01.417529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:01.417529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:01.417529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:01.417529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:01.417529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:01.418774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:01.418774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:01.418774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:01.418774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:01.418774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:01.418774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:01.418774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:01.418774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:05:01.418774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:05:01.418774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:05:01.418774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:05:01.418774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:01.418774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:01.418774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:01.418774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:01.418774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:01.419838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:01.419838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:01.419838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:01.419838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:01.419838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:01.419838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:01.419838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:01.419838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:01.419838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:01.419838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:01.419838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:01.419838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:05:01.419838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:01.419838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 14:05:01.419838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:01.423462 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 432/846] 10.222.0.99 () {56 vars in 1132 bytes} [Mon Jul 18 14:05:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:01.431539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d87d5-89b4-49e3-9882-bc1581dc82f2 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:01.496022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568ea13-5572-462a-929c-b4ec27b12a09 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:01.534567 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef3495-21aa-451a-ae14-1095fadbfc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:01.535824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef3495-21aa-451a-ae14-1095fadbfc63 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:01.536402 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef3495-21aa-451a-ae14-1095fadbfc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:01.536825 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef3495-21aa-451a-ae14-1095fadbfc63 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:01.546165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef3495-21aa-451a-ae14-1095fadbfc63 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:01.548076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef3495-21aa-451a-ae14-1095fadbfc63 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:01.563842 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d87d5-89b4-49e3-9882-bc1581dc82f2 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:01.564842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-3cef3495-21aa-451a-ae14-1095fadbfc63 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 14:05:01.564842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:01.564842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:01.564842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:01.564842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:01.564842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:01.564842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:01.564842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:01.564842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:01.564842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:01.564842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:01.564842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:01.564842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:05:01.564842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:05:01.564842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:05:01.564842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:01.565912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:01.566879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:01.566879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:01.566879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:05:01.566879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:05:01.566879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:05:01.566879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:05:01.566879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:05:01.566879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:05:01.566879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 14:05:01.566879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:01.569480 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 415/847] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:05:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:01.575097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef3495-21aa-451a-ae14-1095fadbfc63 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:01.592032 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:01.605242 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:01.612945 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e9fed-0260-4011-a7ef-97fdef3f7847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:01.614026 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9fed-0260-4011-a7ef-97fdef3f7847 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:01.614566 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9fed-0260-4011-a7ef-97fdef3f7847 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:01.615047 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9fed-0260-4011-a7ef-97fdef3f7847 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:01.615982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e9fed-0260-4011-a7ef-97fdef3f7847 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:01.616495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e9fed-0260-4011-a7ef-97fdef3f7847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:01.618058 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e9fed-0260-4011-a7ef-97fdef3f7847 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:01.628839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 433/848] 10.222.0.99 () {56 vars in 1126 bytes} [Mon Jul 18 14:05:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:01.630237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e9fed-0260-4011-a7ef-97fdef3f7847 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:01.679661 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef3495-21aa-451a-ae14-1095fadbfc63 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:01.713155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31cfde-895b-47c9-be15-a19706d9f55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:01.713685 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31cfde-895b-47c9-be15-a19706d9f55a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:01.713963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31cfde-895b-47c9-be15-a19706d9f55a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:01.714240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31cfde-895b-47c9-be15-a19706d9f55a None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:01.715098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31cfde-895b-47c9-be15-a19706d9f55a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:01.715409 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31cfde-895b-47c9-be15-a19706d9f55a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:01.716892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31cfde-895b-47c9-be15-a19706d9f55a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:01.737093 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e9fed-0260-4011-a7ef-97fdef3f7847 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:01.740444 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 416/849] 10.222.0.99 () {56 vars in 1135 bytes} [Mon Jul 18 14:05:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:01.741079 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31cfde-895b-47c9-be15-a19706d9f55a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:01.774136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9ba86-354a-435c-8a0e-64d08e0e5ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:01.775164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9ba86-354a-435c-8a0e-64d08e0e5ceb None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:01.775703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9ba86-354a-435c-8a0e-64d08e0e5ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:01.776272 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9ba86-354a-435c-8a0e-64d08e0e5ceb None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:01.777198 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9ba86-354a-435c-8a0e-64d08e0e5ceb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:01.777702 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9ba86-354a-435c-8a0e-64d08e0e5ceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:01.779291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9ba86-354a-435c-8a0e-64d08e0e5ceb None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:01.790493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 434/850] 10.222.0.99 () {56 vars in 1126 bytes} [Mon Jul 18 14:05:01 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:01.814294 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:01.848823 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31cfde-895b-47c9-be15-a19706d9f55a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:01.888025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790c5a4-beb6-4a06-a507-c553e93ee8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:01.888599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790c5a4-beb6-4a06-a507-c553e93ee8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:01.888880 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790c5a4-beb6-4a06-a507-c553e93ee8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:01.889154 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790c5a4-beb6-4a06-a507-c553e93ee8f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:01.967176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790c5a4-beb6-4a06-a507-c553e93ee8f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:01.968639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790c5a4-beb6-4a06-a507-c553e93ee8f4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:02.042740 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:02.074045 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 417/851] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:05:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 14:05:02.079760 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9ba86-354a-435c-8a0e-64d08e0e5ceb None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:02.141184 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:02.186525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9ba86-354a-435c-8a0e-64d08e0e5ceb None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:02.220385 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd5178-d089-4cd8-91cb-13898a114297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:02.221182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd5178-d089-4cd8-91cb-13898a114297 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:02.221463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd5178-d089-4cd8-91cb-13898a114297 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:02.221737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd5178-d089-4cd8-91cb-13898a114297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:02.232648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd5178-d089-4cd8-91cb-13898a114297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:02.234095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd5178-d089-4cd8-91cb-13898a114297 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:02.252406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-1edd5178-d089-4cd8-91cb-13898a114297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:02.252406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:02.252406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:02.252406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:02.252406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:02.252406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:02.252406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:02.252406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:02.252406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:02.252406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:02.252406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:02.252406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:02.252406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:02.252406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:02.252406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:02.253437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:02.254322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:02.254322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:02.254322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:02.254322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:02.254322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 435/852] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:02.259860 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790c5a4-beb6-4a06-a507-c553e93ee8f4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:02.361756 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790c5a4-beb6-4a06-a507-c553e93ee8f4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:02.387740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7019d1-48c9-41fe-834f-982ea6efc58c None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:02.388261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7019d1-48c9-41fe-834f-982ea6efc58c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:02.388261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7019d1-48c9-41fe-834f-982ea6efc58c None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:02.390422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 436/853] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:02.397702 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ed457-7318-48fc-9a07-054e3dcabcc2 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:02.397951 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ed457-7318-48fc-9a07-054e3dcabcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:02.398602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ed457-7318-48fc-9a07-054e3dcabcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:02.408008 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31980eab-f0b6-422b-89fc-3656317b18bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:02.408727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31980eab-f0b6-422b-89fc-3656317b18bb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:02.409140 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31980eab-f0b6-422b-89fc-3656317b18bb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:02.409566 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31980eab-f0b6-422b-89fc-3656317b18bb None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:02.410481 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31980eab-f0b6-422b-89fc-3656317b18bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:02.410797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31980eab-f0b6-422b-89fc-3656317b18bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:02.412219 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31980eab-f0b6-422b-89fc-3656317b18bb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:02.422538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-7a7ed457-7318-48fc-9a07-054e3dcabcc2 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:02.424191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-7a7ed457-7318-48fc-9a07-054e3dcabcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:02.425476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 418/854] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:02.430902 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31980eab-f0b6-422b-89fc-3656317b18bb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:02.464328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:02.512263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 437/855] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:05:02.518633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c46727-d647-4ca1-a441-a1590dec2db5 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:02.518633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c46727-d647-4ca1-a441-a1590dec2db5 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:02.518633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c46727-d647-4ca1-a441-a1590dec2db5 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:02.518633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 438/856] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:02.520939 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b8c8-b34b-4c9a-813e-c2f5700ac1e8 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:02.521235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b8c8-b34b-4c9a-813e-c2f5700ac1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:02.521510 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b8c8-b34b-4c9a-813e-c2f5700ac1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:02.540013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-b519b8c8-b34b-4c9a-813e-c2f5700ac1e8 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:02.541313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b519b8c8-b34b-4c9a-813e-c2f5700ac1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:02.552652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31980eab-f0b6-422b-89fc-3656317b18bb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:02.584188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:02.591613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a03bf-db64-41ce-8b73-f886f44393f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:02.592469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a03bf-db64-41ce-8b73-f886f44393f8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:02.592763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a03bf-db64-41ce-8b73-f886f44393f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:02.593043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a03bf-db64-41ce-8b73-f886f44393f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:02.600477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a03bf-db64-41ce-8b73-f886f44393f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:02.601944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a03bf-db64-41ce-8b73-f886f44393f8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:02.616839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-903a03bf-db64-41ce-8b73-f886f44393f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:02.616839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:02.616839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:02.616839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:02.616839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:02.616839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:02.616839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:02.616839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:02.616839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:02.616839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:02.616839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:02.616839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:02.616839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:05:02.616839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:05:02.616839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:02.617786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:02.618723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:05:02.618723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:05:02.618723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:05:02.618723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:05:02.618723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:05:02.618723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:05:02.618723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:02.618723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:02.618723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 419/857] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:02.619430 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a03bf-db64-41ce-8b73-f886f44393f8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:02.624876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 439/858] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:02.626068 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519b8c8-b34b-4c9a-813e-c2f5700ac1e8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:02.720395 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:02.731065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a03bf-db64-41ce-8b73-f886f44393f8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:02.736972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519b8c8-b34b-4c9a-813e-c2f5700ac1e8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:02.767127 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c324c5a-8ab4-4ce1-be0b-12af395d2628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:02.767916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c324c5a-8ab4-4ce1-be0b-12af395d2628 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:02.768199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c324c5a-8ab4-4ce1-be0b-12af395d2628 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:02.768484 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c324c5a-8ab4-4ce1-be0b-12af395d2628 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:02.777280 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a9a8c-8d36-4ced-8413-a4b9d97ca372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:02.778085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a9a8c-8d36-4ced-8413-a4b9d97ca372 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:02.778577 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a9a8c-8d36-4ced-8413-a4b9d97ca372 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:02.779048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a9a8c-8d36-4ced-8413-a4b9d97ca372 None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:02.780202 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a9a8c-8d36-4ced-8413-a4b9d97ca372 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:02.780652 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a9a8c-8d36-4ced-8413-a4b9d97ca372 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:02.782455 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a9a8c-8d36-4ced-8413-a4b9d97ca372 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:02.782730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c324c5a-8ab4-4ce1-be0b-12af395d2628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:05:02.790273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-8c324c5a-8ab4-4ce1-be0b-12af395d2628 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:05:02.790273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:02.790273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:02.790273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:02.790273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:02.790273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:02.790273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:02.790273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:02.790273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:02.790273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:02.790273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:02.790273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:02.790273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:05:02.790273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:05:02.790273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:05:02.790273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:05:02.791231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:05:02.791231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:05:02.791231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:05:02.791231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:05:02.791231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:02.791231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:02.791231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:02.791231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:02.791231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:02.791231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:02.791231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:02.791231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:02.791231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:02.791231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:02.791231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:02.791231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:02.792097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:02.792097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:02.792097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:02.792097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:02.792097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:05:02.792097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:05:02.792097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:05:02.792097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:05:02.792097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:05:02.792097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:05:02.792097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:05:02.792097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:02.792097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 420/859] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:05:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:02.792804 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c324c5a-8ab4-4ce1-be0b-12af395d2628 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:02.797608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 440/860] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:02.798462 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a9a8c-8d36-4ced-8413-a4b9d97ca372 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:02.834073 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:02.905932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c324c5a-8ab4-4ce1-be0b-12af395d2628 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:02.906857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a9a8c-8d36-4ced-8413-a4b9d97ca372 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:02.941975 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277bd3f-26ce-426d-b015-951d4dada339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:02.942760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277bd3f-26ce-426d-b015-951d4dada339 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:02.943044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277bd3f-26ce-426d-b015-951d4dada339 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:02.943319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277bd3f-26ce-426d-b015-951d4dada339 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:02.944052 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277bd3f-26ce-426d-b015-951d4dada339 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:02.945016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575eb825-f2e6-4a38-ba39-34c41806393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:02.945448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277bd3f-26ce-426d-b015-951d4dada339 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:02.945683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eb825-f2e6-4a38-ba39-34c41806393d None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:02.945966 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eb825-f2e6-4a38-ba39-34c41806393d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:02.946240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eb825-f2e6-4a38-ba39-34c41806393d None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:02.947020 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575eb825-f2e6-4a38-ba39-34c41806393d None admin] RBAC: Adding query filter params (name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:02.947325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575eb825-f2e6-4a38-ba39-34c41806393d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:02.948692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575eb825-f2e6-4a38-ba39-34c41806393d None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:02.962569 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 441/861] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:05:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:02.962569 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575eb825-f2e6-4a38-ba39-34c41806393d None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:02.964324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 421/862] 10.222.0.99 () {60 vars in 1141 bytes} [Mon Jul 18 14:05:02 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:05:02.967398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277bd3f-26ce-426d-b015-951d4dada339 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:02.986971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:03.098134 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:03.103575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277bd3f-26ce-426d-b015-951d4dada339 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:03.113193 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575eb825-f2e6-4a38-ba39-34c41806393d None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:03.161252 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec4cef-7f70-43ae-b443-398db4053117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:03.162166 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec4cef-7f70-43ae-b443-398db4053117 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:03.162490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec4cef-7f70-43ae-b443-398db4053117 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:03.162750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec4cef-7f70-43ae-b443-398db4053117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:03.170143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9054c-f385-492f-b042-59c736110498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:03.170859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9054c-f385-492f-b042-59c736110498 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:03.171146 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9054c-f385-492f-b042-59c736110498 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:03.171426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9054c-f385-492f-b042-59c736110498 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:03.172280 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9054c-f385-492f-b042-59c736110498 None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=55fe1a286c2045d5bcd49895a878a3bf) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:03.172597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9054c-f385-492f-b042-59c736110498 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:03.174039 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9054c-f385-492f-b042-59c736110498 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:03.174859 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec4cef-7f70-43ae-b443-398db4053117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:03.175908 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec4cef-7f70-43ae-b443-398db4053117 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:03.182043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 442/863] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:05:02 2022] GET /identity/v3/role_assignments?user.id=55fe1a286c2045d5bcd49895a878a3bf&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:03.193937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-8fec4cef-7f70-43ae-b443-398db4053117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:03.193937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:03.193937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:03.193937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:03.193937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:03.193937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:03.193937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:03.193937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:03.193937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:03.193937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:03.193937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:03.193937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:03.193937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:03.193937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:03.193937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:03.195265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:03.196181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:03.196181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:03.196181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:03.196181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:03.196784 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 422/864] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:03.201549 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9054c-f385-492f-b042-59c736110498 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:03.316592 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9054c-f385-492f-b042-59c736110498 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:03.354743 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fdac0-e233-4ec2-b5bd-6c6c01951552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:03.355427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fdac0-e233-4ec2-b5bd-6c6c01951552 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:03.355711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fdac0-e233-4ec2-b5bd-6c6c01951552 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:03.355992 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fdac0-e233-4ec2-b5bd-6c6c01951552 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:03.356737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fdac0-e233-4ec2-b5bd-6c6c01951552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:03.357047 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fdac0-e233-4ec2-b5bd-6c6c01951552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:03.358487 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fdac0-e233-4ec2-b5bd-6c6c01951552 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:03.378328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 443/865] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:03.383991 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec4cef-7f70-43ae-b443-398db4053117 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:03.449537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:03.492043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec4cef-7f70-43ae-b443-398db4053117 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:03.526368 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21904bce-417f-4365-9cb8-72ad5ebf961a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:03.527215 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21904bce-417f-4365-9cb8-72ad5ebf961a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:03.527668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21904bce-417f-4365-9cb8-72ad5ebf961a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:03.527948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21904bce-417f-4365-9cb8-72ad5ebf961a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:03.535847 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21904bce-417f-4365-9cb8-72ad5ebf961a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:03.537378 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21904bce-417f-4365-9cb8-72ad5ebf961a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:03.552301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-21904bce-417f-4365-9cb8-72ad5ebf961a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 14:05:03.552301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:03.552301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:03.552301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:03.552301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:03.552301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:03.552301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:03.552301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:03.552301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:03.552301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:03.552301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:03.552301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:03.552301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:05:03.552301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:05:03.552301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:05:03.552301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:03.553290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:03.554235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:03.554235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:03.554235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:05:03.554235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:05:03.554235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:05:03.554235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:05:03.554235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:05:03.554235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:05:03.554235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 14:05:03.554235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:03.558195 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 423/866] 10.222.0.99 () {56 vars in 1117 bytes} [Mon Jul 18 14:05:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:03.559597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fdac0-e233-4ec2-b5bd-6c6c01951552 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:03.578160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:03.662563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fdac0-e233-4ec2-b5bd-6c6c01951552 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:03.697804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ed253-a3a4-4236-a365-bfba6813169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:03.698843 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ed253-a3a4-4236-a365-bfba6813169f None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:03.699299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ed253-a3a4-4236-a365-bfba6813169f None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:03.699758 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ed253-a3a4-4236-a365-bfba6813169f None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:03.700767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ed253-a3a4-4236-a365-bfba6813169f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:03.701245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ed253-a3a4-4236-a365-bfba6813169f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:03.702883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ed253-a3a4-4236-a365-bfba6813169f None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:03.721529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 444/867] 10.222.0.99 () {56 vars in 1149 bytes} [Mon Jul 18 14:05:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:03.727101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21904bce-417f-4365-9cb8-72ad5ebf961a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:03.829438 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21904bce-417f-4365-9cb8-72ad5ebf961a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:03.847232 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:03.869200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca75356-0149-47f2-923c-da40570b0e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:03.870119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca75356-0149-47f2-923c-da40570b0e6e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:03.870599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca75356-0149-47f2-923c-da40570b0e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:03.871047 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca75356-0149-47f2-923c-da40570b0e6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:03.902874 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b6b1b-0792-463a-ac54-c73c52c5f1ce None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:03.903177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b6b1b-0792-463a-ac54-c73c52c5f1ce None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:03.903676 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b6b1b-0792-463a-ac54-c73c52c5f1ce None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:03.905069 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 445/868] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:05:03.910178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27bba4-ca2d-4685-beca-e03924f02bad None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:03.910650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27bba4-ca2d-4685-beca-e03924f02bad None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:03.910936 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27bba4-ca2d-4685-beca-e03924f02bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:03.927693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-cf27bba4-ca2d-4685-beca-e03924f02bad None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:03.928884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-cf27bba4-ca2d-4685-beca-e03924f02bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:03.943722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca75356-0149-47f2-923c-da40570b0e6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:03.945658 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca75356-0149-47f2-923c-da40570b0e6e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:04.018594 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 446/869] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:03 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:05:04.040756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27bba4-ca2d-4685-beca-e03924f02bad None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:04.044088 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:04.176018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27bba4-ca2d-4685-beca-e03924f02bad None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:04.183739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 424/870] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:05:03 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 14:05:04.191458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca75356-0149-47f2-923c-da40570b0e6e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:04.215546 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:04.224556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489a0d5-a680-446a-80b3-1ceeb03b2e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:04.225814 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489a0d5-a680-446a-80b3-1ceeb03b2e40 None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:04.226560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489a0d5-a680-446a-80b3-1ceeb03b2e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:04.227099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489a0d5-a680-446a-80b3-1ceeb03b2e40 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:04.228682 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489a0d5-a680-446a-80b3-1ceeb03b2e40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:04.230947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489a0d5-a680-446a-80b3-1ceeb03b2e40 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:04.262858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 447/871] 10.222.0.99 () {60 vars in 1141 bytes} [Mon Jul 18 14:05:04 2022] POST /identity/v3/services => generated 269 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:05:04.324822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca75356-0149-47f2-923c-da40570b0e6e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:04.368100 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2081185-7ef0-4161-b84d-54023acad55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:04.368931 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2081185-7ef0-4161-b84d-54023acad55b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:04.369215 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2081185-7ef0-4161-b84d-54023acad55b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:04.369491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2081185-7ef0-4161-b84d-54023acad55b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:04.382565 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2081185-7ef0-4161-b84d-54023acad55b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:04.384048 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2081185-7ef0-4161-b84d-54023acad55b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:04.404025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f2081185-7ef0-4161-b84d-54023acad55b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:04.404025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:04.404025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:04.404025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:04.404025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:04.404025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:04.404025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:04.404025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:04.404025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:04.404025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:04.404025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:04.404025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:04.404025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:04.404025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:04.404025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:04.404944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:04.405830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:04.405830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:04.405830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:04.405830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:04.405830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 425/872] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:04.411131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489a0d5-a680-446a-80b3-1ceeb03b2e40 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:04.478149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:04.520898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489a0d5-a680-446a-80b3-1ceeb03b2e40 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:04.555358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1f66f-998e-4232-9b41-4e7e41cc095c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:04.556022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1f66f-998e-4232-9b41-4e7e41cc095c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:04.556307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1f66f-998e-4232-9b41-4e7e41cc095c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:04.556586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1f66f-998e-4232-9b41-4e7e41cc095c None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:04.557317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1f66f-998e-4232-9b41-4e7e41cc095c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:04.557624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1f66f-998e-4232-9b41-4e7e41cc095c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:04.559027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1f66f-998e-4232-9b41-4e7e41cc095c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:04.571647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 448/873] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:04.578503 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2081185-7ef0-4161-b84d-54023acad55b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:04.652763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:04.690116 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2081185-7ef0-4161-b84d-54023acad55b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:04.725687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4d14d-eebf-477e-a3d5-7d7df61c5856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:04.726766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4d14d-eebf-477e-a3d5-7d7df61c5856 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:04.727230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4d14d-eebf-477e-a3d5-7d7df61c5856 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:04.727654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4d14d-eebf-477e-a3d5-7d7df61c5856 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:04.734972 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4d14d-eebf-477e-a3d5-7d7df61c5856 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:04.736624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4d14d-eebf-477e-a3d5-7d7df61c5856 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:04.751591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-28c4d14d-eebf-477e-a3d5-7d7df61c5856 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:04.751591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:04.751591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:04.751591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:04.751591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:04.751591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:04.751591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:04.751591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:04.751591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:04.751591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:04.751591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:04.751591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:04.751591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:05:04.751591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:05:04.751591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:04.752724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:04.753899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:05:04.753899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:05:04.753899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:05:04.753899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:05:04.753899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:05:04.753899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:05:04.753899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:04.753899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:04.756063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 426/874] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:05:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:04.764510 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1f66f-998e-4232-9b41-4e7e41cc095c None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:04.874016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1f66f-998e-4232-9b41-4e7e41cc095c None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:04.899199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:04.911728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6bf38-c136-4c9c-a700-dd72a23b261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:04.912598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6bf38-c136-4c9c-a700-dd72a23b261f None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:04.913026 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6bf38-c136-4c9c-a700-dd72a23b261f None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:04.913471 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6bf38-c136-4c9c-a700-dd72a23b261f None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:04.914447 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6bf38-c136-4c9c-a700-dd72a23b261f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:04.914897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6bf38-c136-4c9c-a700-dd72a23b261f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:04.916487 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6bf38-c136-4c9c-a700-dd72a23b261f None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:04.931653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 449/875] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:05:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:04.937430 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4d14d-eebf-477e-a3d5-7d7df61c5856 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:05.042978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4d14d-eebf-477e-a3d5-7d7df61c5856 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:05.070680 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:05.081276 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f443c4f-2fab-4a2d-9519-fce111a17282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:05.082144 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f443c4f-2fab-4a2d-9519-fce111a17282 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:05.082627 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f443c4f-2fab-4a2d-9519-fce111a17282 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:05.083043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f443c4f-2fab-4a2d-9519-fce111a17282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:05.084042 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f443c4f-2fab-4a2d-9519-fce111a17282 None admin] RBAC: Adding query filter params (role.id=ea9f1b43d91c4665ba5af180f55c663c, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=8f3ee6a031214346a20cdfcb7fb551d3) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:05.084498 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f443c4f-2fab-4a2d-9519-fce111a17282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:05.086080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f443c4f-2fab-4a2d-9519-fce111a17282 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:05.092742 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 427/876] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:05:04 2022] GET /identity/v3/role_assignments?user.id=8f3ee6a031214346a20cdfcb7fb551d3&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=ea9f1b43d91c4665ba5af180f55c663c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:05.197277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09730a-5c0d-49fb-8335-8d12f8c4629f None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:05.197798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09730a-5c0d-49fb-8335-8d12f8c4629f None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:05.198238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09730a-5c0d-49fb-8335-8d12f8c4629f None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:05.200070 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 450/877] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:05.206089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384b43e-12f8-41bc-8eb1-8c93a6007eb7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:05.206738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384b43e-12f8-41bc-8eb1-8c93a6007eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:05.207216 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384b43e-12f8-41bc-8eb1-8c93a6007eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:05.225690 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9384b43e-12f8-41bc-8eb1-8c93a6007eb7 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:05.227279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9384b43e-12f8-41bc-8eb1-8c93a6007eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:05.298842 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6bb9a-24d6-4d0d-9285-799b1e3bb2bc None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:05.299045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6bb9a-24d6-4d0d-9285-799b1e3bb2bc None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:05.299643 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6bb9a-24d6-4d0d-9285-799b1e3bb2bc None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:05.301223 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 451/878] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:05:05.305749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 428/879] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:05.307290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4acbd1-da2a-49b2-9c6c-06a420776db6 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:05.307673 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4acbd1-da2a-49b2-9c6c-06a420776db6 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:05.308027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4acbd1-da2a-49b2-9c6c-06a420776db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:05.326497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-ff4acbd1-da2a-49b2-9c6c-06a420776db6 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:05.327954 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ff4acbd1-da2a-49b2-9c6c-06a420776db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:05.329819 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384b43e-12f8-41bc-8eb1-8c93a6007eb7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:05.420032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 452/880] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:05.446505 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4acbd1-da2a-49b2-9c6c-06a420776db6 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:05.447457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384b43e-12f8-41bc-8eb1-8c93a6007eb7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:05.469294 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:05.486052 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dac671-a117-4b19-8acd-4981d3eff095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:05.487013 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dac671-a117-4b19-8acd-4981d3eff095 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:05.487370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dac671-a117-4b19-8acd-4981d3eff095 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:05.487705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dac671-a117-4b19-8acd-4981d3eff095 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:05.488443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dac671-a117-4b19-8acd-4981d3eff095 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:05.489906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dac671-a117-4b19-8acd-4981d3eff095 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-38dac671-a117-4b19-8acd-4981d3eff095 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:05.502494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:05.503621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:05.503621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:05.503621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:05.503621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:05.503621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:05.503621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:05.503621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:05:05.503621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:05:05.503621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:05:05.503621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:05:05.503621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:05.503621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:05.503621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:05.503621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:05.503621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:05.503621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:05.504774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:05.504774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:05.504774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:05.504774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:05.504774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:05.504774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:05.504774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:05.504774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:05.504774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:05.504774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:05.504774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:05:05.504774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:05.504774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 14:05:05.504774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:05.504774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 429/881] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:05:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:05.509738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dac671-a117-4b19-8acd-4981d3eff095 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:05.567833 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4acbd1-da2a-49b2-9c6c-06a420776db6 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:05.584096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:05.609430 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f102ac2-21be-46ea-8ece-d545d7196e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:05.610428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dac671-a117-4b19-8acd-4981d3eff095 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:05.610857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f102ac2-21be-46ea-8ece-d545d7196e3e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:05.611346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f102ac2-21be-46ea-8ece-d545d7196e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:05.612169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f102ac2-21be-46ea-8ece-d545d7196e3e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:05.613915 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f102ac2-21be-46ea-8ece-d545d7196e3e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:05.615542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f102ac2-21be-46ea-8ece-d545d7196e3e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-0f102ac2-21be-46ea-8ece-d545d7196e3e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:05.632864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:05.633921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:05.633921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:05.633921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:05.633921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:05.633921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:05.633921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:05.633921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:05:05.633921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:05:05.633921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:05:05.633921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:05:05.633921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:05.633921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:05.633921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:05.633921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:05.633921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:05.633921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:05.634795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:05.634795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:05.634795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:05.634795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:05.634795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:05.634795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:05.634795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:05.634795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:05.634795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:05.634795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:05.634795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:05:05.634795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:05.634795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 14:05:05.634795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:05.637282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 453/882] 10.222.0.99 () {56 vars in 1126 bytes} [Mon Jul 18 14:05:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:05.643283 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f102ac2-21be-46ea-8ece-d545d7196e3e None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:05.655816 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde298f-89c9-4c41-a18b-14d420ff8da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:05.656520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde298f-89c9-4c41-a18b-14d420ff8da5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:05.656802 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde298f-89c9-4c41-a18b-14d420ff8da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:05.657115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde298f-89c9-4c41-a18b-14d420ff8da5 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:05.657872 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde298f-89c9-4c41-a18b-14d420ff8da5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:05.658180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde298f-89c9-4c41-a18b-14d420ff8da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:05.659872 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde298f-89c9-4c41-a18b-14d420ff8da5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:05.670503 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 430/883] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:05:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:05.671412 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde298f-89c9-4c41-a18b-14d420ff8da5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:05.723837 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:05.779307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde298f-89c9-4c41-a18b-14d420ff8da5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:05.788246 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f102ac2-21be-46ea-8ece-d545d7196e3e None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:05.813821 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862d23a-b06c-45f6-806f-1e2fdab793fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:05.814506 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862d23a-b06c-45f6-806f-1e2fdab793fe None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:05.814787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862d23a-b06c-45f6-806f-1e2fdab793fe None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:05.815060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862d23a-b06c-45f6-806f-1e2fdab793fe None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:05.815765 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862d23a-b06c-45f6-806f-1e2fdab793fe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:05.816065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862d23a-b06c-45f6-806f-1e2fdab793fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:05.818095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862d23a-b06c-45f6-806f-1e2fdab793fe None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:05.829037 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 431/884] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:05:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:05.829918 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862d23a-b06c-45f6-806f-1e2fdab793fe None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:05.836324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfec63-fcb5-4597-8477-0e346b5327c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:05.837277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfec63-fcb5-4597-8477-0e346b5327c4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:05.837793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfec63-fcb5-4597-8477-0e346b5327c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:05.838271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfec63-fcb5-4597-8477-0e346b5327c4 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:05.839759 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfec63-fcb5-4597-8477-0e346b5327c4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:05.840292 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfec63-fcb5-4597-8477-0e346b5327c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:05.842318 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfec63-fcb5-4597-8477-0e346b5327c4 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:05.855678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 454/885] 10.222.0.99 () {56 vars in 1122 bytes} [Mon Jul 18 14:05:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:05.857600 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfec63-fcb5-4597-8477-0e346b5327c4 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:05.918141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:05.939490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862d23a-b06c-45f6-806f-1e2fdab793fe None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:05.953910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:05.977756 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109fd36-051f-40a3-ab68-47d18a9c62ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:05.978709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109fd36-051f-40a3-ab68-47d18a9c62ce None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:05.978824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109fd36-051f-40a3-ab68-47d18a9c62ce None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:05.979063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109fd36-051f-40a3-ab68-47d18a9c62ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:05.979855 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109fd36-051f-40a3-ab68-47d18a9c62ce None admin] RBAC: Adding query filter params (interface=public, service_id=20e80014a1c54309ba1c00c89865027a, region_id=RegionOne) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:05.980245 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109fd36-051f-40a3-ab68-47d18a9c62ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:05.981532 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109fd36-051f-40a3-ab68-47d18a9c62ce None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:05.992164 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 432/886] 10.222.0.99 () {56 vars in 1251 bytes} [Mon Jul 18 14:05:05 2022] GET /identity/v3/endpoints?service_id=20e80014a1c54309ba1c00c89865027a&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:05.993086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109fd36-051f-40a3-ab68-47d18a9c62ce None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:06.001666 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfec63-fcb5-4597-8477-0e346b5327c4 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:06.045050 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f28305-76de-43ad-8f31-7c7a6beb3046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:06.046234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f28305-76de-43ad-8f31-7c7a6beb3046 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:06.047120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f28305-76de-43ad-8f31-7c7a6beb3046 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:06.047656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f28305-76de-43ad-8f31-7c7a6beb3046 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:06.048864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f28305-76de-43ad-8f31-7c7a6beb3046 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:06.049797 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f28305-76de-43ad-8f31-7c7a6beb3046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:06.051691 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f28305-76de-43ad-8f31-7c7a6beb3046 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:06.066968 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 455/887] 10.222.0.99 () {56 vars in 1122 bytes} [Mon Jul 18 14:05:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:06.109471 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109fd36-051f-40a3-ab68-47d18a9c62ce None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:06.157000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ab732-d76d-4563-809b-e11fee40f10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:06.157958 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab732-d76d-4563-809b-e11fee40f10c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:06.158428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab732-d76d-4563-809b-e11fee40f10c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:06.158844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ab732-d76d-4563-809b-e11fee40f10c None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:06.159684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ab732-d76d-4563-809b-e11fee40f10c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:06.161235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ab732-d76d-4563-809b-e11fee40f10c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:06.169620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 433/888] 10.222.0.99 () {56 vars in 1087 bytes} [Mon Jul 18 14:05:05 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:05:06.386031 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9f5ec-1b14-441c-a289-2e8f38e023e3 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:06.386463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9f5ec-1b14-441c-a289-2e8f38e023e3 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:06.386655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9f5ec-1b14-441c-a289-2e8f38e023e3 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:06.388134 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 456/889] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:06.393769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201adbaa-4e1c-4142-a1cd-3acdfcbaba44 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:06.393944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201adbaa-4e1c-4142-a1cd-3acdfcbaba44 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:06.394189 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201adbaa-4e1c-4142-a1cd-3acdfcbaba44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:06.412021 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-201adbaa-4e1c-4142-a1cd-3acdfcbaba44 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:06.413424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-201adbaa-4e1c-4142-a1cd-3acdfcbaba44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:06.448676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:06.485303 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 434/890] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:06.508449 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9f5ec-1b14-441c-a289-2e8f38e023e3 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:06.623391 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9f5ec-1b14-441c-a289-2e8f38e023e3 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:06.631219 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:06.660451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5403b-70fd-4339-b92c-86bc22197de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:06.661183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5403b-70fd-4339-b92c-86bc22197de7 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:06.661464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5403b-70fd-4339-b92c-86bc22197de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:06.661737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5403b-70fd-4339-b92c-86bc22197de7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:06.662417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5403b-70fd-4339-b92c-86bc22197de7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:06.663875 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5403b-70fd-4339-b92c-86bc22197de7 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:06.677024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-cfc5403b-70fd-4339-b92c-86bc22197de7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 14:05:06.677024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:06.677024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:05:06.677024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:05:06.677024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:05:06.677024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:05:06.677024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:05:06.677024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:06.677024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 14:05:06.677024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:06.677024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:06.677024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:06.677024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:06.677024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:06.677024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:06.677024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:06.678029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:06.678029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:06.678029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:06.678029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:06.678029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:06.678029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:06.678029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:06.678029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:05:06.678029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:05:06.678029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:05:06.678029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:05:06.678029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:06.678029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:06.678029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:06.678029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:06.678029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:06.678920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:06.678920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:06.678920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:06.678920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:06.678920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:06.678920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:06.678920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:06.678920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:06.678920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:06.678920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:06.678920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:06.678920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:05:06.678920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:06.678920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 14:05:06.678920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:06.678920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 457/891] 10.222.0.99 () {56 vars in 1132 bytes} [Mon Jul 18 14:05:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:06.684774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201adbaa-4e1c-4142-a1cd-3acdfcbaba44 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:06.792887 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201adbaa-4e1c-4142-a1cd-3acdfcbaba44 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:06.829938 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09e2f4-b005-4f83-b8e5-f403967559c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:06.831101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09e2f4-b005-4f83-b8e5-f403967559c4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:06.831603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09e2f4-b005-4f83-b8e5-f403967559c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:06.832068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09e2f4-b005-4f83-b8e5-f403967559c4 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:06.834640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09e2f4-b005-4f83-b8e5-f403967559c4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:06.834640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09e2f4-b005-4f83-b8e5-f403967559c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:06.836857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09e2f4-b005-4f83-b8e5-f403967559c4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:06.841826 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 435/892] 10.222.0.99 () {56 vars in 1126 bytes} [Mon Jul 18 14:05:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:06.851533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5403b-70fd-4339-b92c-86bc22197de7 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:06.954466 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5403b-70fd-4339-b92c-86bc22197de7 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:06.988191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765d181-f402-4dd2-80a7-b96cb233e2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:06.988863 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765d181-f402-4dd2-80a7-b96cb233e2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:06.989148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765d181-f402-4dd2-80a7-b96cb233e2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:06.989423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765d181-f402-4dd2-80a7-b96cb233e2f7 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:06.990144 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765d181-f402-4dd2-80a7-b96cb233e2f7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:06.990472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765d181-f402-4dd2-80a7-b96cb233e2f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:06.991844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765d181-f402-4dd2-80a7-b96cb233e2f7 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:06.997090 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 458/893] 10.222.0.99 () {56 vars in 1126 bytes} [Mon Jul 18 14:05:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:07.003376 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09e2f4-b005-4f83-b8e5-f403967559c4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:07.038010 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:07.107379 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09e2f4-b005-4f83-b8e5-f403967559c4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:07.152935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a04bd9-0c20-4f0c-acaa-ec0d90ac7d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:07.153612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a04bd9-0c20-4f0c-acaa-ec0d90ac7d0e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:07.153895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a04bd9-0c20-4f0c-acaa-ec0d90ac7d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:07.154170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a04bd9-0c20-4f0c-acaa-ec0d90ac7d0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:07.158976 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a04bd9-0c20-4f0c-acaa-ec0d90ac7d0e None admin] RBAC: Adding query filter params (interface=public, service_id=6ad3a6557d56496db08391fc7279e876, region_id=RegionOne) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:07.158976 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a04bd9-0c20-4f0c-acaa-ec0d90ac7d0e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:07.158976 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a04bd9-0c20-4f0c-acaa-ec0d90ac7d0e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:07.162779 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 436/894] 10.222.0.99 () {56 vars in 1251 bytes} [Mon Jul 18 14:05:07 2022] GET /identity/v3/endpoints?service_id=6ad3a6557d56496db08391fc7279e876&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:07.168111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765d181-f402-4dd2-80a7-b96cb233e2f7 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:07.205606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:07.268045 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7408b-e8e3-4330-a798-bd626e49b7b4 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:07.268369 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7408b-e8e3-4330-a798-bd626e49b7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:07.268599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7408b-e8e3-4330-a798-bd626e49b7b4 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:07.270125 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 437/895] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:07.275387 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3a834-10b8-4fc4-9015-d0ca814f8935 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:07.275856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765d181-f402-4dd2-80a7-b96cb233e2f7 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:07.276135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3a834-10b8-4fc4-9015-d0ca814f8935 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:07.276605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3a834-10b8-4fc4-9015-d0ca814f8935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:07.293640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-08b3a834-10b8-4fc4-9015-d0ca814f8935 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:07.295189 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-08b3a834-10b8-4fc4-9015-d0ca814f8935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:07.316358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851cde9-eb76-43d3-b34f-586755f6ea80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:07.317550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851cde9-eb76-43d3-b34f-586755f6ea80 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:07.317839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851cde9-eb76-43d3-b34f-586755f6ea80 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:07.318117 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851cde9-eb76-43d3-b34f-586755f6ea80 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:07.318942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851cde9-eb76-43d3-b34f-586755f6ea80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:07.320908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851cde9-eb76-43d3-b34f-586755f6ea80 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:07.329560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 459/896] 10.222.0.99 () {56 vars in 1087 bytes} [Mon Jul 18 14:05:07 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:05:07.376430 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 438/897] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:05:07.400342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851cde9-eb76-43d3-b34f-586755f6ea80 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:07.527342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:07.532903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851cde9-eb76-43d3-b34f-586755f6ea80 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:07.568323 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3d2ae-1fbe-48d8-8b45-748a481e3442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:07.569126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3d2ae-1fbe-48d8-8b45-748a481e3442 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:07.569126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3d2ae-1fbe-48d8-8b45-748a481e3442 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:07.569126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3d2ae-1fbe-48d8-8b45-748a481e3442 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:07.579996 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3d2ae-1fbe-48d8-8b45-748a481e3442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:05:07.588195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-5cf3d2ae-1fbe-48d8-8b45-748a481e3442 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 14:05:07.588195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:07.588195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:07.588195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:07.588195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:07.588195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:07.588195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:07.588195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:07.588195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:07.588195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:07.588195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:07.588195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:07.588195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:05:07.588195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:05:07.588195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:05:07.588195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:05:07.589106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:05:07.589106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:05:07.589106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:05:07.589106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:05:07.589106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:07.589106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:07.589106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:07.589106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:07.589106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:07.589106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:07.589106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:07.589106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:07.589106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:07.589106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:07.589106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:07.589106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:07.589973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:07.589973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:07.589973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:07.589973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:07.589973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:05:07.589973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:05:07.589973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:05:07.589973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:05:07.589973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:05:07.589973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:05:07.589973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 14:05:07.589973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:07.589973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 460/898] 10.222.0.99 () {56 vars in 1120 bytes} [Mon Jul 18 14:05:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:07.597135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3a834-10b8-4fc4-9015-d0ca814f8935 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:07.631163 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:07.714612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3a834-10b8-4fc4-9015-d0ca814f8935 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:07.754627 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb46814-cbad-4a0b-9f18-c5ac770c8b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:07.755612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb46814-cbad-4a0b-9f18-c5ac770c8b5d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:07.756073 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb46814-cbad-4a0b-9f18-c5ac770c8b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:07.758823 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb46814-cbad-4a0b-9f18-c5ac770c8b5d None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:07.761036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb46814-cbad-4a0b-9f18-c5ac770c8b5d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:07.761545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb46814-cbad-4a0b-9f18-c5ac770c8b5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:07.763302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb46814-cbad-4a0b-9f18-c5ac770c8b5d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:07.773361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 439/899] 10.222.0.99 () {56 vars in 1115 bytes} [Mon Jul 18 14:05:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:07.779365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3d2ae-1fbe-48d8-8b45-748a481e3442 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:07.897903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3d2ae-1fbe-48d8-8b45-748a481e3442 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:07.933131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658b3ac-ee1a-4d90-9030-c73e7be1e6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:07.934235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658b3ac-ee1a-4d90-9030-c73e7be1e6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:07.934712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658b3ac-ee1a-4d90-9030-c73e7be1e6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:07.935196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658b3ac-ee1a-4d90-9030-c73e7be1e6c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:07.951073 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658b3ac-ee1a-4d90-9030-c73e7be1e6c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:07.952532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7658b3ac-ee1a-4d90-9030-c73e7be1e6c9 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:07.970340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-7658b3ac-ee1a-4d90-9030-c73e7be1e6c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:07.970340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:07.970340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:07.970340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:07.970340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:07.970340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:07.970340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:07.970340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:07.970340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:07.970340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:07.970340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:07.970340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:07.970340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:07.970340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:07.970340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:07.971389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:07.972264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:07.972264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:07.972264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:07.972264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:07.972264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 461/900] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:07.978818 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb46814-cbad-4a0b-9f18-c5ac770c8b5d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:08.074228 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:08.084573 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb46814-cbad-4a0b-9f18-c5ac770c8b5d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:08.119193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687d1d4-aa15-4c5b-952e-414b668684f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:08.120273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687d1d4-aa15-4c5b-952e-414b668684f7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:08.120760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687d1d4-aa15-4c5b-952e-414b668684f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:08.121233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687d1d4-aa15-4c5b-952e-414b668684f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:08.122170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687d1d4-aa15-4c5b-952e-414b668684f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:08.122723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687d1d4-aa15-4c5b-952e-414b668684f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:08.124341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687d1d4-aa15-4c5b-952e-414b668684f7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:08.138081 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 440/901] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:08.147512 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658b3ac-ee1a-4d90-9030-c73e7be1e6c9 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:08.160685 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:08.251439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7658b3ac-ee1a-4d90-9030-c73e7be1e6c9 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:08.285930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1622c89-d51b-4691-a7dc-c88d05c601ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:08.286777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1622c89-d51b-4691-a7dc-c88d05c601ac None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:08.287061 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1622c89-d51b-4691-a7dc-c88d05c601ac None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:08.287336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1622c89-d51b-4691-a7dc-c88d05c601ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:08.295212 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1622c89-d51b-4691-a7dc-c88d05c601ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:08.296663 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1622c89-d51b-4691-a7dc-c88d05c601ac None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:08.311287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-d1622c89-d51b-4691-a7dc-c88d05c601ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 14:05:08.311287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:08.311287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:08.311287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:08.311287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:08.311287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:08.311287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:08.311287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:08.311287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:08.311287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:08.311287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:08.311287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:08.311287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:05:08.311287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:05:08.311287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:05:08.311287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:08.312256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:08.313322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:08.313322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:08.313322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:05:08.313322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:05:08.313322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:05:08.313322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:05:08.313322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:05:08.313322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:05:08.313322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 14:05:08.313322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:08.313322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 462/902] 10.222.0.99 () {56 vars in 1117 bytes} [Mon Jul 18 14:05:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:08.320294 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687d1d4-aa15-4c5b-952e-414b668684f7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:08.358723 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d421c09-1c7f-48bf-b546-ce279f52aeca None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:08.359013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d421c09-1c7f-48bf-b546-ce279f52aeca None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:08.359196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d421c09-1c7f-48bf-b546-ce279f52aeca None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:08.360866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 463/903] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:08.366030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db5736-f9b4-400d-b45e-9c517e5b0e20 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:08.366321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db5736-f9b4-400d-b45e-9c517e5b0e20 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:08.366628 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db5736-f9b4-400d-b45e-9c517e5b0e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:08.385100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-78db5736-f9b4-400d-b45e-9c517e5b0e20 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:08.386298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-78db5736-f9b4-400d-b45e-9c517e5b0e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:08.430068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687d1d4-aa15-4c5b-952e-414b668684f7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:08.458806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:08.465075 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 464/904] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:08.466656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982eb63-90d7-4a84-bfd1-c8b24af6cfed None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:08.467169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982eb63-90d7-4a84-bfd1-c8b24af6cfed None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:08.467646 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982eb63-90d7-4a84-bfd1-c8b24af6cfed None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:08.469418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 465/905] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:08.471177 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ae9be-1fe1-4f9f-81ec-9e3f57d1ccde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:08.472075 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ae9be-1fe1-4f9f-81ec-9e3f57d1ccde None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:08.472589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ae9be-1fe1-4f9f-81ec-9e3f57d1ccde None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:08.473115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ae9be-1fe1-4f9f-81ec-9e3f57d1ccde None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:08.474175 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ae9be-1fe1-4f9f-81ec-9e3f57d1ccde None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:08.474458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91210395-b4e8-43f0-bb5d-1d785a208efc None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:08.474748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91210395-b4e8-43f0-bb5d-1d785a208efc None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:08.475024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91210395-b4e8-43f0-bb5d-1d785a208efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:08.475345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ae9be-1fe1-4f9f-81ec-9e3f57d1ccde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:08.477000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ae9be-1fe1-4f9f-81ec-9e3f57d1ccde None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:08.493933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-91210395-b4e8-43f0-bb5d-1d785a208efc None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:08.494350 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-91210395-b4e8-43f0-bb5d-1d785a208efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:08.499971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 441/906] 10.222.0.99 () {56 vars in 1149 bytes} [Mon Jul 18 14:05:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:08.500838 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ae9be-1fe1-4f9f-81ec-9e3f57d1ccde None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:08.512092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:08.578750 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 466/907] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:05:08.580043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91210395-b4e8-43f0-bb5d-1d785a208efc None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:08.610579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ae9be-1fe1-4f9f-81ec-9e3f57d1ccde None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:08.648283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c08f1a-8c74-4c73-8bd4-52d885a9b89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:08.648948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c08f1a-8c74-4c73-8bd4-52d885a9b89c None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:08.649227 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c08f1a-8c74-4c73-8bd4-52d885a9b89c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:08.649500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c08f1a-8c74-4c73-8bd4-52d885a9b89c None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:08.650218 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c08f1a-8c74-4c73-8bd4-52d885a9b89c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:08.651634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c08f1a-8c74-4c73-8bd4-52d885a9b89c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:08.666021 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 442/908] 10.222.0.99 () {60 vars in 1141 bytes} [Mon Jul 18 14:05:08 2022] POST /identity/v3/services => generated 241 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:05:08.666839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c08f1a-8c74-4c73-8bd4-52d885a9b89c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:08.707875 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91210395-b4e8-43f0-bb5d-1d785a208efc None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:08.749352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:08.751682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:08.768936 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deaed3-dc6d-4e22-8b80-257635b75526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:08.769719 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deaed3-dc6d-4e22-8b80-257635b75526 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:08.770105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deaed3-dc6d-4e22-8b80-257635b75526 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:08.770472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deaed3-dc6d-4e22-8b80-257635b75526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:08.794636 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c08f1a-8c74-4c73-8bd4-52d885a9b89c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:08.834588 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba405ea9-a790-4897-9116-df630e1637bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:08.835837 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba405ea9-a790-4897-9116-df630e1637bc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:08.836340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba405ea9-a790-4897-9116-df630e1637bc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:08.836789 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba405ea9-a790-4897-9116-df630e1637bc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:08.837622 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba405ea9-a790-4897-9116-df630e1637bc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:08.839315 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba405ea9-a790-4897-9116-df630e1637bc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ba405ea9-a790-4897-9116-df630e1637bc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:08.854080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:08.855282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:08.855282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:08.855282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:08.855282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:08.855282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:08.855282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:08.855282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:05:08.855282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:05:08.855282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:05:08.855282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:05:08.855282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:08.855282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:08.855282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:08.855282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:08.855282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:08.855282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:08.856137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:08.856137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:08.856137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:08.856137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:08.856137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:08.856137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:08.856137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:08.856137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:08.856137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:08.856137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:08.856137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:05:08.856137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:08.856137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 14:05:08.856137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:08.858867 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 443/909] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:05:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:08.864935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba405ea9-a790-4897-9116-df630e1637bc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:08.865336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95deaed3-dc6d-4e22-8b80-257635b75526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:08.866892 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95deaed3-dc6d-4e22-8b80-257635b75526 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:08.978689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba405ea9-a790-4897-9116-df630e1637bc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:08.997570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 467/910] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:05:08 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 14:05:09.004553 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deaed3-dc6d-4e22-8b80-257635b75526 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:09.013188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:09.019850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94c236-c3b0-4fac-92b2-d869b5b3f5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:09.020518 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94c236-c3b0-4fac-92b2-d869b5b3f5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:09.020796 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94c236-c3b0-4fac-92b2-d869b5b3f5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:09.021069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94c236-c3b0-4fac-92b2-d869b5b3f5e1 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:09.021838 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94c236-c3b0-4fac-92b2-d869b5b3f5e1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:09.022144 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94c236-c3b0-4fac-92b2-d869b5b3f5e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:09.023984 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94c236-c3b0-4fac-92b2-d869b5b3f5e1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:09.029215 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 444/911] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:05:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:09.036337 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94c236-c3b0-4fac-92b2-d869b5b3f5e1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:09.041671 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:09.133562 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deaed3-dc6d-4e22-8b80-257635b75526 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:09.166588 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94c236-c3b0-4fac-92b2-d869b5b3f5e1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:09.181990 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579a7d9-1cb1-4739-8b87-f82691b99625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:09.183399 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579a7d9-1cb1-4739-8b87-f82691b99625 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:09.184362 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579a7d9-1cb1-4739-8b87-f82691b99625 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:09.184841 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579a7d9-1cb1-4739-8b87-f82691b99625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:09.198314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579a7d9-1cb1-4739-8b87-f82691b99625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:09.199773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579a7d9-1cb1-4739-8b87-f82691b99625 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:09.208058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe30c9-1e72-41af-a8de-27ad8724bf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:09.209098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe30c9-1e72-41af-a8de-27ad8724bf1a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:09.210005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe30c9-1e72-41af-a8de-27ad8724bf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:09.210508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe30c9-1e72-41af-a8de-27ad8724bf1a None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:09.211689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe30c9-1e72-41af-a8de-27ad8724bf1a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:09.212209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe30c9-1e72-41af-a8de-27ad8724bf1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:09.213807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe30c9-1e72-41af-a8de-27ad8724bf1a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:09.218798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-4579a7d9-1cb1-4739-8b87-f82691b99625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:09.218798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:09.218798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:09.218798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:09.218798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:09.218798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:09.218798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:09.218798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:09.218798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:09.218798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:09.218798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:09.218798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:09.218798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:09.218798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:09.218798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:09.219755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:09.227398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:09.227398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:09.227398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:09.227398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:09.227398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 468/912] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:09.227684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 445/913] 10.222.0.99 () {56 vars in 1114 bytes} [Mon Jul 18 14:05:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:09.227767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579a7d9-1cb1-4739-8b87-f82691b99625 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:09.231716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe30c9-1e72-41af-a8de-27ad8724bf1a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:09.293576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:09.316787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:09.338850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe30c9-1e72-41af-a8de-27ad8724bf1a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:09.341504 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579a7d9-1cb1-4739-8b87-f82691b99625 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:09.373491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927be9e-2dd6-465b-a730-da959fc4be97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:09.374145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927be9e-2dd6-465b-a730-da959fc4be97 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:09.374791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927be9e-2dd6-465b-a730-da959fc4be97 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:09.375219 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927be9e-2dd6-465b-a730-da959fc4be97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:09.375927 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927be9e-2dd6-465b-a730-da959fc4be97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:09.377296 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927be9e-2dd6-465b-a730-da959fc4be97 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:09.380623 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439489ea-c774-4859-85c7-05e633770a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:09.381618 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439489ea-c774-4859-85c7-05e633770a08 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:09.382113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439489ea-c774-4859-85c7-05e633770a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:09.382635 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439489ea-c774-4859-85c7-05e633770a08 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:09.383643 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439489ea-c774-4859-85c7-05e633770a08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:09.384147 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439489ea-c774-4859-85c7-05e633770a08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:09.385894 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439489ea-c774-4859-85c7-05e633770a08 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:09.403421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 446/914] 10.222.0.99 () {60 vars in 1144 bytes} [Mon Jul 18 14:05:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:05:09.403766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 469/915] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:09.409570 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927be9e-2dd6-465b-a730-da959fc4be97 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:09.452290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52731c17-0ba5-4a2e-9a49-be68d3025f8c None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:09.452621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52731c17-0ba5-4a2e-9a49-be68d3025f8c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:09.452847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52731c17-0ba5-4a2e-9a49-be68d3025f8c None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:09.454687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 470/916] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:05:09.460576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7cf08-9f76-4a9c-802d-7db38a98c99c None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:09.460946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7cf08-9f76-4a9c-802d-7db38a98c99c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:09.461129 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7cf08-9f76-4a9c-802d-7db38a98c99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:09.485219 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-77e7cf08-9f76-4a9c-802d-7db38a98c99c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:09.486697 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-77e7cf08-9f76-4a9c-802d-7db38a98c99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:09.545986 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927be9e-2dd6-465b-a730-da959fc4be97 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:09.561201 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:09.594411 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 471/917] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:05:09.594614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2995d70-f22c-4fd9-a46d-6ec0f63497dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:09.594614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2995d70-f22c-4fd9-a46d-6ec0f63497dd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:09.594614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2995d70-f22c-4fd9-a46d-6ec0f63497dd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:09.594614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2995d70-f22c-4fd9-a46d-6ec0f63497dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:09.600412 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2995d70-f22c-4fd9-a46d-6ec0f63497dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:09.601906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2995d70-f22c-4fd9-a46d-6ec0f63497dd None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:09.612913 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7cf08-9f76-4a9c-802d-7db38a98c99c None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:09.619087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f2995d70-f22c-4fd9-a46d-6ec0f63497dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:09.619087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:09.619087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:09.619087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:09.619087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:09.619087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:09.619087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:09.619087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:09.619087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:09.619087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:09.619087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:09.619087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:09.619087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:05:09.619087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:05:09.619087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:09.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:09.621255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:05:09.621255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:05:09.621255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:05:09.621255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:05:09.621255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:05:09.621255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:05:09.621255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:09.621255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:09.621255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 447/918] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:09.628251 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2995d70-f22c-4fd9-a46d-6ec0f63497dd None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:09.700256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:09.736436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7cf08-9f76-4a9c-802d-7db38a98c99c None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:09.748128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2995d70-f22c-4fd9-a46d-6ec0f63497dd None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:09.772855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e82bb-d466-4f1d-bacd-e40785cd1706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:09.773764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e82bb-d466-4f1d-bacd-e40785cd1706 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:09.774154 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e82bb-d466-4f1d-bacd-e40785cd1706 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:09.774533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e82bb-d466-4f1d-bacd-e40785cd1706 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:09.775300 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e82bb-d466-4f1d-bacd-e40785cd1706 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:09.776728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e82bb-d466-4f1d-bacd-e40785cd1706 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:09.790034 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8bbec-69d8-49cb-b8bc-6373e11bfe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:09.790229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-b75e82bb-d466-4f1d-bacd-e40785cd1706 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 14:05:09.790229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:09.790229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:05:09.790229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:05:09.790229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:05:09.790229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:05:09.790229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:05:09.790229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:09.790229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 14:05:09.790229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:09.790229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:09.790229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:09.790229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:09.790229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:09.790229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:09.790229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:09.791393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:09.791393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:09.791393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:09.791393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:09.791393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:09.791393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:09.791393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:09.791393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:05:09.791393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:05:09.791393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:05:09.791393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:05:09.791393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:09.791393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:09.791393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:09.791393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:09.791393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:09.792419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:09.792419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:09.792419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:09.792419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:09.792419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:09.792419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:09.792419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:09.792419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:09.792419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:09.792419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:09.792419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:09.792419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:05:09.792419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:09.792419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 14:05:09.792419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:09.793751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8bbec-69d8-49cb-b8bc-6373e11bfe5b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:09.793751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8bbec-69d8-49cb-b8bc-6373e11bfe5b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:09.793751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8bbec-69d8-49cb-b8bc-6373e11bfe5b None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:09.793751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8bbec-69d8-49cb-b8bc-6373e11bfe5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:09.793751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8bbec-69d8-49cb-b8bc-6373e11bfe5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:09.794111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 472/919] 10.222.0.99 () {56 vars in 1132 bytes} [Mon Jul 18 14:05:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:09.794192 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8bbec-69d8-49cb-b8bc-6373e11bfe5b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:09.800639 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e82bb-d466-4f1d-bacd-e40785cd1706 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:09.807832 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 448/920] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:09.814110 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8bbec-69d8-49cb-b8bc-6373e11bfe5b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:09.848738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:09.926073 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8bbec-69d8-49cb-b8bc-6373e11bfe5b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:09.933805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e82bb-d466-4f1d-bacd-e40785cd1706 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:09.965917 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba84d98-73e0-4f52-897e-a549cdcb1ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:09.966510 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba84d98-73e0-4f52-897e-a549cdcb1ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:09.966791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba84d98-73e0-4f52-897e-a549cdcb1ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:09.967066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba84d98-73e0-4f52-897e-a549cdcb1ea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:09.967939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba84d98-73e0-4f52-897e-a549cdcb1ea4 None admin] RBAC: Adding query filter params (role.id=6f13a164df4e4b459767a55096a5635b, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=8f3ee6a031214346a20cdfcb7fb551d3) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:09.968195 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba84d98-73e0-4f52-897e-a549cdcb1ea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:09.969702 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba84d98-73e0-4f52-897e-a549cdcb1ea4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:09.973284 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:09.982426 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 449/921] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:05:09 2022] GET /identity/v3/role_assignments?user.id=8f3ee6a031214346a20cdfcb7fb551d3&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=6f13a164df4e4b459767a55096a5635b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:09.982626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813df70-c626-470e-b345-bee772be9402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:09.982626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813df70-c626-470e-b345-bee772be9402 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:09.982626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813df70-c626-470e-b345-bee772be9402 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:09.982868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813df70-c626-470e-b345-bee772be9402 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:09.986427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813df70-c626-470e-b345-bee772be9402 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:09.986427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813df70-c626-470e-b345-bee772be9402 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:09.986427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813df70-c626-470e-b345-bee772be9402 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:09.991728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 473/922] 10.222.0.99 () {56 vars in 1126 bytes} [Mon Jul 18 14:05:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:09.997702 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba84d98-73e0-4f52-897e-a549cdcb1ea4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:10.103855 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:10.111673 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba84d98-73e0-4f52-897e-a549cdcb1ea4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:10.149459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7be37c-2954-461d-ba5e-877ef31c4893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:10.150136 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7be37c-2954-461d-ba5e-877ef31c4893 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:10.150475 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7be37c-2954-461d-ba5e-877ef31c4893 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:10.151495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7be37c-2954-461d-ba5e-877ef31c4893 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:10.151495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7be37c-2954-461d-ba5e-877ef31c4893 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:10.151739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7be37c-2954-461d-ba5e-877ef31c4893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:10.153139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7be37c-2954-461d-ba5e-877ef31c4893 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:10.159518 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 450/923] 10.222.0.99 () {56 vars in 1126 bytes} [Mon Jul 18 14:05:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:10.165175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813df70-c626-470e-b345-bee772be9402 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:10.267483 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813df70-c626-470e-b345-bee772be9402 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:10.301429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f77e3f-9808-4b4f-ad1d-dee37a7d5366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:10.302100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f77e3f-9808-4b4f-ad1d-dee37a7d5366 None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:10.302376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f77e3f-9808-4b4f-ad1d-dee37a7d5366 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:10.302677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f77e3f-9808-4b4f-ad1d-dee37a7d5366 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:10.303435 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f77e3f-9808-4b4f-ad1d-dee37a7d5366 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:10.304809 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f77e3f-9808-4b4f-ad1d-dee37a7d5366 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:10.326256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 474/924] 10.222.0.99 () {60 vars in 1144 bytes} [Mon Jul 18 14:05:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:05:10.790616 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e0e31-c4a8-44dd-a6db-2b4eb8db5011 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:10.791150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e0e31-c4a8-44dd-a6db-2b4eb8db5011 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:10.791150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e0e31-c4a8-44dd-a6db-2b4eb8db5011 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:10.792840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 451/925] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:10.798159 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acfaa8-1fa5-4c1a-94a1-67aaada3a1c3 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:10.798480 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acfaa8-1fa5-4c1a-94a1-67aaada3a1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:10.798766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acfaa8-1fa5-4c1a-94a1-67aaada3a1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:10.817440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-96acfaa8-1fa5-4c1a-94a1-67aaada3a1c3 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:10.819623 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-96acfaa8-1fa5-4c1a-94a1-67aaada3a1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:10.871547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:10.898351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 475/926] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:10.923315 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e0e31-c4a8-44dd-a6db-2b4eb8db5011 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:11.036080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e0e31-c4a8-44dd-a6db-2b4eb8db5011 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:11.070914 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666947e-b114-44b6-9337-ab924672e554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:11.071643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666947e-b114-44b6-9337-ab924672e554 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:11.071928 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666947e-b114-44b6-9337-ab924672e554 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:11.072207 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666947e-b114-44b6-9337-ab924672e554 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:11.072907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666947e-b114-44b6-9337-ab924672e554 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:11.074372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666947e-b114-44b6-9337-ab924672e554 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d666947e-b114-44b6-9337-ab924672e554 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:11.086766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:11.087874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:11.087874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:11.087874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:11.087874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:11.087874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:11.087874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:11.087874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:05:11.087874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:05:11.087874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:05:11.087874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:05:11.087874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:11.087874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:11.087874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:11.087874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:11.087874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:11.087874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:11.088780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:11.088780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:11.088780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:11.088780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:11.088780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:11.088780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:11.088780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:11.088780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:11.088780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:11.088780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:11.088780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:05:11.088780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:11.088780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 14:05:11.088780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:11.092864 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 452/927] 10.222.0.99 () {56 vars in 1126 bytes} [Mon Jul 18 14:05:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:11.095686 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acfaa8-1fa5-4c1a-94a1-67aaada3a1c3 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:11.207054 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acfaa8-1fa5-4c1a-94a1-67aaada3a1c3 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:11.251497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc27e7-b5a8-467a-8e94-29d9d4cb8f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:11.252177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc27e7-b5a8-467a-8e94-29d9d4cb8f24 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:11.252462 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc27e7-b5a8-467a-8e94-29d9d4cb8f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:11.252746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc27e7-b5a8-467a-8e94-29d9d4cb8f24 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:11.253469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc27e7-b5a8-467a-8e94-29d9d4cb8f24 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:11.253776 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc27e7-b5a8-467a-8e94-29d9d4cb8f24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:11.255185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc27e7-b5a8-467a-8e94-29d9d4cb8f24 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:11.264979 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 476/928] 10.222.0.99 () {56 vars in 1122 bytes} [Mon Jul 18 14:05:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:11.266551 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666947e-b114-44b6-9337-ab924672e554 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:11.300752 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:11.376675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666947e-b114-44b6-9337-ab924672e554 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:11.410005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8d18a-2be0-4163-b9b5-f2ee894454cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:11.410696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8d18a-2be0-4163-b9b5-f2ee894454cc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:11.410981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8d18a-2be0-4163-b9b5-f2ee894454cc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:11.411255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8d18a-2be0-4163-b9b5-f2ee894454cc None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:11.411968 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8d18a-2be0-4163-b9b5-f2ee894454cc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:11.412274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8d18a-2be0-4163-b9b5-f2ee894454cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:11.413665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8d18a-2be0-4163-b9b5-f2ee894454cc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:11.422518 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 453/929] 10.222.0.99 () {56 vars in 1122 bytes} [Mon Jul 18 14:05:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:11.425137 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc27e7-b5a8-467a-8e94-29d9d4cb8f24 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:11.473014 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:11.535176 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc27e7-b5a8-467a-8e94-29d9d4cb8f24 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:11.570720 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989239f3-81a6-4f5c-b08a-f7437ed41819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:11.571386 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989239f3-81a6-4f5c-b08a-f7437ed41819 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:11.571671 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989239f3-81a6-4f5c-b08a-f7437ed41819 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:11.571949 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989239f3-81a6-4f5c-b08a-f7437ed41819 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:11.574226 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46865d6-69f0-4ea0-a992-7851c2e5163c None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:11.574533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46865d6-69f0-4ea0-a992-7851c2e5163c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:11.574807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46865d6-69f0-4ea0-a992-7851c2e5163c None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:11.576448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 454/930] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:05:11.576662 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989239f3-81a6-4f5c-b08a-f7437ed41819 None admin] RBAC: Adding query filter params (interface=public, service_id=63b9bb2aa95a4531a705a790bf828965, region_id=RegionOne) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:11.576991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989239f3-81a6-4f5c-b08a-f7437ed41819 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:11.578465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989239f3-81a6-4f5c-b08a-f7437ed41819 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:11.582087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23915810-dd88-480f-8e6e-1aaaad810c98 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:11.582633 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23915810-dd88-480f-8e6e-1aaaad810c98 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:11.583119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23915810-dd88-480f-8e6e-1aaaad810c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:11.588576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 477/931] 10.222.0.99 () {56 vars in 1251 bytes} [Mon Jul 18 14:05:11 2022] GET /identity/v3/endpoints?service_id=63b9bb2aa95a4531a705a790bf828965&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:11.589825 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989239f3-81a6-4f5c-b08a-f7437ed41819 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:11.602210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-23915810-dd88-480f-8e6e-1aaaad810c98 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:11.604808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-23915810-dd88-480f-8e6e-1aaaad810c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:11.682560 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 455/932] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:05:11.689793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989239f3-81a6-4f5c-b08a-f7437ed41819 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:11.697559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:11.704610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23915810-dd88-480f-8e6e-1aaaad810c98 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:11.723997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:11.726316 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a6468-58c6-45ec-8cba-6f9b554a1058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:11.727235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a6468-58c6-45ec-8cba-6f9b554a1058 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:11.727399 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a6468-58c6-45ec-8cba-6f9b554a1058 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:11.727651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a6468-58c6-45ec-8cba-6f9b554a1058 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:11.728475 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a6468-58c6-45ec-8cba-6f9b554a1058 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:11.729959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a6468-58c6-45ec-8cba-6f9b554a1058 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:11.742527 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 478/933] 10.222.0.99 () {56 vars in 1087 bytes} [Mon Jul 18 14:05:11 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:05:11.822345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23915810-dd88-480f-8e6e-1aaaad810c98 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:11.860002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b7f74-bea5-41f1-ab98-06eedd872999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:11.860645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b7f74-bea5-41f1-ab98-06eedd872999 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:11.860928 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b7f74-bea5-41f1-ab98-06eedd872999 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:11.861204 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b7f74-bea5-41f1-ab98-06eedd872999 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:11.861944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b7f74-bea5-41f1-ab98-06eedd872999 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:11.863544 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b7f74-bea5-41f1-ab98-06eedd872999 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:11.864947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: WARNING keystone.server.flask.common [None req-654b7f74-bea5-41f1-ab98-06eedd872999 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 18 14:05:11.884805 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.sql.core [None req-654b7f74-bea5-41f1-ab98-06eedd872999 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 14:05:11.884805 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 14:05:11.884805 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [parameters: {'id': 'ae8f50dbaac34b3d9a7c2bc22e6c1380', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 14:05:11.884805 dv-cinder-797608-58-smb devstack@keystone.service[80435]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80435) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 14:05:11.901998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-654b7f74-bea5-41f1-ab98-06eedd872999 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ae8f50dbaac34b3d9a7c2bc22e6c1380.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ae8f50dbaac34b3d9a7c2bc22e6c1380. Jul 18 14:05:11.901998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:11.901998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 14:05:11.901998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 14:05:11.901998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 14:05:11.901998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 14:05:11.901998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 14:05:11.901998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 14:05:11.901998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 14:05:11.901998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application conn.query(q) Jul 18 14:05:11.901998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 14:05:11.901998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 14:05:11.901998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application result.read() Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 18 14:05:11.902905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application next(self.gen) Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application yield resource Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application next(self.gen) Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise self.value Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application session.commit() Jul 18 14:05:11.903868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.session.flush() Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application compat.raise_( Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 14:05:11.904746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 14:05:11.905707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 14:05:11.905707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 14:05:11.905707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 14:05:11.905707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 14:05:11.905707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 14:05:11.905707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 14:05:11.905707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 14:05:11.905707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 14:05:11.905707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 14:05:11.905707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 14:05:11.905707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 14:05:11.905707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 14:05:11.905707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 14:05:11.905707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 14:05:11.905707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application conn.query(q) Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application result.read() Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 14:05:11.906526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 14:05:11.907446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 14:05:11.907446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 14:05:11.907446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 14:05:11.907446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 14:05:11.907446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 14:05:11.907446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 14:05:11.907446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 14:05:11.907446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 14:05:11.907446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [parameters: {'id': 'ae8f50dbaac34b3d9a7c2bc22e6c1380', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 14:05:11.907446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 14:05:11.907446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:11.907446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:11.907446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:11.907446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:11.907446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:11.908231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:11.909293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:11.909293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 18 14:05:11.909293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 18 14:05:11.909293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:11.909293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:11.909293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 18 14:05:11.909293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 18 14:05:11.909293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ae8f50dbaac34b3d9a7c2bc22e6c1380. Jul 18 14:05:11.909293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:11.909293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 456/934] 10.222.0.99 () {60 vars in 1140 bytes} [Mon Jul 18 14:05:11 2022] POST /identity/v3/projects => generated 262 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:11.916107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a6468-58c6-45ec-8cba-6f9b554a1058 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:12.030536 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a6468-58c6-45ec-8cba-6f9b554a1058 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:12.065668 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f191e9c-eb2a-4d7b-b2bb-8ad017771803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:12.066502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f191e9c-eb2a-4d7b-b2bb-8ad017771803 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:12.066787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f191e9c-eb2a-4d7b-b2bb-8ad017771803 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:12.067062 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f191e9c-eb2a-4d7b-b2bb-8ad017771803 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:12.074560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f191e9c-eb2a-4d7b-b2bb-8ad017771803 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:12.076032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f191e9c-eb2a-4d7b-b2bb-8ad017771803 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:12.091201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-8f191e9c-eb2a-4d7b-b2bb-8ad017771803 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:12.091201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:12.091201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:12.091201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:12.091201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:12.091201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:12.091201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:12.091201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:12.091201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:12.091201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:12.091201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:12.091201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:12.091201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:05:12.091201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:05:12.091201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:12.092148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:12.093036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:05:12.093036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:05:12.093036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:05:12.093036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:05:12.093036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:05:12.093036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:05:12.093036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:12.093036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:12.093036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 479/935] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:05:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:12.099028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b7f74-bea5-41f1-ab98-06eedd872999 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:12.126684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c837993-fe19-49d3-894e-4fda0efb7970 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:12.127202 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c837993-fe19-49d3-894e-4fda0efb7970 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:12.127298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c837993-fe19-49d3-894e-4fda0efb7970 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:12.128977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 480/936] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:05:12.134180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dc00a-1c53-4069-a0ee-ecbc52cd2734 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:12.134519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dc00a-1c53-4069-a0ee-ecbc52cd2734 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:12.134805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dc00a-1c53-4069-a0ee-ecbc52cd2734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:12.155372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-0d3dc00a-1c53-4069-a0ee-ecbc52cd2734 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:12.157441 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-0d3dc00a-1c53-4069-a0ee-ecbc52cd2734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:12.185397 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:12.208588 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:12.236634 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 481/937] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:12.246561 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b7f74-bea5-41f1-ab98-06eedd872999 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:12.259961 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dc00a-1c53-4069-a0ee-ecbc52cd2734 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:12.288565 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e29bc0-2138-4ece-8844-27faee259a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:12.290094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e29bc0-2138-4ece-8844-27faee259a91 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:12.290557 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e29bc0-2138-4ece-8844-27faee259a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:12.290973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e29bc0-2138-4ece-8844-27faee259a91 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:12.292533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e29bc0-2138-4ece-8844-27faee259a91 None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:12.293126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e29bc0-2138-4ece-8844-27faee259a91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:12.295051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e29bc0-2138-4ece-8844-27faee259a91 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:12.322485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 457/938] 10.222.0.99 () {56 vars in 1112 bytes} [Mon Jul 18 14:05:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:12.372202 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dc00a-1c53-4069-a0ee-ecbc52cd2734 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:12.389355 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301c5c7-5d29-49ea-b28e-49d6cec86e5f None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:12.389624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301c5c7-5d29-49ea-b28e-49d6cec86e5f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:12.389915 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301c5c7-5d29-49ea-b28e-49d6cec86e5f None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:12.391793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 458/939] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:12.397374 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25174bb4-6aff-4009-9ab4-bc06e5e8a650 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:12.397663 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25174bb4-6aff-4009-9ab4-bc06e5e8a650 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:12.397949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25174bb4-6aff-4009-9ab4-bc06e5e8a650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:12.415994 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-25174bb4-6aff-4009-9ab4-bc06e5e8a650 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:12.417538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-25174bb4-6aff-4009-9ab4-bc06e5e8a650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:12.417907 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a1f8f-a69e-4349-a75c-13b0ae95034d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:12.418945 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a1f8f-a69e-4349-a75c-13b0ae95034d None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:12.419384 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a1f8f-a69e-4349-a75c-13b0ae95034d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:12.420032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a1f8f-a69e-4349-a75c-13b0ae95034d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:12.435572 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a1f8f-a69e-4349-a75c-13b0ae95034d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:05:12.448005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-0c0a1f8f-a69e-4349-a75c-13b0ae95034d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 14:05:12.448005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:12.448005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:12.448005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:12.448005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:12.448005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:12.448005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:12.448005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:12.448005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:12.448005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:12.448005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:12.448005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:12.448005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:05:12.448005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:05:12.448005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:05:12.448005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:05:12.449240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:05:12.449240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:05:12.449240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:05:12.449240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:05:12.449240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:12.449240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:12.449240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:12.449240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:12.449240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:12.449240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:12.449240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:12.449240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:12.449240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:12.449240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:12.449240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:12.449240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:12.450296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:12.450296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:12.450296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:12.450296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:12.450296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:05:12.450296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:05:12.450296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:05:12.450296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:05:12.450296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:05:12.450296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:05:12.450296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 14:05:12.450296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:12.452179 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 482/940] 10.222.0.99 () {56 vars in 1120 bytes} [Mon Jul 18 14:05:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:12.457895 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a1f8f-a69e-4349-a75c-13b0ae95034d None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:12.489016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:12.510742 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 459/941] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:05:12.526911 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25174bb4-6aff-4009-9ab4-bc06e5e8a650 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:12.590915 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a1f8f-a69e-4349-a75c-13b0ae95034d None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:12.601407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:12.644756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e958513-4640-4d32-9e1d-55797dd11ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:12.645955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e958513-4640-4d32-9e1d-55797dd11ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:12.646244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e958513-4640-4d32-9e1d-55797dd11ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:12.646557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e958513-4640-4d32-9e1d-55797dd11ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:12.647592 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e958513-4640-4d32-9e1d-55797dd11ae1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:12.647902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e958513-4640-4d32-9e1d-55797dd11ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:12.650178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e958513-4640-4d32-9e1d-55797dd11ae1 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:12.659358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25174bb4-6aff-4009-9ab4-bc06e5e8a650 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:12.661263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 483/942] 10.222.0.99 () {56 vars in 1115 bytes} [Mon Jul 18 14:05:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:12.666783 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e958513-4640-4d32-9e1d-55797dd11ae1 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:12.706813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936049a6-6f19-470d-aa0e-4570bbdd1ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:12.708161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936049a6-6f19-470d-aa0e-4570bbdd1ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:12.708452 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936049a6-6f19-470d-aa0e-4570bbdd1ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:12.708732 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936049a6-6f19-470d-aa0e-4570bbdd1ef1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:12.709402 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936049a6-6f19-470d-aa0e-4570bbdd1ef1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:12.711662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936049a6-6f19-470d-aa0e-4570bbdd1ef1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-936049a6-6f19-470d-aa0e-4570bbdd1ef1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:12.727619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:12.728652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:12.728652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:12.728652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:12.728652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:12.728652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:12.728652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:12.728652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:05:12.728652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:05:12.728652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:05:12.728652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:05:12.728652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:12.728652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:12.728652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:12.728652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:12.728652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:12.728652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:12.729477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:12.729477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:12.729477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:12.729477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:12.729477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:12.729477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:12.729477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:12.729477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:12.729477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:12.729477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:12.729477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:05:12.729477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:12.729477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 14:05:12.729477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:12.730202 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 460/943] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:05:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:12.735704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936049a6-6f19-470d-aa0e-4570bbdd1ef1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:12.757571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:12.777651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e958513-4640-4d32-9e1d-55797dd11ae1 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:12.812888 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1af7e-3874-4ca1-93f3-9fae9f71a9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:12.813899 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1af7e-3874-4ca1-93f3-9fae9f71a9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:12.814249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1af7e-3874-4ca1-93f3-9fae9f71a9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:12.814618 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1af7e-3874-4ca1-93f3-9fae9f71a9f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:12.827122 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1af7e-3874-4ca1-93f3-9fae9f71a9f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:12.828711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1af7e-3874-4ca1-93f3-9fae9f71a9f1 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:12.841295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936049a6-6f19-470d-aa0e-4570bbdd1ef1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:12.849810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-86a1af7e-3874-4ca1-93f3-9fae9f71a9f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:12.849810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:12.849810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:12.849810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:12.849810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:12.849810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:12.849810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:12.849810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:12.849810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:12.849810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:12.849810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:12.849810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:12.849810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:12.849810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:12.849810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:12.851879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:12.853921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:12.853921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:12.853921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:12.853921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:12.858209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 484/944] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:12.858209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1af7e-3874-4ca1-93f3-9fae9f71a9f1 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:12.868630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:12.878872 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b65b0-df89-4b88-9264-663cbc6e2cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:12.879542 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b65b0-df89-4b88-9264-663cbc6e2cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:12.879826 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b65b0-df89-4b88-9264-663cbc6e2cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:12.880105 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b65b0-df89-4b88-9264-663cbc6e2cc9 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:12.881266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b65b0-df89-4b88-9264-663cbc6e2cc9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:12.881581 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b65b0-df89-4b88-9264-663cbc6e2cc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:12.883311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b65b0-df89-4b88-9264-663cbc6e2cc9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:12.894561 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 461/945] 10.222.0.99 () {56 vars in 1112 bytes} [Mon Jul 18 14:05:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:12.898095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b65b0-df89-4b88-9264-663cbc6e2cc9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:12.973008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1af7e-3874-4ca1-93f3-9fae9f71a9f1 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:13.014465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68503432-c021-4d65-80d0-81abe5e1748e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:13.015793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68503432-c021-4d65-80d0-81abe5e1748e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:13.016898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68503432-c021-4d65-80d0-81abe5e1748e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:13.017376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68503432-c021-4d65-80d0-81abe5e1748e None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:13.018440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68503432-c021-4d65-80d0-81abe5e1748e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:13.018937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68503432-c021-4d65-80d0-81abe5e1748e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:13.021360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68503432-c021-4d65-80d0-81abe5e1748e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:13.024030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:13.034009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b65b0-df89-4b88-9264-663cbc6e2cc9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:13.040597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 485/946] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:13.046899 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68503432-c021-4d65-80d0-81abe5e1748e None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:13.085153 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b40678-4209-4c6d-9bf1-6bc5f7c8aa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:13.086753 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b40678-4209-4c6d-9bf1-6bc5f7c8aa51 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:13.087211 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b40678-4209-4c6d-9bf1-6bc5f7c8aa51 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:13.087636 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b40678-4209-4c6d-9bf1-6bc5f7c8aa51 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:13.089179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b40678-4209-4c6d-9bf1-6bc5f7c8aa51 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:13.089907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b40678-4209-4c6d-9bf1-6bc5f7c8aa51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:13.091592 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b40678-4209-4c6d-9bf1-6bc5f7c8aa51 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:13.099268 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 462/947] 10.222.0.99 () {56 vars in 1112 bytes} [Mon Jul 18 14:05:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:13.178069 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68503432-c021-4d65-80d0-81abe5e1748e None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:13.216722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901ac81-a375-43a1-86e6-5c9371b2f7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:13.217554 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901ac81-a375-43a1-86e6-5c9371b2f7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:13.217836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901ac81-a375-43a1-86e6-5c9371b2f7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:13.218106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f901ac81-a375-43a1-86e6-5c9371b2f7e7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:13.226671 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901ac81-a375-43a1-86e6-5c9371b2f7e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:13.228149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f901ac81-a375-43a1-86e6-5c9371b2f7e7 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:13.244944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-f901ac81-a375-43a1-86e6-5c9371b2f7e7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 14:05:13.244944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:13.244944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:13.244944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:13.244944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:13.244944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:13.244944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:13.244944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:13.244944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:13.244944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:13.244944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:13.244944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:13.244944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:05:13.244944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:05:13.244944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:05:13.244944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:13.245975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:13.247586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:13.247586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:13.247586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:05:13.247586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:05:13.247586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:05:13.247586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:05:13.247586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:05:13.247586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:05:13.247586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 14:05:13.247586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:13.250683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 486/948] 10.222.0.99 () {56 vars in 1117 bytes} [Mon Jul 18 14:05:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:13.252826 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b40678-4209-4c6d-9bf1-6bc5f7c8aa51 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:13.313556 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:13.360133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b40678-4209-4c6d-9bf1-6bc5f7c8aa51 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:13.395790 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fb0ec-6824-429b-83ad-f659e14fdcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:13.396945 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fb0ec-6824-429b-83ad-f659e14fdcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:13.397467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fb0ec-6824-429b-83ad-f659e14fdcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:13.397942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fb0ec-6824-429b-83ad-f659e14fdcf6 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:13.399033 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fb0ec-6824-429b-83ad-f659e14fdcf6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:13.399566 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fb0ec-6824-429b-83ad-f659e14fdcf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:13.401206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fb0ec-6824-429b-83ad-f659e14fdcf6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:13.420554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 463/949] 10.222.0.99 () {56 vars in 1149 bytes} [Mon Jul 18 14:05:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:13.425945 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901ac81-a375-43a1-86e6-5c9371b2f7e7 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:13.484699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:13.531307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f901ac81-a375-43a1-86e6-5c9371b2f7e7 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:13.566424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d416ccb-bcdc-420b-9ba8-efba7e21060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:13.567235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d416ccb-bcdc-420b-9ba8-efba7e21060b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:13.567568 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d416ccb-bcdc-420b-9ba8-efba7e21060b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:13.567847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d416ccb-bcdc-420b-9ba8-efba7e21060b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:13.578570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d416ccb-bcdc-420b-9ba8-efba7e21060b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:13.580036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d416ccb-bcdc-420b-9ba8-efba7e21060b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:13.598749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-3d416ccb-bcdc-420b-9ba8-efba7e21060b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:13.598749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:13.598749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:13.598749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:13.598749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:13.598749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:13.598749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:13.598749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:13.598749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:13.598749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:13.598749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:13.598749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:13.598749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:13.598749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:13.598749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:13.599699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:13.600585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:13.600585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:13.600585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:13.600585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:13.600585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 487/950] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:13.606300 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fb0ec-6824-429b-83ad-f659e14fdcf6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:13.710946 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fb0ec-6824-429b-83ad-f659e14fdcf6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:13.726323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:13.748762 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49848931-c0c3-4b1a-b4a8-a92c9cb70d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:13.750011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49848931-c0c3-4b1a-b4a8-a92c9cb70d12 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:13.750580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49848931-c0c3-4b1a-b4a8-a92c9cb70d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:13.751020 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49848931-c0c3-4b1a-b4a8-a92c9cb70d12 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:13.751895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49848931-c0c3-4b1a-b4a8-a92c9cb70d12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:13.752483 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49848931-c0c3-4b1a-b4a8-a92c9cb70d12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:13.754031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49848931-c0c3-4b1a-b4a8-a92c9cb70d12 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:13.766551 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 464/951] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:13.774684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d416ccb-bcdc-420b-9ba8-efba7e21060b None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:13.835786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea9a88-610c-4cef-bd34-5669dcefa0e2 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:13.836451 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea9a88-610c-4cef-bd34-5669dcefa0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:13.836943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea9a88-610c-4cef-bd34-5669dcefa0e2 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:13.838892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 465/952] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:05:13.843990 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570e9f-7589-459d-a62e-8cb02070daf5 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:13.844648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570e9f-7589-459d-a62e-8cb02070daf5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:13.844727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570e9f-7589-459d-a62e-8cb02070daf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:13.862423 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3f570e9f-7589-459d-a62e-8cb02070daf5 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:13.863739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3f570e9f-7589-459d-a62e-8cb02070daf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:13.875760 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d416ccb-bcdc-420b-9ba8-efba7e21060b None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:13.883499 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:13.912666 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b54d14-f6c7-4532-9f96-c5873104cf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:13.913458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b54d14-f6c7-4532-9f96-c5873104cf3e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:13.913743 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b54d14-f6c7-4532-9f96-c5873104cf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:13.914017 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b54d14-f6c7-4532-9f96-c5873104cf3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:13.921399 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b54d14-f6c7-4532-9f96-c5873104cf3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:13.923742 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b54d14-f6c7-4532-9f96-c5873104cf3e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:13.942608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-69b54d14-f6c7-4532-9f96-c5873104cf3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:13.942608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:13.942608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:13.942608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:13.942608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:13.942608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:13.942608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:13.942608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:13.942608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:13.942608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:13.942608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:13.942608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:13.942608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:05:13.942608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:05:13.942608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:13.943546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:13.944624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:05:13.944624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:05:13.944624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:05:13.944624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:05:13.944624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:05:13.944624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:05:13.944624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:13.944624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:13.945581 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 466/954] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:05:13.946438 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 488/954] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:05:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:13.951436 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570e9f-7589-459d-a62e-8cb02070daf5 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:13.965018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b54d14-f6c7-4532-9f96-c5873104cf3e None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:14.074578 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570e9f-7589-459d-a62e-8cb02070daf5 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:14.077825 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:14.079736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b54d14-f6c7-4532-9f96-c5873104cf3e None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:14.120811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f40670-6963-4bc3-8bd8-0977016dc450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:14.122059 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f40670-6963-4bc3-8bd8-0977016dc450 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:14.122483 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f40670-6963-4bc3-8bd8-0977016dc450 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:14.122902 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f40670-6963-4bc3-8bd8-0977016dc450 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:14.123834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f40670-6963-4bc3-8bd8-0977016dc450 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:14.124728 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f40670-6963-4bc3-8bd8-0977016dc450 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:14.126652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f40670-6963-4bc3-8bd8-0977016dc450 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:14.127338 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be4a85-4f93-4170-a94e-20f3f4554854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:14.128318 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be4a85-4f93-4170-a94e-20f3f4554854 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:14.128861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be4a85-4f93-4170-a94e-20f3f4554854 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:14.129295 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be4a85-4f93-4170-a94e-20f3f4554854 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:14.130341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be4a85-4f93-4170-a94e-20f3f4554854 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:14.131880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be4a85-4f93-4170-a94e-20f3f4554854 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:14.142434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 467/955] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:14.148229 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f40670-6963-4bc3-8bd8-0977016dc450 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-17be4a85-4f93-4170-a94e-20f3f4554854 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:14.150254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:14.151458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:14.151458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:14.151458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:14.151458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:14.151458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:14.151458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:14.151458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:05:14.151458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:05:14.151458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:05:14.151458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:05:14.151458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:14.151458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:14.151458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:14.151458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:14.151458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:14.151458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:14.157390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:14.157390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:14.157390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:14.157390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:14.157390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:14.157390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:14.157390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:14.157390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:14.157390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:14.157390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:14.157390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:05:14.157390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:14.157390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 14:05:14.157390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:14.157390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 489/956] 10.222.0.99 () {56 vars in 1126 bytes} [Mon Jul 18 14:05:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:14.159832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be4a85-4f93-4170-a94e-20f3f4554854 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:14.193280 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:14.272334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f40670-6963-4bc3-8bd8-0977016dc450 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:14.273308 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be4a85-4f93-4170-a94e-20f3f4554854 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:14.306189 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1092f48-6964-44ef-9872-6459f8fd8a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:14.307209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1092f48-6964-44ef-9872-6459f8fd8a74 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:14.307594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1092f48-6964-44ef-9872-6459f8fd8a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:14.307880 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1092f48-6964-44ef-9872-6459f8fd8a74 None admin] PATH_INFO: `/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/8f3ee6a031214346a20cdfcb7fb551d3/roles/6f13a164df4e4b459767a55096a5635b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:14.310087 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93563522-a167-4a98-913d-1be86dc12df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:14.310224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1092f48-6964-44ef-9872-6459f8fd8a74 None admin] RBAC: Authorizing `identity:create_grant(project_id=50b78e16c86b4e6cac3a725f536a8274, user_id=8f3ee6a031214346a20cdfcb7fb551d3, role_id=6f13a164df4e4b459767a55096a5635b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:14.311122 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93563522-a167-4a98-913d-1be86dc12df9 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:14.311615 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1092f48-6964-44ef-9872-6459f8fd8a74 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:14.311724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93563522-a167-4a98-913d-1be86dc12df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:14.312186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93563522-a167-4a98-913d-1be86dc12df9 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:14.313219 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93563522-a167-4a98-913d-1be86dc12df9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:14.313770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93563522-a167-4a98-913d-1be86dc12df9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:14.315694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93563522-a167-4a98-913d-1be86dc12df9 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:14.327374 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 490/957] 10.222.0.99 () {56 vars in 1122 bytes} [Mon Jul 18 14:05:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:14.328398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93563522-a167-4a98-913d-1be86dc12df9 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:14.329823 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 468/958] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:05:14 2022] PUT /identity/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/8f3ee6a031214346a20cdfcb7fb551d3/roles/6f13a164df4e4b459767a55096a5635b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:05:14.445929 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:14.454149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93563522-a167-4a98-913d-1be86dc12df9 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:14.493258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2dbd0-879f-40c0-82d4-7ee84aad9b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:14.493934 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2dbd0-879f-40c0-82d4-7ee84aad9b36 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:14.494217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2dbd0-879f-40c0-82d4-7ee84aad9b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:14.494525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2dbd0-879f-40c0-82d4-7ee84aad9b36 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:14.495241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2dbd0-879f-40c0-82d4-7ee84aad9b36 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:14.495548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2dbd0-879f-40c0-82d4-7ee84aad9b36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:14.496920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2dbd0-879f-40c0-82d4-7ee84aad9b36 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:14.502435 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 491/959] 10.222.0.99 () {56 vars in 1122 bytes} [Mon Jul 18 14:05:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:14.509119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1092f48-6964-44ef-9872-6459f8fd8a74 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:14.511579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4ca7-b145-43bc-85be-561a47fdf82f None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:14.511866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4ca7-b145-43bc-85be-561a47fdf82f None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:14.512147 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4ca7-b145-43bc-85be-561a47fdf82f None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:14.513500 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 492/960] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:14.519456 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c12e4-b05c-40cc-b92f-ed5d558d9bcd None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:14.519741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c12e4-b05c-40cc-b92f-ed5d558d9bcd None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:14.520013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c12e4-b05c-40cc-b92f-ed5d558d9bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:14.543460 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:14.543826 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-932c12e4-b05c-40cc-b92f-ed5d558d9bcd None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:14.545019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-932c12e4-b05c-40cc-b92f-ed5d558d9bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:14.616332 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 493/961] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:14.643655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c12e4-b05c-40cc-b92f-ed5d558d9bcd None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:14.652886 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1092f48-6964-44ef-9872-6459f8fd8a74 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:14.691328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a32a39-18ec-4664-b369-a2c0d28c86b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:14.692166 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a32a39-18ec-4664-b369-a2c0d28c86b6 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:14.692541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a32a39-18ec-4664-b369-a2c0d28c86b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:14.692906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a32a39-18ec-4664-b369-a2c0d28c86b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:14.694155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a32a39-18ec-4664-b369-a2c0d28c86b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:14.695925 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a32a39-18ec-4664-b369-a2c0d28c86b6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:14.720868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 469/962] 10.222.0.99 () {60 vars in 1144 bytes} [Mon Jul 18 14:05:14 2022] POST /identity/v3/endpoints => generated 349 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:05:14.751156 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:14.767486 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c12e4-b05c-40cc-b92f-ed5d558d9bcd None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:14.816976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f74755-409a-4d73-bfa5-17335d80e8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:14.818143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74755-409a-4d73-bfa5-17335d80e8a3 None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:14.818814 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74755-409a-4d73-bfa5-17335d80e8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:14.819427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f74755-409a-4d73-bfa5-17335d80e8a3 None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:14.820555 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f74755-409a-4d73-bfa5-17335d80e8a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:14.822473 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f74755-409a-4d73-bfa5-17335d80e8a3 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:14.824368 dv-cinder-797608-58-smb devstack@keystone.service[80436]: WARNING keystone.server.flask.common [None req-68f74755-409a-4d73-bfa5-17335d80e8a3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 18 14:05:14.839337 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.sql.core [None req-68f74755-409a-4d73-bfa5-17335d80e8a3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 14:05:14.839337 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 14:05:14.839337 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [parameters: {'user_id': '7b6efa868bb64ea18ec210eb98afef69', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 14:05:14.839337 dv-cinder-797608-58-smb devstack@keystone.service[80436]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80436) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 14:05:14.848517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-68f74755-409a-4d73-bfa5-17335d80e8a3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 14:05:14.848517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:14.848517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 14:05:14.848517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 14:05:14.848517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 14:05:14.848517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 14:05:14.848517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 14:05:14.848517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 14:05:14.848517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 14:05:14.848517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application conn.query(q) Jul 18 14:05:14.848517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 14:05:14.848517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 14:05:14.848517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 14:05:14.848517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application result.read() Jul 18 14:05:14.848517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 14:05:14.849518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application next(self.gen) Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application yield resource Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application next(self.gen) Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise self.value Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application session.commit() Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 14:05:14.850563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self.session.flush() Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application compat.raise_( Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 14:05:14.851508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 14:05:14.852442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 14:05:14.852442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 14:05:14.852442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 14:05:14.852442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 18 14:05:14.852442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 14:05:14.852442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 14:05:14.852442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 14:05:14.852442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 14:05:14.852442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 14:05:14.852442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 14:05:14.852442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 14:05:14.852442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 14:05:14.852442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 14:05:14.852442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 14:05:14.852442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 14:05:14.852442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception Jul 18 14:05:14.853314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 14:05:14.853314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 14:05:14.853314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 14:05:14.853314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 14:05:14.853314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 14:05:14.853314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 14:05:14.853314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 14:05:14.853314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application conn.query(q) Jul 18 14:05:14.853314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 14:05:14.853314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 14:05:14.853314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 14:05:14.853314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application result.read() Jul 18 14:05:14.853314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 14:05:14.853314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 14:05:14.853314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 14:05:14.853314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 14:05:14.854149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 14:05:14.854149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 14:05:14.854149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 14:05:14.854149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 14:05:14.854149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 14:05:14.854149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 14:05:14.854149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [parameters: {'user_id': '7b6efa868bb64ea18ec210eb98afef69', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 14:05:14.854149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 14:05:14.854149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:14.854149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:14.854149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:14.854149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:14.854149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:14.854149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:14.854149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 18 14:05:14.856805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 18 14:05:14.859074 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 18 14:05:14.859074 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 18 14:05:14.859074 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 14:05:14.859074 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 14:05:14.859074 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 14:05:14.859074 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:14.862030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 494/963] 10.222.0.99 () {60 vars in 1131 bytes} [Mon Jul 18 14:05:14 2022] POST /identity/v3/users => generated 160 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:14.868916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a32a39-18ec-4664-b369-a2c0d28c86b6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:14.966797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:14.987098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a32a39-18ec-4664-b369-a2c0d28c86b6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:15.021609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7bd5b-c99d-4c63-b239-bea68681c394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:15.022492 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7bd5b-c99d-4c63-b239-bea68681c394 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:15.022773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7bd5b-c99d-4c63-b239-bea68681c394 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:15.023045 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7bd5b-c99d-4c63-b239-bea68681c394 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:15.031255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7bd5b-c99d-4c63-b239-bea68681c394 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:15.032907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7bd5b-c99d-4c63-b239-bea68681c394 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:15.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-6dd7bd5b-c99d-4c63-b239-bea68681c394 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 14:05:15.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:15.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:15.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:15.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:15.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:15.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:15.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:15.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:15.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:15.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:15.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:15.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:05:15.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:05:15.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:05:15.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:15.048036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:15.049076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:15.049076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:15.049076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:05:15.049076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:05:15.049076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:05:15.049076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:05:15.049076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:05:15.049076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:05:15.049076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 14:05:15.049076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:15.049076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 470/964] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:05:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:15.056445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f74755-409a-4d73-bfa5-17335d80e8a3 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:15.168845 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f74755-409a-4d73-bfa5-17335d80e8a3 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:15.206599 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391cb97-4f30-48d9-9c2e-89eaec8fce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:15.208097 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391cb97-4f30-48d9-9c2e-89eaec8fce16 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:15.208604 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391cb97-4f30-48d9-9c2e-89eaec8fce16 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:15.209104 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391cb97-4f30-48d9-9c2e-89eaec8fce16 None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:15.210123 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391cb97-4f30-48d9-9c2e-89eaec8fce16 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:15.210696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391cb97-4f30-48d9-9c2e-89eaec8fce16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:15.212566 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391cb97-4f30-48d9-9c2e-89eaec8fce16 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:15.254774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 495/965] 10.222.0.99 () {56 vars in 1101 bytes} [Mon Jul 18 14:05:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:15.323998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93c349-dd43-4d6c-9bdf-65bc6a24eebb None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:15.324375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93c349-dd43-4d6c-9bdf-65bc6a24eebb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:15.324556 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93c349-dd43-4d6c-9bdf-65bc6a24eebb None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:15.326239 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 471/966] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:15.332302 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a09c65-c88a-4b9e-ae2d-efcaf6907d1c None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:15.332597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a09c65-c88a-4b9e-ae2d-efcaf6907d1c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:15.332861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a09c65-c88a-4b9e-ae2d-efcaf6907d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:15.339482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:15.353626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-05a09c65-c88a-4b9e-ae2d-efcaf6907d1c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:15.355595 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-05a09c65-c88a-4b9e-ae2d-efcaf6907d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:15.432046 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 496/967] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:15.454781 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93c349-dd43-4d6c-9bdf-65bc6a24eebb None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:15.567634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93c349-dd43-4d6c-9bdf-65bc6a24eebb None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:15.608418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc1eb4-83cb-4b44-a924-797f6bb86fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:15.608418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc1eb4-83cb-4b44-a924-797f6bb86fe2 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:15.608418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc1eb4-83cb-4b44-a924-797f6bb86fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:15.608418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc1eb4-83cb-4b44-a924-797f6bb86fe2 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:15.609042 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc1eb4-83cb-4b44-a924-797f6bb86fe2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:15.610417 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc1eb4-83cb-4b44-a924-797f6bb86fe2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:15.622659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:15.634434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 472/968] 10.222.0.99 () {60 vars in 1141 bytes} [Mon Jul 18 14:05:15 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:05:16.437838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac76ca-8de8-4645-a521-9a878234d6cd None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:16.438437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac76ca-8de8-4645-a521-9a878234d6cd None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:16.438437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac76ca-8de8-4645-a521-9a878234d6cd None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:16.440024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 497/969] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:16.445469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c628c-761a-4528-a1dc-de79faaa3cd2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:16.445914 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c628c-761a-4528-a1dc-de79faaa3cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:16.446083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c628c-761a-4528-a1dc-de79faaa3cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:16.463645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-fc5c628c-761a-4528-a1dc-de79faaa3cd2 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:16.465035 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fc5c628c-761a-4528-a1dc-de79faaa3cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:16.547791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 473/970] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:16.571523 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac76ca-8de8-4645-a521-9a878234d6cd None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:16.685647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac76ca-8de8-4645-a521-9a878234d6cd None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:16.722760 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98478585-49a2-4297-8ccd-3d53b3e2e036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:16.723499 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98478585-49a2-4297-8ccd-3d53b3e2e036 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:16.723781 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98478585-49a2-4297-8ccd-3d53b3e2e036 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:16.724059 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98478585-49a2-4297-8ccd-3d53b3e2e036 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:16.726043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:16.736747 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98478585-49a2-4297-8ccd-3d53b3e2e036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:05:16.745033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-98478585-49a2-4297-8ccd-3d53b3e2e036 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 14:05:16.745033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:16.745033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:16.745033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:16.745033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:16.745033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:16.745033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:16.745033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:16.745033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:16.745033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:16.745033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:16.745033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:16.745033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:05:16.745033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:05:16.745033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:05:16.745033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:05:16.746048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:05:16.746048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:05:16.746048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:05:16.746048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:05:16.746048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:16.746048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:16.746048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:16.746048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:16.746048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:16.746048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:16.746048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:16.746048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:16.746048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:16.746048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:16.746048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:16.746048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:16.747305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:16.747305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:16.747305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:16.747305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:16.747305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:05:16.747305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:05:16.747305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:05:16.747305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:05:16.747305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:05:16.747305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:05:16.747305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 14:05:16.747305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:16.747305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 498/971] 10.222.0.99 () {56 vars in 1120 bytes} [Mon Jul 18 14:05:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:16.752997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c628c-761a-4528-a1dc-de79faaa3cd2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:16.815594 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a11a-dce5-481e-ad89-4c26e4403d1a None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:16.815853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a11a-dce5-481e-ad89-4c26e4403d1a None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:16.816104 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a11a-dce5-481e-ad89-4c26e4403d1a None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:16.817452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 499/972] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:05:16.823607 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e14fe-3b2c-475b-8918-dfd179e081ae None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:16.824154 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e14fe-3b2c-475b-8918-dfd179e081ae None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:16.824750 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e14fe-3b2c-475b-8918-dfd179e081ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:16.846123 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-e78e14fe-3b2c-475b-8918-dfd179e081ae None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:16.847349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e78e14fe-3b2c-475b-8918-dfd179e081ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:16.860653 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c628c-761a-4528-a1dc-de79faaa3cd2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:16.886251 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:16.896194 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764d50b-d893-476b-8ebd-8824bcce623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:16.896865 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764d50b-d893-476b-8ebd-8824bcce623a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:16.897147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764d50b-d893-476b-8ebd-8824bcce623a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:16.897436 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764d50b-d893-476b-8ebd-8824bcce623a None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:16.898183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764d50b-d893-476b-8ebd-8824bcce623a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:16.898529 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764d50b-d893-476b-8ebd-8824bcce623a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:16.899929 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764d50b-d893-476b-8ebd-8824bcce623a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:16.912945 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 474/973] 10.222.0.99 () {56 vars in 1115 bytes} [Mon Jul 18 14:05:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:16.913807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764d50b-d893-476b-8ebd-8824bcce623a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:16.918970 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 500/974] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:16.942755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e14fe-3b2c-475b-8918-dfd179e081ae None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:17.020140 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764d50b-d893-476b-8ebd-8824bcce623a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:17.049167 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e14fe-3b2c-475b-8918-dfd179e081ae None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:17.057889 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc955149-cdf8-4b0f-8c80-a2246aafa319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:17.058719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc955149-cdf8-4b0f-8c80-a2246aafa319 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:17.059004 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc955149-cdf8-4b0f-8c80-a2246aafa319 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:17.059276 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc955149-cdf8-4b0f-8c80-a2246aafa319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:17.070272 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc955149-cdf8-4b0f-8c80-a2246aafa319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:17.071752 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc955149-cdf8-4b0f-8c80-a2246aafa319 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:17.075811 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:17.089220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-fc955149-cdf8-4b0f-8c80-a2246aafa319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:17.089220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:17.089220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:17.089220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:17.089220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:17.089220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:17.089220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:17.089220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:17.089220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:17.089220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:17.089220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:17.089220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:17.089220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:17.089220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:17.089220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:17.090159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:17.091147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:17.091147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:17.091147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:17.091147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:17.091396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e345bf-675f-4e3f-8336-22da8057a284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:17.091396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e345bf-675f-4e3f-8336-22da8057a284 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:17.091396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e345bf-675f-4e3f-8336-22da8057a284 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:17.091396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e345bf-675f-4e3f-8336-22da8057a284 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:17.091673 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e345bf-675f-4e3f-8336-22da8057a284 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:17.092780 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e345bf-675f-4e3f-8336-22da8057a284 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:17.095351 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 475/975] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:17.096142 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc955149-cdf8-4b0f-8c80-a2246aafa319 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-f8e345bf-675f-4e3f-8336-22da8057a284 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:17.106189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:17.107307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:17.107307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:17.107307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:17.107307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:17.107307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:17.107307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:17.107307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:05:17.107307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:05:17.107307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:05:17.107307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:05:17.107307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:17.107307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:17.107307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:17.107307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:17.107307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:17.107307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:17.108132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:17.108132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:17.108132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:17.108132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:17.108132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:17.108132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:17.108132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:17.108132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:17.108132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:17.108132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:17.108132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:05:17.108132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:17.108132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 14:05:17.108132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:17.110826 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 501/976] 10.222.0.99 () {56 vars in 1126 bytes} [Mon Jul 18 14:05:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:17.114777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e345bf-675f-4e3f-8336-22da8057a284 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:17.149365 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:17.217623 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc955149-cdf8-4b0f-8c80-a2246aafa319 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:17.226855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e345bf-675f-4e3f-8336-22da8057a284 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:17.257934 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d153597-7f2d-4c77-ba9a-e9759850afee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:17.258990 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d153597-7f2d-4c77-ba9a-e9759850afee None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:17.259424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d153597-7f2d-4c77-ba9a-e9759850afee None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:17.259850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d153597-7f2d-4c77-ba9a-e9759850afee None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:17.260752 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d153597-7f2d-4c77-ba9a-e9759850afee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:17.261217 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d153597-7f2d-4c77-ba9a-e9759850afee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:17.262801 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d153597-7f2d-4c77-ba9a-e9759850afee None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:17.263048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73e10c-a46b-4064-8e43-4cb34956ab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:17.263713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73e10c-a46b-4064-8e43-4cb34956ab3f None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:17.263999 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73e10c-a46b-4064-8e43-4cb34956ab3f None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:17.264278 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73e10c-a46b-4064-8e43-4cb34956ab3f None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:17.264986 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73e10c-a46b-4064-8e43-4cb34956ab3f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:17.265289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73e10c-a46b-4064-8e43-4cb34956ab3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:17.266704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73e10c-a46b-4064-8e43-4cb34956ab3f None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:17.274489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 502/977] 10.222.0.99 () {56 vars in 1122 bytes} [Mon Jul 18 14:05:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:17.277774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73e10c-a46b-4064-8e43-4cb34956ab3f None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:17.281974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 476/978] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:17.287365 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d153597-7f2d-4c77-ba9a-e9759850afee None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:17.336638 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:17.387735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:17.390577 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73e10c-a46b-4064-8e43-4cb34956ab3f None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:17.391134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d153597-7f2d-4c77-ba9a-e9759850afee None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:17.427274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a244a-129b-45de-a910-8c9782c31dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:17.428087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a244a-129b-45de-a910-8c9782c31dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:17.428372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a244a-129b-45de-a910-8c9782c31dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:17.428650 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a244a-129b-45de-a910-8c9782c31dd1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:17.428970 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e963a-fce6-44f5-9799-c2d948ff5bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:17.429636 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e963a-fce6-44f5-9799-c2d948ff5bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:17.429923 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e963a-fce6-44f5-9799-c2d948ff5bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:17.430258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e963a-fce6-44f5-9799-c2d948ff5bd4 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:17.431063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e963a-fce6-44f5-9799-c2d948ff5bd4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:17.431489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e963a-fce6-44f5-9799-c2d948ff5bd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:17.432866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e963a-fce6-44f5-9799-c2d948ff5bd4 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:17.436082 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a244a-129b-45de-a910-8c9782c31dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:17.437512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a244a-129b-45de-a910-8c9782c31dd1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:17.443017 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 503/979] 10.222.0.99 () {56 vars in 1122 bytes} [Mon Jul 18 14:05:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:17.443763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e963a-fce6-44f5-9799-c2d948ff5bd4 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:17.452743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-2b9a244a-129b-45de-a910-8c9782c31dd1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 14:05:17.452743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:17.452743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:17.452743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:17.452743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:17.452743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:17.452743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:17.452743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:17.452743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:17.452743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:17.452743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:17.452743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:17.452743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:05:17.452743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:05:17.452743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:05:17.452743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:17.454160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:17.455235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:17.455235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:17.455235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:05:17.455235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:05:17.455235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:05:17.455235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:05:17.455235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:05:17.455235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:05:17.455235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 14:05:17.455235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:17.458718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 477/980] 10.222.0.99 () {56 vars in 1117 bytes} [Mon Jul 18 14:05:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:17.459716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a244a-129b-45de-a910-8c9782c31dd1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:17.552062 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e963a-fce6-44f5-9799-c2d948ff5bd4 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:17.564124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a244a-129b-45de-a910-8c9782c31dd1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:17.568726 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:17.587648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c50ff-7ba2-4130-9ff4-0db482bd942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:17.588334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c50ff-7ba2-4130-9ff4-0db482bd942b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:17.588621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c50ff-7ba2-4130-9ff4-0db482bd942b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:17.588896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c50ff-7ba2-4130-9ff4-0db482bd942b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:17.589701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c50ff-7ba2-4130-9ff4-0db482bd942b None admin] RBAC: Adding query filter params (interface=admin, service_id=63b9bb2aa95a4531a705a790bf828965, region_id=RegionOne) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:17.590016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c50ff-7ba2-4130-9ff4-0db482bd942b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:17.591422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c50ff-7ba2-4130-9ff4-0db482bd942b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:17.597032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 504/981] 10.222.0.99 () {56 vars in 1249 bytes} [Mon Jul 18 14:05:17 2022] GET /identity/v3/endpoints?service_id=63b9bb2aa95a4531a705a790bf828965&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:17.600725 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64779f40-5a90-432e-b394-4180ffffa090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:17.601397 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64779f40-5a90-432e-b394-4180ffffa090 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:17.601680 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64779f40-5a90-432e-b394-4180ffffa090 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:17.601951 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64779f40-5a90-432e-b394-4180ffffa090 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:17.602182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c50ff-7ba2-4130-9ff4-0db482bd942b None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:17.602824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64779f40-5a90-432e-b394-4180ffffa090 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:17.603132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64779f40-5a90-432e-b394-4180ffffa090 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:17.604571 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64779f40-5a90-432e-b394-4180ffffa090 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:17.626072 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 478/982] 10.222.0.99 () {56 vars in 1149 bytes} [Mon Jul 18 14:05:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:17.631463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64779f40-5a90-432e-b394-4180ffffa090 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:17.650608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:17.706043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c50ff-7ba2-4130-9ff4-0db482bd942b None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:17.736005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64779f40-5a90-432e-b394-4180ffffa090 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:17.758369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91a74a-acfd-4f88-995c-17e2d0fa2f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:17.759078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91a74a-acfd-4f88-995c-17e2d0fa2f31 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:17.761986 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91a74a-acfd-4f88-995c-17e2d0fa2f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:17.762276 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91a74a-acfd-4f88-995c-17e2d0fa2f31 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:17.763009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91a74a-acfd-4f88-995c-17e2d0fa2f31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:17.764393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91a74a-acfd-4f88-995c-17e2d0fa2f31 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:17.771103 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 505/983] 10.222.0.99 () {56 vars in 1087 bytes} [Mon Jul 18 14:05:17 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:05:17.772412 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660aac4-990f-4665-a950-93012e506059 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:17.772699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660aac4-990f-4665-a950-93012e506059 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:17.772976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660aac4-990f-4665-a950-93012e506059 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:17.774208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 506/984] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:17.781197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489b7db-16cb-46f6-be96-3f30e64c8611 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:17.781557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489b7db-16cb-46f6-be96-3f30e64c8611 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:17.781916 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489b7db-16cb-46f6-be96-3f30e64c8611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:17.790718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb2bca-85e8-42b7-92ca-e323a5150407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:17.791393 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb2bca-85e8-42b7-92ca-e323a5150407 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:17.791674 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb2bca-85e8-42b7-92ca-e323a5150407 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:17.791946 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb2bca-85e8-42b7-92ca-e323a5150407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:17.805705 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-9489b7db-16cb-46f6-be96-3f30e64c8611 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:17.807249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9489b7db-16cb-46f6-be96-3f30e64c8611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:17.853234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:17.873229 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb2bca-85e8-42b7-92ca-e323a5150407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:17.875197 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb2bca-85e8-42b7-92ca-e323a5150407 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:17.884753 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 507/985] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:17.895335 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:17.907599 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489b7db-16cb-46f6-be96-3f30e64c8611 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:17.989911 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 479/986] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:05:17 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 14:05:17.995311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb2bca-85e8-42b7-92ca-e323a5150407 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:18.017655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489b7db-16cb-46f6-be96-3f30e64c8611 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:18.053037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb381f0-dbed-4b6e-91ce-638cbf83e40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:18.053944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb381f0-dbed-4b6e-91ce-638cbf83e40b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:18.054232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb381f0-dbed-4b6e-91ce-638cbf83e40b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:18.054629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb381f0-dbed-4b6e-91ce-638cbf83e40b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:18.055307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb381f0-dbed-4b6e-91ce-638cbf83e40b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:18.056758 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb381f0-dbed-4b6e-91ce-638cbf83e40b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-ebb381f0-dbed-4b6e-91ce-638cbf83e40b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:18.069136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:18.070232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:18.070232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:18.070232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:18.070232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:18.070232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:18.070232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:18.070232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:05:18.070232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:05:18.070232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:05:18.070232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:05:18.070232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:18.070232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:18.070232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:18.070232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:18.070232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:18.070232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:18.071131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:18.071131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:18.071131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:18.071131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:18.071131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:18.071131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:18.071131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:18.071131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:18.071131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:18.071131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:18.071131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:05:18.071131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:18.071131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 14:05:18.071131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:18.075351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 508/987] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:05:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:18.076104 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb381f0-dbed-4b6e-91ce-638cbf83e40b None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:18.099864 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb2bca-85e8-42b7-92ca-e323a5150407 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:18.120903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:18.121885 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:18.145035 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c766435-6a14-4662-81f2-745b4aba60d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:18.147006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c766435-6a14-4662-81f2-745b4aba60d1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:18.147291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c766435-6a14-4662-81f2-745b4aba60d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:18.147565 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c766435-6a14-4662-81f2-745b4aba60d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:18.159175 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c766435-6a14-4662-81f2-745b4aba60d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:18.160675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c766435-6a14-4662-81f2-745b4aba60d1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:18.182722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-4c766435-6a14-4662-81f2-745b4aba60d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:18.182722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:18.182722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:18.182722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:18.182722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:18.182722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:18.182722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:18.182722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:18.182722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:18.182722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:18.182722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:18.182722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:18.182722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:18.182722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:18.182722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:18.184063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:18.184975 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:18.184975 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:18.184975 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:18.184975 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:18.190074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 480/988] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:18.191065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c766435-6a14-4662-81f2-745b4aba60d1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:18.200450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb381f0-dbed-4b6e-91ce-638cbf83e40b None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:18.238424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412c9e5-ca65-4dd5-ad28-3a60d310348f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:18.239804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412c9e5-ca65-4dd5-ad28-3a60d310348f None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:18.239804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412c9e5-ca65-4dd5-ad28-3a60d310348f None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:18.240576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412c9e5-ca65-4dd5-ad28-3a60d310348f None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:18.240819 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412c9e5-ca65-4dd5-ad28-3a60d310348f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:18.241391 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412c9e5-ca65-4dd5-ad28-3a60d310348f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:18.243066 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412c9e5-ca65-4dd5-ad28-3a60d310348f None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:18.250602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 509/989] 10.222.0.99 () {56 vars in 1112 bytes} [Mon Jul 18 14:05:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:18.255580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412c9e5-ca65-4dd5-ad28-3a60d310348f None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:18.304795 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c766435-6a14-4662-81f2-745b4aba60d1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:18.342067 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015af83-5d9d-4783-a94b-a59448b6b141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:18.342854 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015af83-5d9d-4783-a94b-a59448b6b141 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:18.343058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015af83-5d9d-4783-a94b-a59448b6b141 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:18.343305 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015af83-5d9d-4783-a94b-a59448b6b141 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:18.344125 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015af83-5d9d-4783-a94b-a59448b6b141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:18.344429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015af83-5d9d-4783-a94b-a59448b6b141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:18.345825 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015af83-5d9d-4783-a94b-a59448b6b141 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:18.362831 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 481/990] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:18.363005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412c9e5-ca65-4dd5-ad28-3a60d310348f None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:18.364650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:18.365398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015af83-5d9d-4783-a94b-a59448b6b141 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:18.397428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:18.402199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9eb8e-6c06-4db8-9ea7-0202e293fc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:18.403349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9eb8e-6c06-4db8-9ea7-0202e293fc45 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:18.403349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9eb8e-6c06-4db8-9ea7-0202e293fc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:18.403527 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9eb8e-6c06-4db8-9ea7-0202e293fc45 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:18.404180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9eb8e-6c06-4db8-9ea7-0202e293fc45 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:18.404491 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9eb8e-6c06-4db8-9ea7-0202e293fc45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:18.405859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9eb8e-6c06-4db8-9ea7-0202e293fc45 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:18.416166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 510/991] 10.222.0.99 () {56 vars in 1112 bytes} [Mon Jul 18 14:05:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:18.416999 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9eb8e-6c06-4db8-9ea7-0202e293fc45 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:18.469776 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015af83-5d9d-4783-a94b-a59448b6b141 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:18.506810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb43610-7679-4220-b21e-b030b41af872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:18.507606 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb43610-7679-4220-b21e-b030b41af872 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:18.507888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb43610-7679-4220-b21e-b030b41af872 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:18.508170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb43610-7679-4220-b21e-b030b41af872 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:18.515042 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb43610-7679-4220-b21e-b030b41af872 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:18.516538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb43610-7679-4220-b21e-b030b41af872 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:18.520423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9eb8e-6c06-4db8-9ea7-0202e293fc45 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:18.530894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-3bb43610-7679-4220-b21e-b030b41af872 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:18.530894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:18.530894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:18.530894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:18.530894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:18.530894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:18.530894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:18.530894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:18.530894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:18.530894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:18.530894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:18.530894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:18.530894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:05:18.530894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:05:18.530894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:18.531876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:18.532835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:05:18.532835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:05:18.532835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:05:18.532835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:05:18.532835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:05:18.532835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:05:18.532835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:18.532835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:18.532835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 482/992] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:05:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:18.538068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb43610-7679-4220-b21e-b030b41af872 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:18.563113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a42e6-bcb8-4168-84ff-c354493dc8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:18.563775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a42e6-bcb8-4168-84ff-c354493dc8fb None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:18.564168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a42e6-bcb8-4168-84ff-c354493dc8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:18.564445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a42e6-bcb8-4168-84ff-c354493dc8fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:18.565362 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a42e6-bcb8-4168-84ff-c354493dc8fb None admin] RBAC: Adding query filter params (interface=public, service_id=2f9cd35655df4a63904d9799e24241c1, region_id=RegionOne) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:18.565677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a42e6-bcb8-4168-84ff-c354493dc8fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:18.567189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a42e6-bcb8-4168-84ff-c354493dc8fb None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:18.577174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 511/993] 10.222.0.99 () {56 vars in 1251 bytes} [Mon Jul 18 14:05:18 2022] GET /identity/v3/endpoints?service_id=2f9cd35655df4a63904d9799e24241c1&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:18.578152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a42e6-bcb8-4168-84ff-c354493dc8fb None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:18.614094 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:18.644241 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:18.655360 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb43610-7679-4220-b21e-b030b41af872 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:18.689563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a42e6-bcb8-4168-84ff-c354493dc8fb None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:18.692328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330adbb-0435-4778-8f6c-b14c2ab8f864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:18.693061 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330adbb-0435-4778-8f6c-b14c2ab8f864 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:18.693413 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330adbb-0435-4778-8f6c-b14c2ab8f864 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:18.693780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330adbb-0435-4778-8f6c-b14c2ab8f864 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:18.694762 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330adbb-0435-4778-8f6c-b14c2ab8f864 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:18.695139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330adbb-0435-4778-8f6c-b14c2ab8f864 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:18.696651 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330adbb-0435-4778-8f6c-b14c2ab8f864 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:18.710306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 483/994] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:05:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:18.716180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330adbb-0435-4778-8f6c-b14c2ab8f864 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:18.730707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fa8cc-ec07-439c-9269-4b5870603073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:18.731462 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fa8cc-ec07-439c-9269-4b5870603073 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:18.731754 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fa8cc-ec07-439c-9269-4b5870603073 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:18.732038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fa8cc-ec07-439c-9269-4b5870603073 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:18.732734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fa8cc-ec07-439c-9269-4b5870603073 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:18.734104 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fa8cc-ec07-439c-9269-4b5870603073 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:18.741345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 512/995] 10.222.0.99 () {56 vars in 1087 bytes} [Mon Jul 18 14:05:18 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:05:18.829721 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330adbb-0435-4778-8f6c-b14c2ab8f864 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:18.870164 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42d986-7617-4c34-a3c5-5ba2f47f914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:18.870781 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42d986-7617-4c34-a3c5-5ba2f47f914a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:18.871067 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42d986-7617-4c34-a3c5-5ba2f47f914a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:18.871345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42d986-7617-4c34-a3c5-5ba2f47f914a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:18.872209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42d986-7617-4c34-a3c5-5ba2f47f914a None admin] RBAC: Adding query filter params (role.id=6f13a164df4e4b459767a55096a5635b, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=8f3ee6a031214346a20cdfcb7fb551d3) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:18.872525 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42d986-7617-4c34-a3c5-5ba2f47f914a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:18.874013 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42d986-7617-4c34-a3c5-5ba2f47f914a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:18.881704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 484/996] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:05:18 2022] GET /identity/v3/role_assignments?user.id=8f3ee6a031214346a20cdfcb7fb551d3&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=6f13a164df4e4b459767a55096a5635b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:19.786535 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d305d-984c-4577-a67b-d31b85b77ffa None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:19.787099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d305d-984c-4577-a67b-d31b85b77ffa None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:19.787099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d305d-984c-4577-a67b-d31b85b77ffa None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:19.788653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 513/997] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:05:19.793731 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441f374-9ed7-4fbf-afeb-48399b433ae8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:19.794161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441f374-9ed7-4fbf-afeb-48399b433ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:19.794357 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441f374-9ed7-4fbf-afeb-48399b433ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:19.811096 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5441f374-9ed7-4fbf-afeb-48399b433ae8 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:19.812294 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5441f374-9ed7-4fbf-afeb-48399b433ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:19.822543 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:19.885949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 485/998] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:19.908094 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d305d-984c-4577-a67b-d31b85b77ffa None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:20.005429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:20.014628 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d305d-984c-4577-a67b-d31b85b77ffa None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:20.050225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5e4ec-6581-47ac-bfe9-0bc3a45ea94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:20.050983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5e4ec-6581-47ac-bfe9-0bc3a45ea94e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:20.051270 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5e4ec-6581-47ac-bfe9-0bc3a45ea94e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:20.051542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5e4ec-6581-47ac-bfe9-0bc3a45ea94e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:20.052198 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5e4ec-6581-47ac-bfe9-0bc3a45ea94e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:20.053568 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5e4ec-6581-47ac-bfe9-0bc3a45ea94e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-9db5e4ec-6581-47ac-bfe9-0bc3a45ea94e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:20.065756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:20.066985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:20.066985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:20.066985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:20.066985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:20.066985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:20.066985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:20.066985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:05:20.066985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:05:20.066985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:05:20.066985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:05:20.066985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:20.066985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:20.066985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:20.066985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:20.066985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:20.066985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:20.067807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:20.067807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:20.067807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:20.067807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:20.067807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:20.067807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:20.067807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:20.067807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:20.067807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:20.067807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:20.067807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:05:20.067807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:20.067807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 14:05:20.067807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:20.070704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 514/999] 10.222.0.99 () {56 vars in 1126 bytes} [Mon Jul 18 14:05:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:20.072926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441f374-9ed7-4fbf-afeb-48399b433ae8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:20.183836 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441f374-9ed7-4fbf-afeb-48399b433ae8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:20.217947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f273d6-b7cf-4a2e-997b-5725051dce62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:20.218640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f273d6-b7cf-4a2e-997b-5725051dce62 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:20.218922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f273d6-b7cf-4a2e-997b-5725051dce62 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:20.219384 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f273d6-b7cf-4a2e-997b-5725051dce62 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:20.220238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f273d6-b7cf-4a2e-997b-5725051dce62 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:20.220548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f273d6-b7cf-4a2e-997b-5725051dce62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:20.221926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f273d6-b7cf-4a2e-997b-5725051dce62 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:20.227149 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 486/1000] 10.222.0.99 () {56 vars in 1122 bytes} [Mon Jul 18 14:05:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:20.232758 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5e4ec-6581-47ac-bfe9-0bc3a45ea94e None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:20.338650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5e4ec-6581-47ac-bfe9-0bc3a45ea94e None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:20.375977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1ee44-b74a-4d78-9f65-8d95f378d1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:20.376993 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1ee44-b74a-4d78-9f65-8d95f378d1fa None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:20.377418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1ee44-b74a-4d78-9f65-8d95f378d1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:20.377817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1ee44-b74a-4d78-9f65-8d95f378d1fa None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:20.379013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1ee44-b74a-4d78-9f65-8d95f378d1fa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:20.379626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1ee44-b74a-4d78-9f65-8d95f378d1fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:20.382002 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1ee44-b74a-4d78-9f65-8d95f378d1fa None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:20.387711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 515/1001] 10.222.0.99 () {56 vars in 1122 bytes} [Mon Jul 18 14:05:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:20.393608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f273d6-b7cf-4a2e-997b-5725051dce62 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:20.405255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:20.498758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f273d6-b7cf-4a2e-997b-5725051dce62 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:20.533369 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00c46b-f088-4435-abf5-a02e698e91cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:20.534022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00c46b-f088-4435-abf5-a02e698e91cf None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:20.534298 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00c46b-f088-4435-abf5-a02e698e91cf None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:20.534592 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00c46b-f088-4435-abf5-a02e698e91cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:20.535331 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00c46b-f088-4435-abf5-a02e698e91cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:20.536697 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00c46b-f088-4435-abf5-a02e698e91cf None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:20.562414 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 487/1002] 10.222.0.99 () {60 vars in 1144 bytes} [Mon Jul 18 14:05:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:05:20.730879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09ec9a-a205-4bb0-ba19-3b7eaf19ba94 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:20.731165 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09ec9a-a205-4bb0-ba19-3b7eaf19ba94 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:20.731439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09ec9a-a205-4bb0-ba19-3b7eaf19ba94 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:20.732812 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 516/1003] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:20.738490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87487c9f-607b-441d-ac43-093d2ad5bc78 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:20.738783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87487c9f-607b-441d-ac43-093d2ad5bc78 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:20.739060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87487c9f-607b-441d-ac43-093d2ad5bc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:20.756719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-87487c9f-607b-441d-ac43-093d2ad5bc78 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:20.757910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-87487c9f-607b-441d-ac43-093d2ad5bc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:20.822528 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:20.836560 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 488/1004] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:20 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:20.859195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09ec9a-a205-4bb0-ba19-3b7eaf19ba94 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:20.885626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:20.934223 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d7a5b-c4f0-4062-92f0-79b8a9966fb2 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:20.934561 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d7a5b-c4f0-4062-92f0-79b8a9966fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:20.934844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d7a5b-c4f0-4062-92f0-79b8a9966fb2 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:20.936343 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 489/1005] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:20.941762 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dbee4-2307-464d-966a-3d5863ee8b4d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:20.942277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dbee4-2307-464d-966a-3d5863ee8b4d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:20.942880 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dbee4-2307-464d-966a-3d5863ee8b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:20.960878 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3e8dbee4-2307-464d-966a-3d5863ee8b4d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:20.962406 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3e8dbee4-2307-464d-966a-3d5863ee8b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:20.969725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09ec9a-a205-4bb0-ba19-3b7eaf19ba94 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:21.005233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d625a-410d-4c48-848f-c4d7d76ebdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:21.005953 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d625a-410d-4c48-848f-c4d7d76ebdea None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:21.006235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d625a-410d-4c48-848f-c4d7d76ebdea None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:21.006542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d625a-410d-4c48-848f-c4d7d76ebdea None admin] PATH_INFO: `/v3/services/compute` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:21.007201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d625a-410d-4c48-848f-c4d7d76ebdea None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:21.008570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d625a-410d-4c48-848f-c4d7d76ebdea None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-3d8d625a-410d-4c48-848f-c4d7d76ebdea None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:21.021143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:21.022360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:21.022360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:21.022360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:21.022360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:21.022360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:21.022360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:21.022360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:05:21.022360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:05:21.022360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:05:21.022360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:05:21.022360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:21.022360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:21.022360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:21.022360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:21.022360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:21.022360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:21.023431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:21.023431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:21.023431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:21.023431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:21.023431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:21.023431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:21.023431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:21.023431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:21.023431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:21.023431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:21.023431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:05:21.023431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:21.023431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 14:05:21.023431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:21.026576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 517/1006] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:05:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:21.028150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d625a-410d-4c48-848f-c4d7d76ebdea None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:21.038488 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 490/1007] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:20 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:05:21.060843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dbee4-2307-464d-966a-3d5863ee8b4d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:21.116433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:21.136289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d625a-410d-4c48-848f-c4d7d76ebdea None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:21.170770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8dbee4-2307-464d-966a-3d5863ee8b4d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:21.175485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19461992-bed2-4ec8-b376-0198830b7baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:21.176328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19461992-bed2-4ec8-b376-0198830b7baf None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:21.176776 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19461992-bed2-4ec8-b376-0198830b7baf None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:21.177194 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19461992-bed2-4ec8-b376-0198830b7baf None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:21.178447 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19461992-bed2-4ec8-b376-0198830b7baf None admin] RBAC: Adding query filter params (name=compute) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:21.178819 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19461992-bed2-4ec8-b376-0198830b7baf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:21.180196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19461992-bed2-4ec8-b376-0198830b7baf None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:21.189866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 518/1008] 10.222.0.99 () {56 vars in 1112 bytes} [Mon Jul 18 14:05:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:21.193335 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19461992-bed2-4ec8-b376-0198830b7baf None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:21.200405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:21.212985 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4dd13-0c11-4ee5-a4de-9e50fd5d9b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:21.213876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4dd13-0c11-4ee5-a4de-9e50fd5d9b76 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:21.214226 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4dd13-0c11-4ee5-a4de-9e50fd5d9b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:21.214630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4dd13-0c11-4ee5-a4de-9e50fd5d9b76 None admin] PATH_INFO: `/v3/services/image` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:21.215200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4dd13-0c11-4ee5-a4de-9e50fd5d9b76 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:21.216582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4dd13-0c11-4ee5-a4de-9e50fd5d9b76 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-e0c4dd13-0c11-4ee5-a4de-9e50fd5d9b76 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:21.228620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:21.229704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:21.229704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:21.229704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:21.229704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:21.229704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:21.229704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:21.229704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:05:21.229704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:05:21.229704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:05:21.229704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:05:21.229704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:21.229704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:21.229704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:21.229704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:21.229704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:21.229704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:21.230583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:21.230583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:21.230583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:21.230583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:21.230583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:21.230583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:21.230583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:21.230583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:21.230583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:21.230583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:21.230583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:05:21.230583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:21.230583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 14:05:21.230583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:21.230583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 491/1009] 10.222.0.99 () {56 vars in 1105 bytes} [Mon Jul 18 14:05:21 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:21.235884 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4dd13-0c11-4ee5-a4de-9e50fd5d9b76 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:21.306341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19461992-bed2-4ec8-b376-0198830b7baf None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:21.340692 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4dd13-0c11-4ee5-a4de-9e50fd5d9b76 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:21.341763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1273169-d45b-4a35-b9c5-ccb43dc57b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:21.342573 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1273169-d45b-4a35-b9c5-ccb43dc57b86 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:21.342981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1273169-d45b-4a35-b9c5-ccb43dc57b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:21.343256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1273169-d45b-4a35-b9c5-ccb43dc57b86 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:21.343993 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1273169-d45b-4a35-b9c5-ccb43dc57b86 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:21.344310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1273169-d45b-4a35-b9c5-ccb43dc57b86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:21.345774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1273169-d45b-4a35-b9c5-ccb43dc57b86 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:21.355862 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 519/1010] 10.222.0.99 () {56 vars in 1112 bytes} [Mon Jul 18 14:05:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:21.356928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1273169-d45b-4a35-b9c5-ccb43dc57b86 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:21.373642 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a4ab3-5bf0-4b60-9fc1-3c87917cf32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:21.373816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:21.374784 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a4ab3-5bf0-4b60-9fc1-3c87917cf32d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:21.374917 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a4ab3-5bf0-4b60-9fc1-3c87917cf32d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:21.375300 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a4ab3-5bf0-4b60-9fc1-3c87917cf32d None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:21.376069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a4ab3-5bf0-4b60-9fc1-3c87917cf32d None admin] RBAC: Adding query filter params (name=image) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:21.376370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a4ab3-5bf0-4b60-9fc1-3c87917cf32d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:21.377942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a4ab3-5bf0-4b60-9fc1-3c87917cf32d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:21.387494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 492/1011] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:21.388483 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a4ab3-5bf0-4b60-9fc1-3c87917cf32d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:21.444122 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:21.472290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1273169-d45b-4a35-b9c5-ccb43dc57b86 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:21.495140 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a4ab3-5bf0-4b60-9fc1-3c87917cf32d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:21.510220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4c2bf-3bbb-49f6-8e88-9dd2be5c721d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:21.510919 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4c2bf-3bbb-49f6-8e88-9dd2be5c721d None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:21.511201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4c2bf-3bbb-49f6-8e88-9dd2be5c721d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:21.511477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4c2bf-3bbb-49f6-8e88-9dd2be5c721d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:21.512229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4c2bf-3bbb-49f6-8e88-9dd2be5c721d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:21.513571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4c2bf-3bbb-49f6-8e88-9dd2be5c721d None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:21.530645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf424e8-8ffb-473b-ad31-70f1bf8f7dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:21.531301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf424e8-8ffb-473b-ad31-70f1bf8f7dac None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:21.531707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf424e8-8ffb-473b-ad31-70f1bf8f7dac None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:21.532051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf424e8-8ffb-473b-ad31-70f1bf8f7dac None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:21.532906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf424e8-8ffb-473b-ad31-70f1bf8f7dac None admin] RBAC: Adding query filter params (type=image) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:21.533231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf424e8-8ffb-473b-ad31-70f1bf8f7dac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:21.542669 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 520/1012] 10.222.0.99 () {60 vars in 1144 bytes} [Mon Jul 18 14:05:21 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:05:21.542888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf424e8-8ffb-473b-ad31-70f1bf8f7dac None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:21.542888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 493/1013] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:22.558979 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6616-9f3f-4867-b414-61ba55fa653f None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:22.559493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6616-9f3f-4867-b414-61ba55fa653f None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:22.559493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb6616-9f3f-4867-b414-61ba55fa653f None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:22.560764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 521/1014] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:22.566432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a6d78-c47e-4f36-9712-f5be07bcea3b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:22.566874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a6d78-c47e-4f36-9712-f5be07bcea3b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:22.566965 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a6d78-c47e-4f36-9712-f5be07bcea3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:22.584471 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9b6a6d78-c47e-4f36-9712-f5be07bcea3b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:22.585646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9b6a6d78-c47e-4f36-9712-f5be07bcea3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:22.665341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 494/1015] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:22 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:22.689776 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb6616-9f3f-4867-b414-61ba55fa653f None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:22.772025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:22.807383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb6616-9f3f-4867-b414-61ba55fa653f None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:22.844274 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a754f-f1e7-4364-aaba-cef958620f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:22.845019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a754f-f1e7-4364-aaba-cef958620f91 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:22.845308 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a754f-f1e7-4364-aaba-cef958620f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:22.845633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a754f-f1e7-4364-aaba-cef958620f91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:22.846915 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a754f-f1e7-4364-aaba-cef958620f91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:22.848424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a754f-f1e7-4364-aaba-cef958620f91 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:22.850263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 522/1016] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:22.856106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a6d78-c47e-4f36-9712-f5be07bcea3b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:22.900425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:22.958791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a6d78-c47e-4f36-9712-f5be07bcea3b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:22.993735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb196258-ce18-4346-a32d-b690dd592c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:22.994921 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb196258-ce18-4346-a32d-b690dd592c3f None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:22.995419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb196258-ce18-4346-a32d-b690dd592c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:22.995837 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb196258-ce18-4346-a32d-b690dd592c3f None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:22.996567 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb196258-ce18-4346-a32d-b690dd592c3f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:22.998047 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb196258-ce18-4346-a32d-b690dd592c3f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:23.030069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 495/1017] 10.222.0.99 () {60 vars in 1141 bytes} [Mon Jul 18 14:05:22 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:05:23.523273 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb2ff4-458f-40a5-a730-c65258d6170d None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:23.523582 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb2ff4-458f-40a5-a730-c65258d6170d None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:23.523767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb2ff4-458f-40a5-a730-c65258d6170d None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:23.525312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 523/1018] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:23.530369 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265e11c-661d-46c6-b1d1-55fb30993f44 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:23.530693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265e11c-661d-46c6-b1d1-55fb30993f44 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:23.530971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265e11c-661d-46c6-b1d1-55fb30993f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:23.547672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2265e11c-661d-46c6-b1d1-55fb30993f44 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:23.548856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2265e11c-661d-46c6-b1d1-55fb30993f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:23.619297 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 496/1019] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:23 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:23.641750 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb2ff4-458f-40a5-a730-c65258d6170d None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:23.645637 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a78b93-2572-4034-a6d5-55ce47ee0cfe None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:23.645926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a78b93-2572-4034-a6d5-55ce47ee0cfe None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:23.646179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a78b93-2572-4034-a6d5-55ce47ee0cfe None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:23.647800 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 497/1020] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:05:23.652409 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bcbea-a0f1-49c0-9bb6-e9b9608323e0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:23.652702 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bcbea-a0f1-49c0-9bb6-e9b9608323e0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:23.652983 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bcbea-a0f1-49c0-9bb6-e9b9608323e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:23.670326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9e4bcbea-a0f1-49c0-9bb6-e9b9608323e0 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:23.671546 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9e4bcbea-a0f1-49c0-9bb6-e9b9608323e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:23.691311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:23.751793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 498/1021] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:23 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:05:23.754449 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb2ff4-458f-40a5-a730-c65258d6170d None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:23.774953 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bcbea-a0f1-49c0-9bb6-e9b9608323e0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:23.791229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4039f63-d0d2-42f2-a3a8-b86690da9714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:23.791905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4039f63-d0d2-42f2-a3a8-b86690da9714 None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:23.792194 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4039f63-d0d2-42f2-a3a8-b86690da9714 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:23.792477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4039f63-d0d2-42f2-a3a8-b86690da9714 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:23.793264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4039f63-d0d2-42f2-a3a8-b86690da9714 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:23.794687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4039f63-d0d2-42f2-a3a8-b86690da9714 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:23.803938 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:23.823147 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 524/1022] 10.222.0.99 () {60 vars in 1141 bytes} [Mon Jul 18 14:05:23 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:05:23.899465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bcbea-a0f1-49c0-9bb6-e9b9608323e0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:23.943662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a0728-7206-4a72-9bb5-a3ec02f08571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:23.944545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a0728-7206-4a72-9bb5-a3ec02f08571 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:23.944850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a0728-7206-4a72-9bb5-a3ec02f08571 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:23.945222 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a0728-7206-4a72-9bb5-a3ec02f08571 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:23.956879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a0728-7206-4a72-9bb5-a3ec02f08571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:05:23.965582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f34a0728-7206-4a72-9bb5-a3ec02f08571 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 14:05:23.965582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:23.965582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:23.965582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:23.965582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:23.965582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:23.965582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:23.965582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:23.965582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:23.965582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:23.965582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:23.965582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:23.965582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:05:23.965582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:05:23.965582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:05:23.965582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:05:23.966597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:05:23.966597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:05:23.966597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:05:23.966597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:05:23.966597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:23.966597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:23.966597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:23.966597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:23.966597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:23.966597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:23.966597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:23.966597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:23.966597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:23.966597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:23.966597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:23.966597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:23.967448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:23.967448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:23.967448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:23.967448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:23.967448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:05:23.967448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:05:23.967448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:05:23.967448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:05:23.967448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:05:23.967448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:05:23.967448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 14:05:23.967448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:23.967448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 499/1023] 10.222.0.99 () {56 vars in 1120 bytes} [Mon Jul 18 14:05:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:23.973316 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4039f63-d0d2-42f2-a3a8-b86690da9714 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:24.080927 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4039f63-d0d2-42f2-a3a8-b86690da9714 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:24.117673 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526a597-91ae-4d43-a028-46f9b9f3e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:24.118342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a597-91ae-4d43-a028-46f9b9f3e8ce None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:24.118668 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a597-91ae-4d43-a028-46f9b9f3e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:24.118950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a597-91ae-4d43-a028-46f9b9f3e8ce None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:24.119756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526a597-91ae-4d43-a028-46f9b9f3e8ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:24.120110 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526a597-91ae-4d43-a028-46f9b9f3e8ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:24.123519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526a597-91ae-4d43-a028-46f9b9f3e8ce None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:24.134001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 525/1024] 10.222.0.99 () {56 vars in 1115 bytes} [Mon Jul 18 14:05:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:24.140093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a0728-7206-4a72-9bb5-a3ec02f08571 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:24.153676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:24.249847 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a0728-7206-4a72-9bb5-a3ec02f08571 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:24.284095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e6a0d-16f9-48c4-be52-fd1aacc2d9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:24.284988 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e6a0d-16f9-48c4-be52-fd1aacc2d9ec None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:24.285273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e6a0d-16f9-48c4-be52-fd1aacc2d9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:24.285551 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e6a0d-16f9-48c4-be52-fd1aacc2d9ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:24.297525 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e6a0d-16f9-48c4-be52-fd1aacc2d9ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:24.299161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e6a0d-16f9-48c4-be52-fd1aacc2d9ec None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:24.317530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d99e6a0d-16f9-48c4-be52-fd1aacc2d9ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:24.317530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:24.317530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:24.317530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:24.317530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:24.317530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:24.317530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:24.317530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:24.317530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:24.317530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:24.317530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:24.317530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:24.317530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:24.317530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:24.317530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:24.318469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:24.319373 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:24.319373 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:24.319373 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:24.319373 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:24.319373 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 500/1025] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:24.325913 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526a597-91ae-4d43-a028-46f9b9f3e8ce None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:24.389267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:24.431327 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526a597-91ae-4d43-a028-46f9b9f3e8ce None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:24.466999 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83590ac3-74e7-4fc9-b43b-221bb520eb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:24.467656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83590ac3-74e7-4fc9-b43b-221bb520eb39 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:24.467921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83590ac3-74e7-4fc9-b43b-221bb520eb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:24.468189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83590ac3-74e7-4fc9-b43b-221bb520eb39 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:24.468928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83590ac3-74e7-4fc9-b43b-221bb520eb39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:24.469264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83590ac3-74e7-4fc9-b43b-221bb520eb39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:24.470653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83590ac3-74e7-4fc9-b43b-221bb520eb39 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:24.482966 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 526/1026] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:24.488443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e6a0d-16f9-48c4-be52-fd1aacc2d9ec None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:24.555046 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:24.596917 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e6a0d-16f9-48c4-be52-fd1aacc2d9ec None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:24.635763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d051541-0544-4b22-9070-f4ec5e913385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:24.636555 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d051541-0544-4b22-9070-f4ec5e913385 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:24.636832 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d051541-0544-4b22-9070-f4ec5e913385 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:24.637105 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d051541-0544-4b22-9070-f4ec5e913385 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:24.645040 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d051541-0544-4b22-9070-f4ec5e913385 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:24.646585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d051541-0544-4b22-9070-f4ec5e913385 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:24.660727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-2d051541-0544-4b22-9070-f4ec5e913385 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:05:24.660727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:24.660727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:24.660727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:24.660727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:24.660727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:24.660727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:24.660727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:24.660727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:24.660727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:24.660727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:24.660727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:24.660727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:05:24.660727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:05:24.660727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:05:24.660727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:24.661705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:24.662720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:24.662720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:24.662720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:05:24.662720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:05:24.662720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:05:24.662720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:05:24.662720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:05:24.662720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:05:24.662720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:05:24.662720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:24.662720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 501/1027] 10.222.0.99 () {56 vars in 1093 bytes} [Mon Jul 18 14:05:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:24.669478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83590ac3-74e7-4fc9-b43b-221bb520eb39 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:24.773633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83590ac3-74e7-4fc9-b43b-221bb520eb39 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:24.794057 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:24.809569 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43318924-4907-4fb4-8c7f-03d210d79e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:24.810245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43318924-4907-4fb4-8c7f-03d210d79e98 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:24.810570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43318924-4907-4fb4-8c7f-03d210d79e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:24.810848 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43318924-4907-4fb4-8c7f-03d210d79e98 None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:24.811694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43318924-4907-4fb4-8c7f-03d210d79e98 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:24.812002 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43318924-4907-4fb4-8c7f-03d210d79e98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:24.813493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43318924-4907-4fb4-8c7f-03d210d79e98 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:24.831882 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 527/1028] 10.222.0.99 () {56 vars in 1133 bytes} [Mon Jul 18 14:05:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:24.837455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d051541-0544-4b22-9070-f4ec5e913385 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:24.941985 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d051541-0544-4b22-9070-f4ec5e913385 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:24.970152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:24.982413 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc324891-c6f2-470c-ab4b-fdeb3158959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:24.983079 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324891-c6f2-470c-ab4b-fdeb3158959d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:24.983366 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324891-c6f2-470c-ab4b-fdeb3158959d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:24.983645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324891-c6f2-470c-ab4b-fdeb3158959d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:25.054677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc324891-c6f2-470c-ab4b-fdeb3158959d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:25.056026 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16205690-fbc7-40d4-b1a0-86bec49b845b None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:25.056176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc324891-c6f2-470c-ab4b-fdeb3158959d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:25.056355 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16205690-fbc7-40d4-b1a0-86bec49b845b None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:25.056591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16205690-fbc7-40d4-b1a0-86bec49b845b None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:25.058286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 528/1029] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:25.063231 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384419ee-1c5c-44e3-b22c-85dcbf5dc70a None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:25.063519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384419ee-1c5c-44e3-b22c-85dcbf5dc70a None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:25.063799 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384419ee-1c5c-44e3-b22c-85dcbf5dc70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:25.080805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-384419ee-1c5c-44e3-b22c-85dcbf5dc70a None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:25.082084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-384419ee-1c5c-44e3-b22c-85dcbf5dc70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:25.152440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 529/1030] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:25.175209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 502/1031] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:05:24 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 14:05:25.176530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384419ee-1c5c-44e3-b22c-85dcbf5dc70a None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:25.177843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc324891-c6f2-470c-ab4b-fdeb3158959d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:25.203775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:25.280211 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384419ee-1c5c-44e3-b22c-85dcbf5dc70a None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:25.283629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc324891-c6f2-470c-ab4b-fdeb3158959d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:25.291224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:25.321451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a57e7b-39b4-4df5-8fad-f7bd42c8c207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:25.322249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a57e7b-39b4-4df5-8fad-f7bd42c8c207 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:25.322557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a57e7b-39b4-4df5-8fad-f7bd42c8c207 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:25.322829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a57e7b-39b4-4df5-8fad-f7bd42c8c207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:25.323242 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c109e4-e371-4f0d-a625-c7260bba7465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:25.324275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c109e4-e371-4f0d-a625-c7260bba7465 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:25.324755 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c109e4-e371-4f0d-a625-c7260bba7465 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:25.325236 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c109e4-e371-4f0d-a625-c7260bba7465 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:25.326641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c109e4-e371-4f0d-a625-c7260bba7465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:25.328287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c109e4-e371-4f0d-a625-c7260bba7465 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:25.330634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 503/1032] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:25.337075 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a57e7b-39b4-4df5-8fad-f7bd42c8c207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:25.337234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c109e4-e371-4f0d-a625-c7260bba7465 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:25.338585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a57e7b-39b4-4df5-8fad-f7bd42c8c207 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:25.358114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-85a57e7b-39b4-4df5-8fad-f7bd42c8c207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:25.358114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:25.358114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:25.358114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:25.358114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:25.358114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:25.358114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:25.358114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:25.358114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:25.358114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:25.358114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:25.358114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:25.358114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:25.358114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:25.358114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:25.359079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:25.360053 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:25.360053 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:25.360053 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:25.360053 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:25.364361 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 530/1033] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:25.365191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a57e7b-39b4-4df5-8fad-f7bd42c8c207 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:25.432191 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:25.445145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c109e4-e371-4f0d-a625-c7260bba7465 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:25.468250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a57e7b-39b4-4df5-8fad-f7bd42c8c207 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:25.484101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bf93f-7977-4a87-a532-450b4ae86c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:25.485080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bf93f-7977-4a87-a532-450b4ae86c12 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:25.485534 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bf93f-7977-4a87-a532-450b4ae86c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:25.485962 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bf93f-7977-4a87-a532-450b4ae86c12 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:25.486736 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bf93f-7977-4a87-a532-450b4ae86c12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:25.488173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bf93f-7977-4a87-a532-450b4ae86c12 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:25.505282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58d0f0-2bd1-410f-befd-d8106263aff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:25.506216 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58d0f0-2bd1-410f-befd-d8106263aff4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:25.506543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58d0f0-2bd1-410f-befd-d8106263aff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:25.506827 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58d0f0-2bd1-410f-befd-d8106263aff4 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:25.507562 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58d0f0-2bd1-410f-befd-d8106263aff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:25.507926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58d0f0-2bd1-410f-befd-d8106263aff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:25.509237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58d0f0-2bd1-410f-befd-d8106263aff4 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:25.510508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 504/1034] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:05:25 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:05:25.527170 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 531/1035] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:25.533327 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bf93f-7977-4a87-a532-450b4ae86c12 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:25.650212 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bf93f-7977-4a87-a532-450b4ae86c12 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:25.689952 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bbcb0-7250-4ebe-81c6-1f226b8d029c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:25.691231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bbcb0-7250-4ebe-81c6-1f226b8d029c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:25.691591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bbcb0-7250-4ebe-81c6-1f226b8d029c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:25.691878 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bbcb0-7250-4ebe-81c6-1f226b8d029c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:25.702357 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bbcb0-7250-4ebe-81c6-1f226b8d029c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:25.704016 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bbcb0-7250-4ebe-81c6-1f226b8d029c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:25.719083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-3c6bbcb0-7250-4ebe-81c6-1f226b8d029c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:25.719083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:25.719083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:25.719083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:25.719083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:25.719083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:25.719083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:25.719083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:25.719083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:25.719083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:25.719083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:25.719083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:25.719083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:05:25.719083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:05:25.719083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:25.719980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:25.721550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:05:25.721550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:05:25.721550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:05:25.721550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:05:25.721550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:05:25.721550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:05:25.721550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:25.721550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:25.721550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 505/1036] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:05:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:25.726172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58d0f0-2bd1-410f-befd-d8106263aff4 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:25.755740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:25.835027 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfa97e-a59f-4561-b1b9-cf8b53b9afaa None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:25.835492 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfa97e-a59f-4561-b1b9-cf8b53b9afaa None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:25.835892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfa97e-a59f-4561-b1b9-cf8b53b9afaa None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:25.837564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 506/1037] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:25.838324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58d0f0-2bd1-410f-befd-d8106263aff4 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:25.844773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8527a73-77da-40cc-a3d0-f0f033b5fe09 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:25.845039 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8527a73-77da-40cc-a3d0-f0f033b5fe09 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:25.845349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8527a73-77da-40cc-a3d0-f0f033b5fe09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:25.856447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:25.862758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f8527a73-77da-40cc-a3d0-f0f033b5fe09 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:25.864482 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f8527a73-77da-40cc-a3d0-f0f033b5fe09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:25.879201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbc3aa-33ac-41a9-8482-5ff1a240a3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:25.879865 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbc3aa-33ac-41a9-8482-5ff1a240a3fc None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:25.880147 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbc3aa-33ac-41a9-8482-5ff1a240a3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:25.880424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbc3aa-33ac-41a9-8482-5ff1a240a3fc None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:25.881248 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbc3aa-33ac-41a9-8482-5ff1a240a3fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:25.881555 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbc3aa-33ac-41a9-8482-5ff1a240a3fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:25.883021 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbc3aa-33ac-41a9-8482-5ff1a240a3fc None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:25.900219 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 532/1038] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:05:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:25.901250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbc3aa-33ac-41a9-8482-5ff1a240a3fc None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:25.945831 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 507/1039] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:05:25.968033 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8527a73-77da-40cc-a3d0-f0f033b5fe09 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:25.989024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:26.010679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbc3aa-33ac-41a9-8482-5ff1a240a3fc None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:26.047409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e34f3-1f73-4a85-bd17-674ec53be099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:26.048068 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e34f3-1f73-4a85-bd17-674ec53be099 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:26.048354 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e34f3-1f73-4a85-bd17-674ec53be099 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:26.048632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e34f3-1f73-4a85-bd17-674ec53be099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:26.049466 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e34f3-1f73-4a85-bd17-674ec53be099 None admin] RBAC: Adding query filter params (role.id=6f13a164df4e4b459767a55096a5635b, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=b1b66b55e0374152828913910c4002f4) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:26.049772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e34f3-1f73-4a85-bd17-674ec53be099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:26.051492 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e34f3-1f73-4a85-bd17-674ec53be099 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:26.066420 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 533/1040] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:05:25 2022] GET /identity/v3/role_assignments?user.id=b1b66b55e0374152828913910c4002f4&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=6f13a164df4e4b459767a55096a5635b => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:26.070044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8527a73-77da-40cc-a3d0-f0f033b5fe09 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:26.110913 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fcc90-f849-4184-9da0-c97d2cfa2f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:26.111846 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fcc90-f849-4184-9da0-c97d2cfa2f59 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:26.112193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fcc90-f849-4184-9da0-c97d2cfa2f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:26.112527 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fcc90-f849-4184-9da0-c97d2cfa2f59 None admin] PATH_INFO: `/v3/services/image` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:26.113324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fcc90-f849-4184-9da0-c97d2cfa2f59 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:26.114802 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fcc90-f849-4184-9da0-c97d2cfa2f59 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:26.118507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-5f6fcc90-f849-4184-9da0-c97d2cfa2f59 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:26.129672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:26.131011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:26.131011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:26.131011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:26.131011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:26.131011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:26.131011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:26.131011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:05:26.131011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:05:26.131011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:05:26.131011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:05:26.131011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:26.131011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:26.131011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:26.131011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:26.131011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:26.131011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:26.132051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:26.132051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:26.132051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:26.132051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:26.132051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:26.132051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:26.132051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:26.132051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:26.132051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:26.132051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:26.132051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:05:26.132051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:26.132051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 14:05:26.132051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:26.140224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 508/1041] 10.222.0.99 () {56 vars in 1105 bytes} [Mon Jul 18 14:05:25 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:26.141994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e34f3-1f73-4a85-bd17-674ec53be099 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:26.257508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e34f3-1f73-4a85-bd17-674ec53be099 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:26.291576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200b859-33be-4c5d-a5ce-4cb4e29bd6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:26.292243 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200b859-33be-4c5d-a5ce-4cb4e29bd6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:26.292525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200b859-33be-4c5d-a5ce-4cb4e29bd6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:26.292800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200b859-33be-4c5d-a5ce-4cb4e29bd6f9 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:26.293502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200b859-33be-4c5d-a5ce-4cb4e29bd6f9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:26.293805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200b859-33be-4c5d-a5ce-4cb4e29bd6f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:26.295197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200b859-33be-4c5d-a5ce-4cb4e29bd6f9 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:26.300521 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 534/1042] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:26.306133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fcc90-f849-4184-9da0-c97d2cfa2f59 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:26.412447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fcc90-f849-4184-9da0-c97d2cfa2f59 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:26.445403 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb2c85-e078-4f41-9da5-6607f7708cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:26.446064 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb2c85-e078-4f41-9da5-6607f7708cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:26.446347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb2c85-e078-4f41-9da5-6607f7708cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:26.446779 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb2c85-e078-4f41-9da5-6607f7708cf3 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:26.447500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb2c85-e078-4f41-9da5-6607f7708cf3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:26.447808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb2c85-e078-4f41-9da5-6607f7708cf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:26.449190 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb2c85-e078-4f41-9da5-6607f7708cf3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:26.454460 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 509/1043] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:26.460389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200b859-33be-4c5d-a5ce-4cb4e29bd6f9 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:26.473103 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:26.567598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200b859-33be-4c5d-a5ce-4cb4e29bd6f9 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:26.601917 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e50c29-a820-4722-96bc-145e212902a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:26.602596 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e50c29-a820-4722-96bc-145e212902a0 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:26.602880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e50c29-a820-4722-96bc-145e212902a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:26.603136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e50c29-a820-4722-96bc-145e212902a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:26.603935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e50c29-a820-4722-96bc-145e212902a0 None admin] RBAC: Adding query filter params (interface=public, service_id=ba52610d36ad403ea95c36e4623110d2, region_id=RegionOne) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:26.604242 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e50c29-a820-4722-96bc-145e212902a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:26.605604 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e50c29-a820-4722-96bc-145e212902a0 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:26.610936 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 535/1044] 10.222.0.99 () {56 vars in 1251 bytes} [Mon Jul 18 14:05:26 2022] GET /identity/v3/endpoints?service_id=ba52610d36ad403ea95c36e4623110d2&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:26.616360 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb2c85-e078-4f41-9da5-6607f7708cf3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:26.687362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:26.733039 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb2c85-e078-4f41-9da5-6607f7708cf3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:26.772702 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fc750-c452-4019-846f-2c7992de94cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:26.773511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fc750-c452-4019-846f-2c7992de94cb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:26.773892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fc750-c452-4019-846f-2c7992de94cb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:26.774267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fc750-c452-4019-846f-2c7992de94cb None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:26.775084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fc750-c452-4019-846f-2c7992de94cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:26.776613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fc750-c452-4019-846f-2c7992de94cb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:26.786767 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 510/1045] 10.222.0.99 () {56 vars in 1087 bytes} [Mon Jul 18 14:05:26 2022] GET /identity/v3/services => generated 1957 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:05:27.611685 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4e4ba-0091-42fb-a22b-70d903e486b0 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:27.612237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4e4ba-0091-42fb-a22b-70d903e486b0 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:27.612237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4e4ba-0091-42fb-a22b-70d903e486b0 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:27.614431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 536/1046] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:27.619066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b10e25-1c0a-4de8-a370-28fa90cc6959 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:27.619356 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b10e25-1c0a-4de8-a370-28fa90cc6959 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:27.619629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b10e25-1c0a-4de8-a370-28fa90cc6959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:27.637998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-61b10e25-1c0a-4de8-a370-28fa90cc6959 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:27.639227 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-61b10e25-1c0a-4de8-a370-28fa90cc6959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:27.707369 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 511/1047] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:27.729617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4e4ba-0091-42fb-a22b-70d903e486b0 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:27.810717 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:27.848264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4e4ba-0091-42fb-a22b-70d903e486b0 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:27.884130 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904434ba-a67e-4ea4-9c56-030ffcf69575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:27.885193 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904434ba-a67e-4ea4-9c56-030ffcf69575 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:27.885642 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904434ba-a67e-4ea4-9c56-030ffcf69575 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:27.886060 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904434ba-a67e-4ea4-9c56-030ffcf69575 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:27.898738 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904434ba-a67e-4ea4-9c56-030ffcf69575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:05:27.906748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-904434ba-a67e-4ea4-9c56-030ffcf69575 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:05:27.906748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:27.906748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:27.906748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:27.906748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:27.906748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:27.906748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:27.906748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:27.906748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:27.906748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:27.906748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:27.906748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:27.906748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:05:27.906748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:05:27.906748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:05:27.906748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:05:27.907785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:05:27.907785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:05:27.907785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:05:27.907785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:05:27.907785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:27.907785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:27.907785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:27.907785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:27.907785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:27.907785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:27.907785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:27.907785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:27.907785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:27.907785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:27.907785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:27.907785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:27.908715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:27.908715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:27.908715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:27.908715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:27.908715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:05:27.908715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:05:27.908715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:05:27.908715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:05:27.908715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:05:27.908715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:05:27.908715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:05:27.908715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:27.910544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 537/1048] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:05:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:27.915039 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b10e25-1c0a-4de8-a370-28fa90cc6959 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:27.977025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:28.020222 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b10e25-1c0a-4de8-a370-28fa90cc6959 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:28.054073 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59325e7-ed55-47e8-bd46-e191a4f50fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:28.054778 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59325e7-ed55-47e8-bd46-e191a4f50fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:28.055056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59325e7-ed55-47e8-bd46-e191a4f50fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:28.055325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59325e7-ed55-47e8-bd46-e191a4f50fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:28.056069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59325e7-ed55-47e8-bd46-e191a4f50fa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:28.056367 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59325e7-ed55-47e8-bd46-e191a4f50fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:28.057741 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59325e7-ed55-47e8-bd46-e191a4f50fa0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:28.060575 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac64931-ec25-4eca-8820-ccadd8d80458 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:28.060860 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac64931-ec25-4eca-8820-ccadd8d80458 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:28.061140 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac64931-ec25-4eca-8820-ccadd8d80458 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:28.062702 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 538/1049] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:05:28.066636 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 512/1050] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:05:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:28.067855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af025a-15c8-4ad9-96cc-a45ea7d8f4eb None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:28.068359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af025a-15c8-4ad9-96cc-a45ea7d8f4eb None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:28.068725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af025a-15c8-4ad9-96cc-a45ea7d8f4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:28.071789 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59325e7-ed55-47e8-bd46-e191a4f50fa0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:28.090752 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-04af025a-15c8-4ad9-96cc-a45ea7d8f4eb None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:28.092342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-04af025a-15c8-4ad9-96cc-a45ea7d8f4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:28.173945 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 539/1051] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:28.181090 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59325e7-ed55-47e8-bd46-e191a4f50fa0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:28.195785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af025a-15c8-4ad9-96cc-a45ea7d8f4eb None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:28.202831 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:28.220304 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ac2d3-b9b7-47cc-8b76-6a88c492766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:28.221174 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ac2d3-b9b7-47cc-8b76-6a88c492766b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:28.221474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ac2d3-b9b7-47cc-8b76-6a88c492766b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:28.221739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ac2d3-b9b7-47cc-8b76-6a88c492766b None admin] PATH_INFO: `/v3/users/8620e2af53b846b99c8c0edeb1a80e5d` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:28.237320 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ac2d3-b9b7-47cc-8b76-6a88c492766b None admin] RBAC: Authorizing `identity:get_user(user_id=8620e2af53b846b99c8c0edeb1a80e5d)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:28.238801 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ac2d3-b9b7-47cc-8b76-6a88c492766b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:28.240528 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 513/1052] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:05:28 2022] GET /identity/v3/users/8620e2af53b846b99c8c0edeb1a80e5d => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:28.246443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ac2d3-b9b7-47cc-8b76-6a88c492766b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:28.262448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:28.303143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af025a-15c8-4ad9-96cc-a45ea7d8f4eb None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:28.339400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6fc85-4701-4c11-84c3-d657b1ada903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:28.340254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6fc85-4701-4c11-84c3-d657b1ada903 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:28.340539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6fc85-4701-4c11-84c3-d657b1ada903 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:28.340819 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6fc85-4701-4c11-84c3-d657b1ada903 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:28.353931 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6fc85-4701-4c11-84c3-d657b1ada903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:05:28.359943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ac2d3-b9b7-47cc-8b76-6a88c492766b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:28.362209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-eac6fc85-4701-4c11-84c3-d657b1ada903 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 14:05:28.362209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:28.362209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:28.362209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:28.362209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:28.362209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:28.362209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:28.362209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:28.362209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:28.362209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:28.362209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:28.362209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:28.362209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:05:28.362209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:05:28.362209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:05:28.362209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:05:28.363305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:05:28.363305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:05:28.363305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:05:28.363305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:05:28.363305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:28.363305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:28.363305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:28.363305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:28.363305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:28.363305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:28.363305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:28.363305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:28.363305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:28.363305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:28.363305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:28.363305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:28.364158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:28.364158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:28.364158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:28.364158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:28.364158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:05:28.364158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:05:28.364158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:05:28.364158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:05:28.364158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:05:28.364158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:05:28.364158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 14:05:28.364158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:28.364158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 540/1053] 10.222.0.99 () {56 vars in 1120 bytes} [Mon Jul 18 14:05:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:28.369401 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6fc85-4701-4c11-84c3-d657b1ada903 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:28.400018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd26d1f-855b-4b3d-a77a-37639f54dd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:28.400616 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd26d1f-855b-4b3d-a77a-37639f54dd02 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:28.400903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd26d1f-855b-4b3d-a77a-37639f54dd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:28.401181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd26d1f-855b-4b3d-a77a-37639f54dd02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:28.448434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:28.472027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6fc85-4701-4c11-84c3-d657b1ada903 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:28.478132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd26d1f-855b-4b3d-a77a-37639f54dd02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:28.479653 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd26d1f-855b-4b3d-a77a-37639f54dd02 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:28.495947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:28.512074 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7479f84-6c46-4a43-bcfa-665d7ab4a506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:28.512889 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7479f84-6c46-4a43-bcfa-665d7ab4a506 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:28.513173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7479f84-6c46-4a43-bcfa-665d7ab4a506 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:28.513450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7479f84-6c46-4a43-bcfa-665d7ab4a506 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:28.514225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7479f84-6c46-4a43-bcfa-665d7ab4a506 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:28.514665 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7479f84-6c46-4a43-bcfa-665d7ab4a506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:28.516081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7479f84-6c46-4a43-bcfa-665d7ab4a506 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:28.524490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 541/1054] 10.222.0.99 () {56 vars in 1115 bytes} [Mon Jul 18 14:05:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:28.530441 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7479f84-6c46-4a43-bcfa-665d7ab4a506 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:28.585845 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 514/1055] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:05:28 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 14:05:28.591727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd26d1f-855b-4b3d-a77a-37639f54dd02 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:28.643053 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7479f84-6c46-4a43-bcfa-665d7ab4a506 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:28.674166 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:28.683592 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbaa6d-4109-4095-8d01-e749822953be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:28.684691 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbaa6d-4109-4095-8d01-e749822953be None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:28.685175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbaa6d-4109-4095-8d01-e749822953be None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:28.685653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbaa6d-4109-4095-8d01-e749822953be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:28.696441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd26d1f-855b-4b3d-a77a-37639f54dd02 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:28.697244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbaa6d-4109-4095-8d01-e749822953be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:28.698735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbaa6d-4109-4095-8d01-e749822953be None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:28.716367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-9fbbaa6d-4109-4095-8d01-e749822953be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:28.716367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:28.716367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:28.716367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:28.716367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:28.716367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:28.716367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:28.716367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:28.716367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:28.716367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:28.716367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:28.716367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:28.716367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:28.716367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:28.716367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:28.717478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:28.718817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:28.718817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:28.718817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:28.718817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:28.718817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 542/1056] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:28.723274 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbaa6d-4109-4095-8d01-e749822953be None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:28.740436 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dcfed-6135-4253-9837-f143d8108788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:28.742180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dcfed-6135-4253-9837-f143d8108788 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:28.742180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dcfed-6135-4253-9837-f143d8108788 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:28.742180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dcfed-6135-4253-9837-f143d8108788 None admin] PATH_INFO: `/v3/projects/1e718e00e6f343279d59f6fcc171f0ac` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:28.743072 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dcfed-6135-4253-9837-f143d8108788 None admin] RBAC: Authorizing `identity:get_project(project_id=1e718e00e6f343279d59f6fcc171f0ac)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:28.744572 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dcfed-6135-4253-9837-f143d8108788 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:28.746355 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 515/1057] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:05:28 2022] GET /identity/v3/projects/1e718e00e6f343279d59f6fcc171f0ac => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:28.752734 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dcfed-6135-4253-9837-f143d8108788 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:28.769853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:28.836001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbaa6d-4109-4095-8d01-e749822953be None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:28.854590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dcfed-6135-4253-9837-f143d8108788 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:28.872515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7babc-6a61-4bfe-8381-e8c9f84edf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:28.873180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7babc-6a61-4bfe-8381-e8c9f84edf6e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:28.873470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7babc-6a61-4bfe-8381-e8c9f84edf6e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:28.873769 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7babc-6a61-4bfe-8381-e8c9f84edf6e None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:28.874826 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7babc-6a61-4bfe-8381-e8c9f84edf6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:28.875190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7babc-6a61-4bfe-8381-e8c9f84edf6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:28.876557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa7babc-6a61-4bfe-8381-e8c9f84edf6e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:28.888111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 543/1058] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:28.889420 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa655400-9af1-4110-8a1a-099b51cca1f0 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:28.889678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa655400-9af1-4110-8a1a-099b51cca1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:28.889957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa655400-9af1-4110-8a1a-099b51cca1f0 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:28.891140 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6f34c-2eb4-41c6-860f-d8ae3b86ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:28.891607 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 544/1059] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:28.893724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa655400-9af1-4110-8a1a-099b51cca1f0 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:28.894971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6f34c-2eb4-41c6-860f-d8ae3b86ac51 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:28.895257 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6f34c-2eb4-41c6-860f-d8ae3b86ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:28.895535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6f34c-2eb4-41c6-860f-d8ae3b86ac51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:28.896384 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6f34c-2eb4-41c6-860f-d8ae3b86ac51 None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=1e718e00e6f343279d59f6fcc171f0ac, user.id=8620e2af53b846b99c8c0edeb1a80e5d) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:28.896901 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6f34c-2eb4-41c6-860f-d8ae3b86ac51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:28.898349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6f34c-2eb4-41c6-860f-d8ae3b86ac51 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:28.910749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 516/1060] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:05:28 2022] GET /identity/v3/role_assignments?user.id=8620e2af53b846b99c8c0edeb1a80e5d&scope.project.id=1e718e00e6f343279d59f6fcc171f0ac&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:28.910749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab430938-8915-4db8-944d-d1ef91ddb3f6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:28.910749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab430938-8915-4db8-944d-d1ef91ddb3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:28.910749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab430938-8915-4db8-944d-d1ef91ddb3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:28.923428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ab430938-8915-4db8-944d-d1ef91ddb3f6 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:28.924718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ab430938-8915-4db8-944d-d1ef91ddb3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:28.928419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:29.007033 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 517/1061] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:29.018341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:29.026625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa655400-9af1-4110-8a1a-099b51cca1f0 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:29.029817 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab430938-8915-4db8-944d-d1ef91ddb3f6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:29.064859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb62e27-6405-46e7-8cd8-bb7adc3c3b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:29.065712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb62e27-6405-46e7-8cd8-bb7adc3c3b0c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:29.065990 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb62e27-6405-46e7-8cd8-bb7adc3c3b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:29.066311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb62e27-6405-46e7-8cd8-bb7adc3c3b0c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:29.073976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb62e27-6405-46e7-8cd8-bb7adc3c3b0c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:29.075442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb62e27-6405-46e7-8cd8-bb7adc3c3b0c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:29.089975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-1cb62e27-6405-46e7-8cd8-bb7adc3c3b0c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:05:29.089975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:29.089975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:29.089975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:29.089975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:29.089975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:29.089975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:29.089975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:29.089975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:29.089975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:29.089975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:29.089975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:29.089975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:05:29.089975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:05:29.089975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:05:29.089975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:29.091111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:29.092155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:29.092155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:29.092155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:05:29.092155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:05:29.092155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:05:29.092155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:05:29.092155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:05:29.092155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:05:29.092155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:05:29.092155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:29.092155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 545/1062] 10.222.0.99 () {56 vars in 1093 bytes} [Mon Jul 18 14:05:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:29.096850 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb62e27-6405-46e7-8cd8-bb7adc3c3b0c None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:29.140158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab430938-8915-4db8-944d-d1ef91ddb3f6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:29.180474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6b800-0433-424b-933b-d724dc556568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:29.181193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6b800-0433-424b-933b-d724dc556568 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:29.181480 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6b800-0433-424b-933b-d724dc556568 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:29.181759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6b800-0433-424b-933b-d724dc556568 None admin] PATH_INFO: `/v3/services/image` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:29.182457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6b800-0433-424b-933b-d724dc556568 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:29.183884 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6b800-0433-424b-933b-d724dc556568 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-14c6b800-0433-424b-933b-d724dc556568 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:29.195628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:29.196631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:29.196631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:29.196631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:29.196631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:29.196631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:29.196631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:29.196631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:05:29.196631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:05:29.196631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:05:29.196631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:05:29.196631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:29.196631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:29.196631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:29.196631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:29.196631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:29.196631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:29.197473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:29.197473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:29.197473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:29.197473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:29.197473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:29.197473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:29.197473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:29.197473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:29.197473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:29.197473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:29.197473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:05:29.197473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:05:29.197473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 14:05:29.197473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:29.197473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 518/1063] 10.222.0.99 () {56 vars in 1105 bytes} [Mon Jul 18 14:05:29 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:29.203088 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6b800-0433-424b-933b-d724dc556568 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:29.206864 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:29.210231 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb62e27-6405-46e7-8cd8-bb7adc3c3b0c None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:29.247087 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421afbc-3067-458d-9e35-cfdcf69aae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:29.247791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421afbc-3067-458d-9e35-cfdcf69aae60 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:29.248071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421afbc-3067-458d-9e35-cfdcf69aae60 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:29.248345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421afbc-3067-458d-9e35-cfdcf69aae60 None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:29.249181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421afbc-3067-458d-9e35-cfdcf69aae60 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:29.249802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421afbc-3067-458d-9e35-cfdcf69aae60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:29.251359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421afbc-3067-458d-9e35-cfdcf69aae60 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:29.273714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 546/1064] 10.222.0.99 () {56 vars in 1133 bytes} [Mon Jul 18 14:05:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:29.279198 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421afbc-3067-458d-9e35-cfdcf69aae60 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:29.295525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:29.315709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6b800-0433-424b-933b-d724dc556568 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:29.350455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee61bb-17b1-4d06-9def-3a3a06c75537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:29.351151 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee61bb-17b1-4d06-9def-3a3a06c75537 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:29.351655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee61bb-17b1-4d06-9def-3a3a06c75537 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:29.351809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee61bb-17b1-4d06-9def-3a3a06c75537 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:29.352398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee61bb-17b1-4d06-9def-3a3a06c75537 None admin] RBAC: Adding query filter params (name=image) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:29.352695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee61bb-17b1-4d06-9def-3a3a06c75537 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:29.354126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee61bb-17b1-4d06-9def-3a3a06c75537 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:29.359628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 519/1065] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:29.365340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee61bb-17b1-4d06-9def-3a3a06c75537 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:29.396022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421afbc-3067-458d-9e35-cfdcf69aae60 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:29.433032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe0894-6d39-4a15-82fb-c8de02c5d8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:29.434061 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe0894-6d39-4a15-82fb-c8de02c5d8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:29.434529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe0894-6d39-4a15-82fb-c8de02c5d8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:29.434986 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe0894-6d39-4a15-82fb-c8de02c5d8c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:29.438777 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:29.445733 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe0894-6d39-4a15-82fb-c8de02c5d8c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:29.447211 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe0894-6d39-4a15-82fb-c8de02c5d8c0 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:29.465221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-a4fe0894-6d39-4a15-82fb-c8de02c5d8c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:29.465221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:29.465221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:29.465221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:29.465221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:29.465221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:29.465221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:29.465221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:29.465221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:29.465221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:29.465221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:29.465221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:29.465221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:29.465221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:29.465221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:29.466178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:29.467291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:29.467291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:29.467291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:29.467291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:29.467291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 547/1066] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:29.472942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe0894-6d39-4a15-82fb-c8de02c5d8c0 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:29.477465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee61bb-17b1-4d06-9def-3a3a06c75537 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:29.513138 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebfabd-92b6-4458-940e-7bc40f1ce812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:29.514126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebfabd-92b6-4458-940e-7bc40f1ce812 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:29.514524 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebfabd-92b6-4458-940e-7bc40f1ce812 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:29.514803 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebfabd-92b6-4458-940e-7bc40f1ce812 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:29.515546 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebfabd-92b6-4458-940e-7bc40f1ce812 None admin] RBAC: Adding query filter params (type=image) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:29.515946 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebfabd-92b6-4458-940e-7bc40f1ce812 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:29.517308 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebfabd-92b6-4458-940e-7bc40f1ce812 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:29.523534 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 520/1067] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:29.528060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebfabd-92b6-4458-940e-7bc40f1ce812 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:29.550597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:29.588540 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe0894-6d39-4a15-82fb-c8de02c5d8c0 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:29.627689 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1856e-dea5-452b-98cd-e2175e52b63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:29.628626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1856e-dea5-452b-98cd-e2175e52b63e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:29.628912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1856e-dea5-452b-98cd-e2175e52b63e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:29.629194 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1856e-dea5-452b-98cd-e2175e52b63e None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:29.629833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebfabd-92b6-4458-940e-7bc40f1ce812 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:29.629936 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1856e-dea5-452b-98cd-e2175e52b63e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:29.630365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1856e-dea5-452b-98cd-e2175e52b63e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:29.631774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1856e-dea5-452b-98cd-e2175e52b63e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:29.648142 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 548/1068] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:29.649226 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1856e-dea5-452b-98cd-e2175e52b63e None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:29.667629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:29.672535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f5bab-6059-4ea1-ae5a-70ff9b5eb875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:29.673743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f5bab-6059-4ea1-ae5a-70ff9b5eb875 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:29.674535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f5bab-6059-4ea1-ae5a-70ff9b5eb875 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:29.674816 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f5bab-6059-4ea1-ae5a-70ff9b5eb875 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:29.675675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f5bab-6059-4ea1-ae5a-70ff9b5eb875 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:29.677058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f5bab-6059-4ea1-ae5a-70ff9b5eb875 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:29.702909 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 521/1069] 10.222.0.99 () {60 vars in 1144 bytes} [Mon Jul 18 14:05:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:05:29.759934 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1856e-dea5-452b-98cd-e2175e52b63e None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:29.789351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:29.806510 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fb90a-cf70-476b-80ff-21b5b346e905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:29.807672 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fb90a-cf70-476b-80ff-21b5b346e905 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:29.808126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fb90a-cf70-476b-80ff-21b5b346e905 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:29.808583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fb90a-cf70-476b-80ff-21b5b346e905 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:29.817611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210fb90a-cf70-476b-80ff-21b5b346e905 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:29.820421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210fb90a-cf70-476b-80ff-21b5b346e905 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:29.837113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-210fb90a-cf70-476b-80ff-21b5b346e905 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:29.837113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:29.837113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:29.837113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:29.837113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:29.837113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:29.837113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:29.837113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:29.837113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:29.837113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:29.837113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:29.837113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:29.837113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:05:29.837113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:05:29.837113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:29.838175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:29.839120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:05:29.839120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:05:29.839120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:05:29.839120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:05:29.839120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:05:29.839120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:05:29.839120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:29.839120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:29.844717 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 549/1070] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:05:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:29.845079 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f5bab-6059-4ea1-ae5a-70ff9b5eb875 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:29.950980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f5bab-6059-4ea1-ae5a-70ff9b5eb875 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:29.986210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca2cdf-cdaa-47db-91ee-80edd2e2498f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:29.987094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca2cdf-cdaa-47db-91ee-80edd2e2498f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:29.987094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca2cdf-cdaa-47db-91ee-80edd2e2498f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:29.987351 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca2cdf-cdaa-47db-91ee-80edd2e2498f None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:29.988136 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca2cdf-cdaa-47db-91ee-80edd2e2498f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:29.988440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca2cdf-cdaa-47db-91ee-80edd2e2498f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:29.989872 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca2cdf-cdaa-47db-91ee-80edd2e2498f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:30.002845 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 522/1071] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:05:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:30.008822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fb90a-cf70-476b-80ff-21b5b346e905 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:30.112060 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fb90a-cf70-476b-80ff-21b5b346e905 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:30.152823 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b23fb3-79c7-446c-a238-e66d9d3644ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:30.153726 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b23fb3-79c7-446c-a238-e66d9d3644ad None admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:30.154010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b23fb3-79c7-446c-a238-e66d9d3644ad None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:30.154291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b23fb3-79c7-446c-a238-e66d9d3644ad None admin] PATH_INFO: `/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/b1b66b55e0374152828913910c4002f4/roles/6f13a164df4e4b459767a55096a5635b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:30.156520 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b23fb3-79c7-446c-a238-e66d9d3644ad None admin] RBAC: Authorizing `identity:create_grant(project_id=50b78e16c86b4e6cac3a725f536a8274, user_id=b1b66b55e0374152828913910c4002f4, role_id=6f13a164df4e4b459767a55096a5635b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:30.157958 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b23fb3-79c7-446c-a238-e66d9d3644ad None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:30.171970 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 550/1072] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:05:30 2022] PUT /identity/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/b1b66b55e0374152828913910c4002f4/roles/6f13a164df4e4b459767a55096a5635b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:05:30.939785 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df619a-382d-413b-8f52-92df4f102ef3 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:30.940336 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df619a-382d-413b-8f52-92df4f102ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:30.940336 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df619a-382d-413b-8f52-92df4f102ef3 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:30.941885 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 523/1073] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:30.947103 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51fec3-c0b4-4032-b1fa-3dc8558a8b24 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:30.947516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51fec3-c0b4-4032-b1fa-3dc8558a8b24 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:30.947703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51fec3-c0b4-4032-b1fa-3dc8558a8b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:30.965126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-fb51fec3-c0b4-4032-b1fa-3dc8558a8b24 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:30.966335 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-fb51fec3-c0b4-4032-b1fa-3dc8558a8b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:31.005271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:31.038516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 551/1074] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:31.060766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df619a-382d-413b-8f52-92df4f102ef3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:31.113647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:31.174715 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df619a-382d-413b-8f52-92df4f102ef3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:31.208727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d201-48c6-4a4c-bb00-07533f47ae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:31.209442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d201-48c6-4a4c-bb00-07533f47ae01 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:31.209723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d201-48c6-4a4c-bb00-07533f47ae01 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:31.209998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d201-48c6-4a4c-bb00-07533f47ae01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:31.220360 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3d201-48c6-4a4c-bb00-07533f47ae01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:05:31.228092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a6b3d201-48c6-4a4c-bb00-07533f47ae01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:05:31.228092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:31.228092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:31.228092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:31.228092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:31.228092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:31.228092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:31.228092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:31.228092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:31.228092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:31.228092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:31.228092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:31.228092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:05:31.228092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:05:31.228092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:05:31.228092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:05:31.229058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:05:31.229058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:05:31.229058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:05:31.229058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:05:31.229058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:31.229058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:31.229058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:31.229058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:31.229058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:31.229058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:31.229058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:31.229058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:31.229058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:31.229058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:31.229058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:31.229058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:31.229906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:31.229906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:31.229906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:31.229906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:31.229906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:05:31.229906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:05:31.229906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:05:31.229906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:05:31.229906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:05:31.229906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:05:31.229906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:05:31.229906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:31.234490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 524/1075] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:05:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:31.235499 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51fec3-c0b4-4032-b1fa-3dc8558a8b24 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:31.339480 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51fec3-c0b4-4032-b1fa-3dc8558a8b24 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:31.373745 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a24da-8794-409f-9c25-a98efe411443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:31.374707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a24da-8794-409f-9c25-a98efe411443 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:31.375037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a24da-8794-409f-9c25-a98efe411443 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:31.375333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a24da-8794-409f-9c25-a98efe411443 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:31.376076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a24da-8794-409f-9c25-a98efe411443 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:31.376379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a24da-8794-409f-9c25-a98efe411443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:31.377741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a24da-8794-409f-9c25-a98efe411443 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:31.386519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 552/1076] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:05:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:31.392760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d201-48c6-4a4c-bb00-07533f47ae01 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:31.499248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d201-48c6-4a4c-bb00-07533f47ae01 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:31.508851 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:31.535834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be1ebe-024d-436d-9a10-208d66eeba3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:31.536694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1ebe-024d-436d-9a10-208d66eeba3e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:31.536992 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1ebe-024d-436d-9a10-208d66eeba3e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:31.537270 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be1ebe-024d-436d-9a10-208d66eeba3e None admin] PATH_INFO: `/v3/users/8620e2af53b846b99c8c0edeb1a80e5d` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:31.538510 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be1ebe-024d-436d-9a10-208d66eeba3e None admin] RBAC: Authorizing `identity:get_user(user_id=8620e2af53b846b99c8c0edeb1a80e5d)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:31.539965 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be1ebe-024d-436d-9a10-208d66eeba3e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:31.541768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 525/1077] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:05:31 2022] GET /identity/v3/users/8620e2af53b846b99c8c0edeb1a80e5d => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:31.547498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a24da-8794-409f-9c25-a98efe411443 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:31.583166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:31.653942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a24da-8794-409f-9c25-a98efe411443 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:31.688568 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73726ac9-63bd-4426-b48f-aa40ebc2d4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:31.689419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73726ac9-63bd-4426-b48f-aa40ebc2d4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:31.689715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73726ac9-63bd-4426-b48f-aa40ebc2d4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:31.690070 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73726ac9-63bd-4426-b48f-aa40ebc2d4e4 None admin] PATH_INFO: `/v3/projects/1e718e00e6f343279d59f6fcc171f0ac` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:31.691165 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73726ac9-63bd-4426-b48f-aa40ebc2d4e4 None admin] RBAC: Authorizing `identity:get_project(project_id=1e718e00e6f343279d59f6fcc171f0ac)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:31.692716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73726ac9-63bd-4426-b48f-aa40ebc2d4e4 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:31.698435 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 553/1078] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:05:31 2022] GET /identity/v3/projects/1e718e00e6f343279d59f6fcc171f0ac => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:31.700841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be1ebe-024d-436d-9a10-208d66eeba3e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:31.715886 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a530f-330f-40f3-8af6-2c6fdc38b9de None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:31.716358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a530f-330f-40f3-8af6-2c6fdc38b9de None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:31.716610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a530f-330f-40f3-8af6-2c6fdc38b9de None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:31.718100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 554/1079] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:05:31.723669 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ee1e1-f009-442a-9495-f10a0eda440b None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:31.723955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ee1e1-f009-442a-9495-f10a0eda440b None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:31.724230 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ee1e1-f009-442a-9495-f10a0eda440b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:31.743316 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-052ee1e1-f009-442a-9495-f10a0eda440b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:31.744784 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-052ee1e1-f009-442a-9495-f10a0eda440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:31.813960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be1ebe-024d-436d-9a10-208d66eeba3e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:31.817862 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 555/1080] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:05:31.841159 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ee1e1-f009-442a-9495-f10a0eda440b None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:31.856245 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a374e1-3be4-480e-9e04-054025b6914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:31.857146 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a374e1-3be4-480e-9e04-054025b6914c None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:31.857426 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a374e1-3be4-480e-9e04-054025b6914c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:31.857701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a374e1-3be4-480e-9e04-054025b6914c None admin] PATH_INFO: `/v3/projects/1e718e00e6f343279d59f6fcc171f0ac/users/8620e2af53b846b99c8c0edeb1a80e5d/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:31.859747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a374e1-3be4-480e-9e04-054025b6914c None admin] RBAC: Authorizing `identity:create_grant(project_id=1e718e00e6f343279d59f6fcc171f0ac, user_id=8620e2af53b846b99c8c0edeb1a80e5d, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:31.861203 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a374e1-3be4-480e-9e04-054025b6914c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:31.876506 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:31.876898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 526/1081] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:05:31 2022] PUT /identity/v3/projects/1e718e00e6f343279d59f6fcc171f0ac/users/8620e2af53b846b99c8c0edeb1a80e5d/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:05:31.965054 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ee1e1-f009-442a-9495-f10a0eda440b None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:32.001138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc5973-76f4-4354-b4c3-ffe8e8a9bf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:32.001810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc5973-76f4-4354-b4c3-ffe8e8a9bf7b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:32.002093 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc5973-76f4-4354-b4c3-ffe8e8a9bf7b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:32.002363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc5973-76f4-4354-b4c3-ffe8e8a9bf7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:32.078303 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc5973-76f4-4354-b4c3-ffe8e8a9bf7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:32.079714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc5973-76f4-4354-b4c3-ffe8e8a9bf7b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:32.111276 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:32.178450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026efca-366d-4df2-8e40-eed106b47b3c None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:32.178993 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026efca-366d-4df2-8e40-eed106b47b3c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:32.178993 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026efca-366d-4df2-8e40-eed106b47b3c None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:32.180583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 527/1082] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:05:32.185401 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0138a0-66b2-4358-9d7b-8da05e3c205b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:32.185680 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0138a0-66b2-4358-9d7b-8da05e3c205b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:32.185983 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0138a0-66b2-4358-9d7b-8da05e3c205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:32.193576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 556/1083] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:05:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 14:05:32.199359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc5973-76f4-4354-b4c3-ffe8e8a9bf7b None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:32.203716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2a0138a0-66b2-4358-9d7b-8da05e3c205b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:32.205133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2a0138a0-66b2-4358-9d7b-8da05e3c205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:32.238308 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:32.280157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 528/1084] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:05:32.305214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0138a0-66b2-4358-9d7b-8da05e3c205b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:32.320066 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc5973-76f4-4354-b4c3-ffe8e8a9bf7b None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:32.353244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:32.359625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a712ecd-da61-40b3-b818-1b03f2d5e430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:32.360630 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a712ecd-da61-40b3-b818-1b03f2d5e430 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:32.360947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a712ecd-da61-40b3-b818-1b03f2d5e430 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:32.361375 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a712ecd-da61-40b3-b818-1b03f2d5e430 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:32.371738 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a712ecd-da61-40b3-b818-1b03f2d5e430 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:32.373198 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a712ecd-da61-40b3-b818-1b03f2d5e430 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:32.391641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-8a712ecd-da61-40b3-b818-1b03f2d5e430 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:32.391641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:32.391641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:32.391641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:32.391641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:32.391641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:32.391641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:32.391641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:32.391641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:32.391641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:32.391641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:32.391641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:32.391641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:32.391641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:32.391641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:32.392857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:32.393788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:32.393788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:32.393788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:32.393788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:32.393788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 557/1085] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:32.398674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a712ecd-da61-40b3-b818-1b03f2d5e430 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:32.417956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0138a0-66b2-4358-9d7b-8da05e3c205b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:32.455902 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114345bc-a9da-42ed-ad42-455eeee0e4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:32.456856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114345bc-a9da-42ed-ad42-455eeee0e4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:32.457140 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114345bc-a9da-42ed-ad42-455eeee0e4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:32.457410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114345bc-a9da-42ed-ad42-455eeee0e4d8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:32.468011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114345bc-a9da-42ed-ad42-455eeee0e4d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:05:32.476295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-114345bc-a9da-42ed-ad42-455eeee0e4d8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 14:05:32.476295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:32.476295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:32.476295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:32.476295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:32.476295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:32.476295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:32.476295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:32.476295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:32.476295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:32.476295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:32.476295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:32.476295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:05:32.476295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:05:32.476295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:05:32.476295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:05:32.477254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:05:32.477254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:05:32.477254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:05:32.477254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:05:32.477254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:32.477254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:32.477254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:32.477254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:32.477254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:32.477254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:32.477254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:32.477254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:32.477254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:32.477254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:32.477254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:32.477254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:32.479282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:32.479282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:32.479282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:32.479282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:32.479282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:05:32.479282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:05:32.479282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:05:32.479282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:05:32.479282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:05:32.479282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:05:32.479282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 14:05:32.479282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:32.479282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 529/1086] 10.222.0.99 () {56 vars in 1120 bytes} [Mon Jul 18 14:05:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:32.483518 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114345bc-a9da-42ed-ad42-455eeee0e4d8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:32.509440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a712ecd-da61-40b3-b818-1b03f2d5e430 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:32.513296 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:32.551226 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b5751-8132-4e77-a5ef-8fd4a0287f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:32.551897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b5751-8132-4e77-a5ef-8fd4a0287f7b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:32.552207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b5751-8132-4e77-a5ef-8fd4a0287f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:32.552492 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b5751-8132-4e77-a5ef-8fd4a0287f7b None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:32.553257 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b5751-8132-4e77-a5ef-8fd4a0287f7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:32.553785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b5751-8132-4e77-a5ef-8fd4a0287f7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:32.555299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b5751-8132-4e77-a5ef-8fd4a0287f7b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:32.578433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 558/1087] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:32.602846 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114345bc-a9da-42ed-ad42-455eeee0e4d8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:32.643992 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffaa1dd-9cd6-4fe3-865e-f39d14119f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:32.644679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffaa1dd-9cd6-4fe3-865e-f39d14119f2d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:32.644958 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffaa1dd-9cd6-4fe3-865e-f39d14119f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:32.645232 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffaa1dd-9cd6-4fe3-865e-f39d14119f2d None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:32.646009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffaa1dd-9cd6-4fe3-865e-f39d14119f2d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:32.646317 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffaa1dd-9cd6-4fe3-865e-f39d14119f2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:32.647774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffaa1dd-9cd6-4fe3-865e-f39d14119f2d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:32.662432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 530/1088] 10.222.0.99 () {56 vars in 1115 bytes} [Mon Jul 18 14:05:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:32.663956 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b5751-8132-4e77-a5ef-8fd4a0287f7b None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:32.720044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:32.789499 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b5751-8132-4e77-a5ef-8fd4a0287f7b None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:32.824763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409ba2f-87c7-4c7a-9cf6-4b16bd9a0673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:32.825566 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409ba2f-87c7-4c7a-9cf6-4b16bd9a0673 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:32.825849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409ba2f-87c7-4c7a-9cf6-4b16bd9a0673 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:32.826125 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409ba2f-87c7-4c7a-9cf6-4b16bd9a0673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:32.837446 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409ba2f-87c7-4c7a-9cf6-4b16bd9a0673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:32.838975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409ba2f-87c7-4c7a-9cf6-4b16bd9a0673 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:32.856964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-2409ba2f-87c7-4c7a-9cf6-4b16bd9a0673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:32.856964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:32.856964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:32.856964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:32.856964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:32.856964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:32.856964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:32.856964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:32.856964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:32.856964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:32.856964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:32.856964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:32.856964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:32.856964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:32.856964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:32.857896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:32.858902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:32.858902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:32.858902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:32.858902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:32.858902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 559/1089] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:32.864474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffaa1dd-9cd6-4fe3-865e-f39d14119f2d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:32.951093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:32.964095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffaa1dd-9cd6-4fe3-865e-f39d14119f2d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:32.997303 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f352c8-8829-46b7-ad14-12eade22aee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:32.997984 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f352c8-8829-46b7-ad14-12eade22aee8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:32.998269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f352c8-8829-46b7-ad14-12eade22aee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:32.998577 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f352c8-8829-46b7-ad14-12eade22aee8 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:32.999323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f352c8-8829-46b7-ad14-12eade22aee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:32.999970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f352c8-8829-46b7-ad14-12eade22aee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:33.001437 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f352c8-8829-46b7-ad14-12eade22aee8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:33.014416 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 531/1090] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:33.020194 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409ba2f-87c7-4c7a-9cf6-4b16bd9a0673 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:33.115206 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:33.122345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409ba2f-87c7-4c7a-9cf6-4b16bd9a0673 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:33.159635 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b4944-6269-421e-b16d-4d7fc6f69c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:33.160436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b4944-6269-421e-b16d-4d7fc6f69c6c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:33.160716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b4944-6269-421e-b16d-4d7fc6f69c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:33.160991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b4944-6269-421e-b16d-4d7fc6f69c6c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:33.168517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b4944-6269-421e-b16d-4d7fc6f69c6c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:33.169955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b4944-6269-421e-b16d-4d7fc6f69c6c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:33.183680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-bb9b4944-6269-421e-b16d-4d7fc6f69c6c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:05:33.183680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:33.183680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:33.183680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:33.183680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:33.183680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:33.183680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:33.183680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:33.183680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:33.183680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:33.183680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:33.183680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:33.183680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:05:33.183680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:05:33.183680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:05:33.183680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:33.184610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:33.185538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:33.185538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:33.185538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:05:33.185538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:05:33.185538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:05:33.185538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:05:33.185538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:05:33.185538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:05:33.185538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 14:05:33.185538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:33.189847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 560/1091] 10.222.0.99 () {56 vars in 1093 bytes} [Mon Jul 18 14:05:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:33.190919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f352c8-8829-46b7-ad14-12eade22aee8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:33.291392 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f352c8-8829-46b7-ad14-12eade22aee8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:33.325956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85c8ed-d2a7-4376-b712-922b5dc384b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:33.326659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85c8ed-d2a7-4376-b712-922b5dc384b6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:33.326942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85c8ed-d2a7-4376-b712-922b5dc384b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:33.327214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85c8ed-d2a7-4376-b712-922b5dc384b6 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:33.328170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85c8ed-d2a7-4376-b712-922b5dc384b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:33.328554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85c8ed-d2a7-4376-b712-922b5dc384b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:33.329948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85c8ed-d2a7-4376-b712-922b5dc384b6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:33.347486 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 532/1092] 10.222.0.99 () {56 vars in 1133 bytes} [Mon Jul 18 14:05:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:33.353298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b4944-6269-421e-b16d-4d7fc6f69c6c None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:33.455047 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b4944-6269-421e-b16d-4d7fc6f69c6c None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:33.492973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462e5fb-ada9-4ceb-8dea-a1150a61a842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:33.493625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462e5fb-ada9-4ceb-8dea-a1150a61a842 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:33.493905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462e5fb-ada9-4ceb-8dea-a1150a61a842 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:33.494177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462e5fb-ada9-4ceb-8dea-a1150a61a842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:33.520607 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:33.567321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462e5fb-ada9-4ceb-8dea-a1150a61a842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:33.568682 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462e5fb-ada9-4ceb-8dea-a1150a61a842 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:33.670437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 561/1093] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:05:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 14:05:33.676355 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85c8ed-d2a7-4376-b712-922b5dc384b6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:33.685437 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:33.785222 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85c8ed-d2a7-4376-b712-922b5dc384b6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:33.823702 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc7ccf-8d77-448a-b5b6-eedc90c200b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:33.824627 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc7ccf-8d77-448a-b5b6-eedc90c200b6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:33.824895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc7ccf-8d77-448a-b5b6-eedc90c200b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:33.825173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc7ccf-8d77-448a-b5b6-eedc90c200b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:33.835701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc7ccf-8d77-448a-b5b6-eedc90c200b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:33.837170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc7ccf-8d77-448a-b5b6-eedc90c200b6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:33.855439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b4fc7ccf-8d77-448a-b5b6-eedc90c200b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:33.855439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:33.855439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:33.855439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:33.855439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:33.855439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:33.855439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:33.855439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:33.855439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:33.855439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:33.855439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:33.855439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:33.855439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:05:33.855439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:05:33.855439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:33.856473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:33.857407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:05:33.857407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:05:33.857407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:05:33.857407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:33.857407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 533/1094] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:33.862955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462e5fb-ada9-4ceb-8dea-a1150a61a842 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:33.884177 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d90ce-846c-4de6-a3e1-be7e1a8bcdbb None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:33.884550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d90ce-846c-4de6-a3e1-be7e1a8bcdbb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:33.884855 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d90ce-846c-4de6-a3e1-be7e1a8bcdbb None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:33.888451 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 534/1095] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:33.896340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19834d8e-efd9-4355-95b3-f4b6b386dc81 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:33.896626 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19834d8e-efd9-4355-95b3-f4b6b386dc81 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:33.896901 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19834d8e-efd9-4355-95b3-f4b6b386dc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:33.913570 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-19834d8e-efd9-4355-95b3-f4b6b386dc81 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:33.914787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-19834d8e-efd9-4355-95b3-f4b6b386dc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:33.926881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:33.966726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:33.974502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462e5fb-ada9-4ceb-8dea-a1150a61a842 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:33.982647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 535/1096] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:05:34.006254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19834d8e-efd9-4355-95b3-f4b6b386dc81 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:34.008887 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e5732-4617-489f-ab75-dc7dd7fdf839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:34.009552 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e5732-4617-489f-ab75-dc7dd7fdf839 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:34.009835 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e5732-4617-489f-ab75-dc7dd7fdf839 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:34.010110 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e5732-4617-489f-ab75-dc7dd7fdf839 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:34.010875 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e5732-4617-489f-ab75-dc7dd7fdf839 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:34.011177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e5732-4617-489f-ab75-dc7dd7fdf839 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:34.012543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e5732-4617-489f-ab75-dc7dd7fdf839 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:34.028720 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 562/1097] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:34.029721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e5732-4617-489f-ab75-dc7dd7fdf839 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:34.105215 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19834d8e-efd9-4355-95b3-f4b6b386dc81 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:34.132721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e5732-4617-489f-ab75-dc7dd7fdf839 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:34.142479 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5f30d-5a63-4f73-90c8-d017b483e7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:34.143279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5f30d-5a63-4f73-90c8-d017b483e7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:34.143556 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5f30d-5a63-4f73-90c8-d017b483e7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:34.143823 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5f30d-5a63-4f73-90c8-d017b483e7c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:34.149007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:34.154761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5f30d-5a63-4f73-90c8-d017b483e7c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:05:34.162293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-17a5f30d-5a63-4f73-90c8-d017b483e7c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:05:34.162293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:34.162293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:34.162293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:34.162293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:34.162293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:34.162293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:34.162293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:34.162293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:34.162293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:34.162293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:34.162293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:34.162293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:05:34.162293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:05:34.162293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:05:34.162293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:05:34.163407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:05:34.163407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:05:34.163407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:05:34.163407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:05:34.163407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:34.163407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:34.163407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:34.163407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:34.163407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:34.163407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:34.163407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:34.163407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:34.163407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:34.163407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:34.163407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:34.163407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:34.164279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:34.164279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:34.164279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:34.164279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:34.164279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:05:34.164279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:05:34.164279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:05:34.164279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:05:34.164279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:05:34.164279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:05:34.164279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:05:34.164279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:05:34.164279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 536/1098] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:05:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:05:34.167391 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e718a-f036-4b57-906d-6b17d59504e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:34.168188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e718a-f036-4b57-906d-6b17d59504e6 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:34.168550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e718a-f036-4b57-906d-6b17d59504e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:34.168832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e718a-f036-4b57-906d-6b17d59504e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:34.169391 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5f30d-5a63-4f73-90c8-d017b483e7c7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:34.175935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e718a-f036-4b57-906d-6b17d59504e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:34.177381 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e718a-f036-4b57-906d-6b17d59504e6 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:34.191751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-6c3e718a-f036-4b57-906d-6b17d59504e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:34.191751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:34.191751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:34.191751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:34.191751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:34.191751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:34.191751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:34.191751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:34.191751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:34.191751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:34.191751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:34.191751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:34.191751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:05:34.191751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:05:34.191751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:34.192651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:34.193533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:05:34.193533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:05:34.193533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:05:34.193533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:05:34.193533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:05:34.193533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:05:34.193533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:05:34.193533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:34.193533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 563/1099] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:05:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:34.199503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e718a-f036-4b57-906d-6b17d59504e6 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:34.218542 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:34.278015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5f30d-5a63-4f73-90c8-d017b483e7c7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:34.305363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e718a-f036-4b57-906d-6b17d59504e6 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:34.312229 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f92da-ce4c-46e9-bbe2-dd7990cf01f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:34.312943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f92da-ce4c-46e9-bbe2-dd7990cf01f8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:34.313228 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f92da-ce4c-46e9-bbe2-dd7990cf01f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:34.313506 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f92da-ce4c-46e9-bbe2-dd7990cf01f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:34.314290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f92da-ce4c-46e9-bbe2-dd7990cf01f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:34.314631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f92da-ce4c-46e9-bbe2-dd7990cf01f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:34.316027 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f92da-ce4c-46e9-bbe2-dd7990cf01f8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:34.324699 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 537/1100] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:05:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:34.330750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f92da-ce4c-46e9-bbe2-dd7990cf01f8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:34.340594 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f57a6-1f21-4574-b31b-270486f859db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:34.341230 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f57a6-1f21-4574-b31b-270486f859db None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:34.341549 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f57a6-1f21-4574-b31b-270486f859db None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:34.341815 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f57a6-1f21-4574-b31b-270486f859db None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:34.342663 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f57a6-1f21-4574-b31b-270486f859db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:34.342977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f57a6-1f21-4574-b31b-270486f859db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:34.344487 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f57a6-1f21-4574-b31b-270486f859db None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:34.356158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 564/1101] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:05:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:34.362222 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f57a6-1f21-4574-b31b-270486f859db None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:34.398685 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:34.431262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f92da-ce4c-46e9-bbe2-dd7990cf01f8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:34.441737 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:34.464127 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f57a6-1f21-4574-b31b-270486f859db None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:34.467123 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74b498-f18d-4ccc-b039-e14fa3c11e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:34.468110 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74b498-f18d-4ccc-b039-e14fa3c11e33 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:34.468394 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74b498-f18d-4ccc-b039-e14fa3c11e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:34.468667 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74b498-f18d-4ccc-b039-e14fa3c11e33 None admin] PATH_INFO: `/v3/users/8620e2af53b846b99c8c0edeb1a80e5d` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:34.469950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74b498-f18d-4ccc-b039-e14fa3c11e33 None admin] RBAC: Authorizing `identity:get_user(user_id=8620e2af53b846b99c8c0edeb1a80e5d)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:34.471449 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74b498-f18d-4ccc-b039-e14fa3c11e33 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:34.473089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 538/1102] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:05:34 2022] GET /identity/v3/users/8620e2af53b846b99c8c0edeb1a80e5d => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:34.479029 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74b498-f18d-4ccc-b039-e14fa3c11e33 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:34.497719 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e160962-7426-4071-ae8d-fa286c398fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:34.498342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e160962-7426-4071-ae8d-fa286c398fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:34.498652 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e160962-7426-4071-ae8d-fa286c398fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:34.498925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e160962-7426-4071-ae8d-fa286c398fa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:34.500111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e160962-7426-4071-ae8d-fa286c398fa2 None admin] RBAC: Adding query filter params (role.id=6f13a164df4e4b459767a55096a5635b, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=b1b66b55e0374152828913910c4002f4) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:34.500416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e160962-7426-4071-ae8d-fa286c398fa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:34.501834 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e160962-7426-4071-ae8d-fa286c398fa2 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:34.507791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 565/1103] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:05:34 2022] GET /identity/v3/role_assignments?user.id=b1b66b55e0374152828913910c4002f4&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=6f13a164df4e4b459767a55096a5635b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:05:34.586836 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74b498-f18d-4ccc-b039-e14fa3c11e33 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:34.624876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae60db-e0b1-4011-96cc-2ccb32624c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:34.625540 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae60db-e0b1-4011-96cc-2ccb32624c0e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:34.625830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae60db-e0b1-4011-96cc-2ccb32624c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:34.626107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae60db-e0b1-4011-96cc-2ccb32624c0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:34.676759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:34.703261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae60db-e0b1-4011-96cc-2ccb32624c0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:34.704724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae60db-e0b1-4011-96cc-2ccb32624c0e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:34.806968 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 539/1104] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:05:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 14:05:34.813399 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e160962-7426-4071-ae8d-fa286c398fa2 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:34.911200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:34.914508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e160962-7426-4071-ae8d-fa286c398fa2 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:34.950253 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf11341-fa77-4604-a535-aa6e29b945b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:34.951158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf11341-fa77-4604-a535-aa6e29b945b5 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:34.951451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf11341-fa77-4604-a535-aa6e29b945b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:34.951731 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf11341-fa77-4604-a535-aa6e29b945b5 None admin] PATH_INFO: `/v3/projects/1e718e00e6f343279d59f6fcc171f0ac` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:34.952919 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf11341-fa77-4604-a535-aa6e29b945b5 None admin] RBAC: Authorizing `identity:get_project(project_id=1e718e00e6f343279d59f6fcc171f0ac)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:34.954420 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf11341-fa77-4604-a535-aa6e29b945b5 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:34.956333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 566/1105] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:05:34 2022] GET /identity/v3/projects/1e718e00e6f343279d59f6fcc171f0ac => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:34.962562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae60db-e0b1-4011-96cc-2ccb32624c0e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:35.039752 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:35.063562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae60db-e0b1-4011-96cc-2ccb32624c0e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:35.099637 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d81f7c-a508-49a6-87a1-ed166a6aaa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:35.100291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d81f7c-a508-49a6-87a1-ed166a6aaa80 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:35.100572 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d81f7c-a508-49a6-87a1-ed166a6aaa80 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:35.100842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d81f7c-a508-49a6-87a1-ed166a6aaa80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:35.101672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d81f7c-a508-49a6-87a1-ed166a6aaa80 None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=1e718e00e6f343279d59f6fcc171f0ac, user.id=8620e2af53b846b99c8c0edeb1a80e5d) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:35.101983 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d81f7c-a508-49a6-87a1-ed166a6aaa80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:35.103456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d81f7c-a508-49a6-87a1-ed166a6aaa80 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:35.109992 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 540/1106] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:05:34 2022] GET /identity/v3/role_assignments?user.id=8620e2af53b846b99c8c0edeb1a80e5d&scope.project.id=1e718e00e6f343279d59f6fcc171f0ac&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:37.115298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea20c7-c63d-4206-b3d3-854379a27b50 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:37.115852 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea20c7-c63d-4206-b3d3-854379a27b50 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:37.115852 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea20c7-c63d-4206-b3d3-854379a27b50 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:37.117989 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 567/1107] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:37.126912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a87b0-940d-4335-ba22-6c60142190ab None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:37.127321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a87b0-940d-4335-ba22-6c60142190ab None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:37.127473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a87b0-940d-4335-ba22-6c60142190ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:37.152979 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-923a87b0-940d-4335-ba22-6c60142190ab None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:37.154179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-923a87b0-940d-4335-ba22-6c60142190ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:37.224766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 541/1108] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:37.249682 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea20c7-c63d-4206-b3d3-854379a27b50 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:37.371674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea20c7-c63d-4206-b3d3-854379a27b50 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:37.408509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e57fdc-68e5-434c-994b-e981c99e66ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:37.409303 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e57fdc-68e5-434c-994b-e981c99e66ff None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:37.409585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e57fdc-68e5-434c-994b-e981c99e66ff None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:37.409860 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e57fdc-68e5-434c-994b-e981c99e66ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:37.411025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e57fdc-68e5-434c-994b-e981c99e66ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:37.412468 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e57fdc-68e5-434c-994b-e981c99e66ff None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:37.414118 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 568/1109] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:37.422706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a87b0-940d-4335-ba22-6c60142190ab None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:37.494374 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:37.526171 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a87b0-940d-4335-ba22-6c60142190ab None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:37.563587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd0e00-3660-4cc7-89e4-5e36a87a9d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:37.564307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd0e00-3660-4cc7-89e4-5e36a87a9d70 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:37.564307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd0e00-3660-4cc7-89e4-5e36a87a9d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:37.564779 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd0e00-3660-4cc7-89e4-5e36a87a9d70 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:37.565486 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd0e00-3660-4cc7-89e4-5e36a87a9d70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:37.566956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd0e00-3660-4cc7-89e4-5e36a87a9d70 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:37.587669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 542/1110] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:05:37 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:05:39.641425 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99142914-163e-4d9d-ab96-45f1d2d45287 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:39.642323 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99142914-163e-4d9d-ab96-45f1d2d45287 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:39.642323 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99142914-163e-4d9d-ab96-45f1d2d45287 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:39.644669 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 569/1111] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:39.651145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1527f-23c7-4954-ac7d-26bef1152190 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:39.651866 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1527f-23c7-4954-ac7d-26bef1152190 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:39.652017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1527f-23c7-4954-ac7d-26bef1152190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:39.676867 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-23f1527f-23c7-4954-ac7d-26bef1152190 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:39.678049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-23f1527f-23c7-4954-ac7d-26bef1152190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:39.754120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 543/1112] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:39.777301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99142914-163e-4d9d-ab96-45f1d2d45287 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:39.820074 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:39.890272 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99142914-163e-4d9d-ab96-45f1d2d45287 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:39.927867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654d434-6291-46f5-aa6f-0cf66d576955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:39.928645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654d434-6291-46f5-aa6f-0cf66d576955 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:39.928927 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654d434-6291-46f5-aa6f-0cf66d576955 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:39.929519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654d434-6291-46f5-aa6f-0cf66d576955 None admin] PATH_INFO: `/v3/roles/2e761f6eaaa94f9e85d77734e01ac393` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:39.931126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654d434-6291-46f5-aa6f-0cf66d576955 None admin] RBAC: Authorizing `identity:get_role(role_id=2e761f6eaaa94f9e85d77734e01ac393)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:39.932499 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654d434-6291-46f5-aa6f-0cf66d576955 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:39.933876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 570/1113] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:05:39 2022] GET /identity/v3/roles/2e761f6eaaa94f9e85d77734e01ac393 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:39.941527 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1527f-23c7-4954-ac7d-26bef1152190 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:40.003819 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:40.050936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1527f-23c7-4954-ac7d-26bef1152190 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:40.086779 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1810008-a341-4ffe-96c9-34c0ed3c03ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:40.087652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1810008-a341-4ffe-96c9-34c0ed3c03ad None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:40.087930 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1810008-a341-4ffe-96c9-34c0ed3c03ad None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:40.088205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1810008-a341-4ffe-96c9-34c0ed3c03ad None admin] PATH_INFO: `/v3/users/b16df3d018a74e93b603a78a83cc8b0e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:40.103210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1810008-a341-4ffe-96c9-34c0ed3c03ad None admin] RBAC: Authorizing `identity:get_user(user_id=b16df3d018a74e93b603a78a83cc8b0e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:40.104675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1810008-a341-4ffe-96c9-34c0ed3c03ad None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:40.106330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 544/1114] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:05:39 2022] GET /identity/v3/users/b16df3d018a74e93b603a78a83cc8b0e => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:40.115394 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654d434-6291-46f5-aa6f-0cf66d576955 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:40.222487 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654d434-6291-46f5-aa6f-0cf66d576955 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:40.224777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:40.263927 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca54e7e-e942-45c1-a4ce-56eee50b10ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:40.264568 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca54e7e-e942-45c1-a4ce-56eee50b10ab None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:40.264853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca54e7e-e942-45c1-a4ce-56eee50b10ab None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:40.265128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca54e7e-e942-45c1-a4ce-56eee50b10ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:40.340039 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca54e7e-e942-45c1-a4ce-56eee50b10ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:40.341483 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca54e7e-e942-45c1-a4ce-56eee50b10ab None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:40.443125 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 571/1115] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:05:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 14:05:40.452008 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1810008-a341-4ffe-96c9-34c0ed3c03ad None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:40.558822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1810008-a341-4ffe-96c9-34c0ed3c03ad None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:40.574833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:40.593374 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536755b-af2b-4f4d-a024-15047c30fcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:40.594280 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536755b-af2b-4f4d-a024-15047c30fcfa None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:40.594593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536755b-af2b-4f4d-a024-15047c30fcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:40.594867 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536755b-af2b-4f4d-a024-15047c30fcfa None admin] PATH_INFO: `/v3/projects/1e718e00e6f343279d59f6fcc171f0ac` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:40.596086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536755b-af2b-4f4d-a024-15047c30fcfa None admin] RBAC: Authorizing `identity:get_project(project_id=1e718e00e6f343279d59f6fcc171f0ac)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:40.597559 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536755b-af2b-4f4d-a024-15047c30fcfa None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:40.599349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 545/1116] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:05:40 2022] GET /identity/v3/projects/1e718e00e6f343279d59f6fcc171f0ac => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:40.609124 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca54e7e-e942-45c1-a4ce-56eee50b10ab None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:40.613043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:40.718210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca54e7e-e942-45c1-a4ce-56eee50b10ab None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:40.756700 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503d0d4-e632-446c-a8e6-a96f7f1f055e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:40.757348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503d0d4-e632-446c-a8e6-a96f7f1f055e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:40.757634 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503d0d4-e632-446c-a8e6-a96f7f1f055e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:40.757913 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503d0d4-e632-446c-a8e6-a96f7f1f055e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:40.758785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503d0d4-e632-446c-a8e6-a96f7f1f055e None admin] RBAC: Adding query filter params (role.id=2e761f6eaaa94f9e85d77734e01ac393, scope.project.id=1e718e00e6f343279d59f6fcc171f0ac, user.id=b16df3d018a74e93b603a78a83cc8b0e) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:40.759104 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503d0d4-e632-446c-a8e6-a96f7f1f055e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:40.760541 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503d0d4-e632-446c-a8e6-a96f7f1f055e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:40.766259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 572/1117] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:05:40 2022] GET /identity/v3/role_assignments?user.id=b16df3d018a74e93b603a78a83cc8b0e&scope.project.id=1e718e00e6f343279d59f6fcc171f0ac&role.id=2e761f6eaaa94f9e85d77734e01ac393 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:42.718132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66ad94-9909-49cc-8851-f646a92180bd None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:42.718807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66ad94-9909-49cc-8851-f646a92180bd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:42.718807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66ad94-9909-49cc-8851-f646a92180bd None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:42.720126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 546/1118] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:42.726356 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10a87-c062-4150-85c7-f4390e66a3e3 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:42.726836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10a87-c062-4150-85c7-f4390e66a3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:42.726967 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10a87-c062-4150-85c7-f4390e66a3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:42.758364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-06e10a87-c062-4150-85c7-f4390e66a3e3 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:42.759618 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-06e10a87-c062-4150-85c7-f4390e66a3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:42.833316 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:42.841279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 573/1119] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:42.864380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66ad94-9909-49cc-8851-f646a92180bd None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:42.977199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66ad94-9909-49cc-8851-f646a92180bd None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:43.020514 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b842080-95fe-40b7-aacb-7b30a988ee17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:43.021758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b842080-95fe-40b7-aacb-7b30a988ee17 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:43.022103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b842080-95fe-40b7-aacb-7b30a988ee17 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:43.022461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b842080-95fe-40b7-aacb-7b30a988ee17 None admin] PATH_INFO: `/v3/roles/2e761f6eaaa94f9e85d77734e01ac393` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:43.024929 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b842080-95fe-40b7-aacb-7b30a988ee17 None admin] RBAC: Authorizing `identity:get_role(role_id=2e761f6eaaa94f9e85d77734e01ac393)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:43.027142 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b842080-95fe-40b7-aacb-7b30a988ee17 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:43.029302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 547/1120] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:05:42 2022] GET /identity/v3/roles/2e761f6eaaa94f9e85d77734e01ac393 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:43.035445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e10a87-c062-4150-85c7-f4390e66a3e3 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:43.152223 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e10a87-c062-4150-85c7-f4390e66a3e3 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:43.190708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41c8a6-83f8-4137-8230-a595adedf095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:43.191584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41c8a6-83f8-4137-8230-a595adedf095 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:43.191866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41c8a6-83f8-4137-8230-a595adedf095 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:43.192141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41c8a6-83f8-4137-8230-a595adedf095 None admin] PATH_INFO: `/v3/users/b16df3d018a74e93b603a78a83cc8b0e` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:43.193551 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41c8a6-83f8-4137-8230-a595adedf095 None admin] RBAC: Authorizing `identity:get_user(user_id=b16df3d018a74e93b603a78a83cc8b0e)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:43.195041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41c8a6-83f8-4137-8230-a595adedf095 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:43.196713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 574/1121] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:05:43 2022] GET /identity/v3/users/b16df3d018a74e93b603a78a83cc8b0e => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:43.203489 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b842080-95fe-40b7-aacb-7b30a988ee17 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:43.266609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:43.318778 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b842080-95fe-40b7-aacb-7b30a988ee17 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:43.354097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8cfa6-e822-4a6b-981b-7563e5b72891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:43.354974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8cfa6-e822-4a6b-981b-7563e5b72891 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:43.355254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8cfa6-e822-4a6b-981b-7563e5b72891 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:43.355529 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8cfa6-e822-4a6b-981b-7563e5b72891 None admin] PATH_INFO: `/v3/projects/1e718e00e6f343279d59f6fcc171f0ac` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:43.356840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8cfa6-e822-4a6b-981b-7563e5b72891 None admin] RBAC: Authorizing `identity:get_project(project_id=1e718e00e6f343279d59f6fcc171f0ac)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:43.358373 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8cfa6-e822-4a6b-981b-7563e5b72891 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:43.360131 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 548/1122] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:05:43 2022] GET /identity/v3/projects/1e718e00e6f343279d59f6fcc171f0ac => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:43.366313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41c8a6-83f8-4137-8230-a595adedf095 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:43.440264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:43.485218 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41c8a6-83f8-4137-8230-a595adedf095 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:43.524159 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec2d79-9200-43f5-8c46-ea614db86541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:43.524959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec2d79-9200-43f5-8c46-ea614db86541 None admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:43.525232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec2d79-9200-43f5-8c46-ea614db86541 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:43.525501 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec2d79-9200-43f5-8c46-ea614db86541 None admin] PATH_INFO: `/v3/projects/1e718e00e6f343279d59f6fcc171f0ac/users/b16df3d018a74e93b603a78a83cc8b0e/roles/2e761f6eaaa94f9e85d77734e01ac393` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:43.528122 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec2d79-9200-43f5-8c46-ea614db86541 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e718e00e6f343279d59f6fcc171f0ac, user_id=b16df3d018a74e93b603a78a83cc8b0e, role_id=2e761f6eaaa94f9e85d77734e01ac393)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:43.529578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec2d79-9200-43f5-8c46-ea614db86541 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:43.545783 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 575/1123] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:05:43 2022] PUT /identity/v3/projects/1e718e00e6f343279d59f6fcc171f0ac/users/b16df3d018a74e93b603a78a83cc8b0e/roles/2e761f6eaaa94f9e85d77734e01ac393 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:05:45.526068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6561744-e46a-497b-8b5d-03c935d2a66b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:45.526973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6561744-e46a-497b-8b5d-03c935d2a66b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:45.526973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6561744-e46a-497b-8b5d-03c935d2a66b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:45.529088 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 549/1124] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:45.535434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac33bcd-3609-4563-8df3-af4fb5d4c208 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:45.536155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac33bcd-3609-4563-8df3-af4fb5d4c208 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:45.536313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac33bcd-3609-4563-8df3-af4fb5d4c208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:45.557349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-dac33bcd-3609-4563-8df3-af4fb5d4c208 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:45.558585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-dac33bcd-3609-4563-8df3-af4fb5d4c208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:45.631493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 576/1125] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:45.655026 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6561744-e46a-497b-8b5d-03c935d2a66b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:45.757654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6561744-e46a-497b-8b5d-03c935d2a66b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:45.780464 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:45.796827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a3c26-a5df-4307-9ac5-a14a7fc97d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:45.797663 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a3c26-a5df-4307-9ac5-a14a7fc97d44 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:45.797943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a3c26-a5df-4307-9ac5-a14a7fc97d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:45.798211 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a3c26-a5df-4307-9ac5-a14a7fc97d44 None admin] PATH_INFO: `/v3/roles/2e761f6eaaa94f9e85d77734e01ac393` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:45.799752 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a3c26-a5df-4307-9ac5-a14a7fc97d44 None admin] RBAC: Authorizing `identity:get_role(role_id=2e761f6eaaa94f9e85d77734e01ac393)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:45.801123 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a3c26-a5df-4307-9ac5-a14a7fc97d44 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:45.802527 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 550/1126] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:05:45 2022] GET /identity/v3/roles/2e761f6eaaa94f9e85d77734e01ac393 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:45.808734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac33bcd-3609-4563-8df3-af4fb5d4c208 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:45.869556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:45.931183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac33bcd-3609-4563-8df3-af4fb5d4c208 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:45.969437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb87fb-6282-4191-be1d-32705c542f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:45.970270 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb87fb-6282-4191-be1d-32705c542f99 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:45.970606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb87fb-6282-4191-be1d-32705c542f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:45.970882 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb87fb-6282-4191-be1d-32705c542f99 None admin] PATH_INFO: `/v3/users/b16df3d018a74e93b603a78a83cc8b0e` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:45.972142 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb87fb-6282-4191-be1d-32705c542f99 None admin] RBAC: Authorizing `identity:get_user(user_id=b16df3d018a74e93b603a78a83cc8b0e)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:45.973587 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb87fb-6282-4191-be1d-32705c542f99 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:45.975259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 577/1127] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:05:45 2022] GET /identity/v3/users/b16df3d018a74e93b603a78a83cc8b0e => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:45.984535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a3c26-a5df-4307-9ac5-a14a7fc97d44 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:46.104941 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a3c26-a5df-4307-9ac5-a14a7fc97d44 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:46.141657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df209da5-5177-4baf-b525-dd42b44d4572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:46.142321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df209da5-5177-4baf-b525-dd42b44d4572 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:46.142636 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df209da5-5177-4baf-b525-dd42b44d4572 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:46.142913 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df209da5-5177-4baf-b525-dd42b44d4572 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:46.198710 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:46.213899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df209da5-5177-4baf-b525-dd42b44d4572 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:46.215406 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df209da5-5177-4baf-b525-dd42b44d4572 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:46.328402 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 551/1128] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:05:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 14:05:46.334797 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb87fb-6282-4191-be1d-32705c542f99 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:46.441676 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb87fb-6282-4191-be1d-32705c542f99 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:46.468297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:46.482686 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4fe4f-3a31-40b0-b84f-fee7072a9c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:46.483549 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4fe4f-3a31-40b0-b84f-fee7072a9c3b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:46.483831 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4fe4f-3a31-40b0-b84f-fee7072a9c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:46.484163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4fe4f-3a31-40b0-b84f-fee7072a9c3b None admin] PATH_INFO: `/v3/projects/1e718e00e6f343279d59f6fcc171f0ac` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:46.485394 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4fe4f-3a31-40b0-b84f-fee7072a9c3b None admin] RBAC: Authorizing `identity:get_project(project_id=1e718e00e6f343279d59f6fcc171f0ac)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:46.488698 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4fe4f-3a31-40b0-b84f-fee7072a9c3b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:46.490553 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 578/1129] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:05:46 2022] GET /identity/v3/projects/1e718e00e6f343279d59f6fcc171f0ac => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:46.497078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df209da5-5177-4baf-b525-dd42b44d4572 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:46.595286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:46.608809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df209da5-5177-4baf-b525-dd42b44d4572 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:46.643757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bce1b1-8f3f-4019-86c0-075326e03145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:46.644393 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bce1b1-8f3f-4019-86c0-075326e03145 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:46.644672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bce1b1-8f3f-4019-86c0-075326e03145 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:46.644947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bce1b1-8f3f-4019-86c0-075326e03145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:46.645783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bce1b1-8f3f-4019-86c0-075326e03145 None admin] RBAC: Adding query filter params (role.id=2e761f6eaaa94f9e85d77734e01ac393, scope.project.id=1e718e00e6f343279d59f6fcc171f0ac, user.id=b16df3d018a74e93b603a78a83cc8b0e) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:46.646091 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bce1b1-8f3f-4019-86c0-075326e03145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:46.647551 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bce1b1-8f3f-4019-86c0-075326e03145 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:46.654022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 552/1130] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:05:46 2022] GET /identity/v3/role_assignments?user.id=b16df3d018a74e93b603a78a83cc8b0e&scope.project.id=1e718e00e6f343279d59f6fcc171f0ac&role.id=2e761f6eaaa94f9e85d77734e01ac393 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:48.679806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0219e-65b3-48d8-84ac-9d47a335ebf4 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:48.680391 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0219e-65b3-48d8-84ac-9d47a335ebf4 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:48.680391 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0219e-65b3-48d8-84ac-9d47a335ebf4 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:48.681741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 579/1131] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:48.688348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deca7f1-0459-4e4d-96d7-b579006638bc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:48.689028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deca7f1-0459-4e4d-96d7-b579006638bc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:48.689193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deca7f1-0459-4e4d-96d7-b579006638bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:48.712380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4deca7f1-0459-4e4d-96d7-b579006638bc None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:48.713579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4deca7f1-0459-4e4d-96d7-b579006638bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:48.784099 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 553/1132] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:48.807832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0219e-65b3-48d8-84ac-9d47a335ebf4 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:48.936380 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0219e-65b3-48d8-84ac-9d47a335ebf4 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:48.974916 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065dda8b-3635-4ff6-ba4b-80e8675d73b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:48.975710 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dda8b-3635-4ff6-ba4b-80e8675d73b5 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:48.975990 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dda8b-3635-4ff6-ba4b-80e8675d73b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:48.976265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dda8b-3635-4ff6-ba4b-80e8675d73b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:48.977569 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065dda8b-3635-4ff6-ba4b-80e8675d73b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:48.979058 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065dda8b-3635-4ff6-ba4b-80e8675d73b5 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:48.980718 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 580/1133] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:48.987215 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deca7f1-0459-4e4d-96d7-b579006638bc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:49.070915 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:49.089363 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deca7f1-0459-4e4d-96d7-b579006638bc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:49.122988 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62709a2-279f-41c5-a2af-52793a493d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:49.123648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62709a2-279f-41c5-a2af-52793a493d1a None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:49.123927 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62709a2-279f-41c5-a2af-52793a493d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:49.124200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62709a2-279f-41c5-a2af-52793a493d1a None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:49.125278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62709a2-279f-41c5-a2af-52793a493d1a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:49.126751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62709a2-279f-41c5-a2af-52793a493d1a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:49.153360 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 554/1134] 10.222.0.99 () {60 vars in 1141 bytes} [Mon Jul 18 14:05:48 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:05:51.189361 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffa4e5-ae49-49be-8fd9-7eb1a09b8f53 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:51.190110 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffa4e5-ae49-49be-8fd9-7eb1a09b8f53 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:51.190110 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffa4e5-ae49-49be-8fd9-7eb1a09b8f53 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:51.192314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 581/1135] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:51.198669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cbd98-9949-4641-b91c-0878f2a4cb55 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:51.199403 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cbd98-9949-4641-b91c-0878f2a4cb55 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:51.199547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cbd98-9949-4641-b91c-0878f2a4cb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:51.224931 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-de0cbd98-9949-4641-b91c-0878f2a4cb55 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:51.226120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-de0cbd98-9949-4641-b91c-0878f2a4cb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:51.297586 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 555/1136] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:51.327806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffa4e5-ae49-49be-8fd9-7eb1a09b8f53 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:51.398650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:51.441649 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffa4e5-ae49-49be-8fd9-7eb1a09b8f53 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:51.480439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d370af-d6b4-4993-be49-23abd99b576e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:51.481220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d370af-d6b4-4993-be49-23abd99b576e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:51.481500 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d370af-d6b4-4993-be49-23abd99b576e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:51.481778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d370af-d6b4-4993-be49-23abd99b576e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:51.483062 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d370af-d6b4-4993-be49-23abd99b576e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:51.484562 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d370af-d6b4-4993-be49-23abd99b576e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:51.486328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 582/1137] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:05:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:51.493133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cbd98-9949-4641-b91c-0878f2a4cb55 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:51.572336 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:51.615425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cbd98-9949-4641-b91c-0878f2a4cb55 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:51.655783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f9334-cfc0-4917-8c18-47662069f2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:51.656324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f9334-cfc0-4917-8c18-47662069f2c5 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:51.656603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f9334-cfc0-4917-8c18-47662069f2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:51.656877 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f9334-cfc0-4917-8c18-47662069f2c5 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:51.657579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f9334-cfc0-4917-8c18-47662069f2c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:51.659064 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f9334-cfc0-4917-8c18-47662069f2c5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:51.683753 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 556/1138] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:05:51 2022] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:05:53.696206 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd326f-b82b-4256-8dfe-6048be94a710 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:53.696802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd326f-b82b-4256-8dfe-6048be94a710 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:53.696802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd326f-b82b-4256-8dfe-6048be94a710 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:53.698859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 583/1139] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:53.706730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04540f-04f2-4b5f-a7f4-4dbd70945b72 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:53.707139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04540f-04f2-4b5f-a7f4-4dbd70945b72 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:53.707309 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04540f-04f2-4b5f-a7f4-4dbd70945b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:53.734634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0b04540f-04f2-4b5f-a7f4-4dbd70945b72 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:53.735830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0b04540f-04f2-4b5f-a7f4-4dbd70945b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:53.805982 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 557/1140] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:53.831622 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd326f-b82b-4256-8dfe-6048be94a710 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:53.941707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd326f-b82b-4256-8dfe-6048be94a710 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:53.968441 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:53.977228 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece0eb8-52af-4b93-b0a7-3b01b36ea914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:53.978010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece0eb8-52af-4b93-b0a7-3b01b36ea914 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:53.978288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece0eb8-52af-4b93-b0a7-3b01b36ea914 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:53.978577 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece0eb8-52af-4b93-b0a7-3b01b36ea914 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:53.989226 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece0eb8-52af-4b93-b0a7-3b01b36ea914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:05:53.996661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-2ece0eb8-52af-4b93-b0a7-3b01b36ea914 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:05:53.996661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:53.996661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:53.996661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:53.996661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:53.996661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:53.996661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:53.996661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:53.996661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:53.996661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:53.996661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:53.996661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:53.996661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:05:53.996661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:05:53.996661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:05:53.996661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:05:53.997832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:05:53.997832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:05:53.997832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:05:53.997832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:05:53.997832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:53.997832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:53.997832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:53.997832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:53.997832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:53.997832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:53.997832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:53.997832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:53.997832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:53.997832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:53.997832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:53.997832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:53.999217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:53.999217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:53.999217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:53.999217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:53.999217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:05:53.999217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:05:53.999217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:05:53.999217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:05:53.999217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:05:53.999217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:05:53.999217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:05:53.999217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:53.999217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 584/1141] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:05:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:54.004565 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04540f-04f2-4b5f-a7f4-4dbd70945b72 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:54.056528 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:54.107985 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04540f-04f2-4b5f-a7f4-4dbd70945b72 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:54.156502 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f6de8-08a7-4612-9e7f-f065ef75bb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:54.157197 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f6de8-08a7-4612-9e7f-f065ef75bb8f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:54.157573 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f6de8-08a7-4612-9e7f-f065ef75bb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:54.157863 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f6de8-08a7-4612-9e7f-f065ef75bb8f None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:54.158671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f6de8-08a7-4612-9e7f-f065ef75bb8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:54.159002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f6de8-08a7-4612-9e7f-f065ef75bb8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:54.160440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f6de8-08a7-4612-9e7f-f065ef75bb8f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:54.169174 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 558/1142] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:05:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:54.175835 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece0eb8-52af-4b93-b0a7-3b01b36ea914 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:54.290428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece0eb8-52af-4b93-b0a7-3b01b36ea914 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:54.324610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89afba-d77b-4932-a99a-7ab892997715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:54.325477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89afba-d77b-4932-a99a-7ab892997715 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:54.325854 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89afba-d77b-4932-a99a-7ab892997715 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:54.326106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89afba-d77b-4932-a99a-7ab892997715 None admin] PATH_INFO: `/v3/users/d850940933c14a8a9369b35279aea4b1` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:54.344547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89afba-d77b-4932-a99a-7ab892997715 None admin] RBAC: Authorizing `identity:get_user(user_id=d850940933c14a8a9369b35279aea4b1)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:54.345990 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89afba-d77b-4932-a99a-7ab892997715 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:54.347718 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 585/1143] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:05:54 2022] GET /identity/v3/users/d850940933c14a8a9369b35279aea4b1 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:54.356981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f6de8-08a7-4612-9e7f-f065ef75bb8f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:54.467474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f6de8-08a7-4612-9e7f-f065ef75bb8f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:54.480244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:54.502179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba4e92-468c-4919-9e68-22b3d1d48099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:54.502848 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba4e92-468c-4919-9e68-22b3d1d48099 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:54.503128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba4e92-468c-4919-9e68-22b3d1d48099 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:54.503399 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba4e92-468c-4919-9e68-22b3d1d48099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:54.570004 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba4e92-468c-4919-9e68-22b3d1d48099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:54.571441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba4e92-468c-4919-9e68-22b3d1d48099 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:54.672518 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 559/1144] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:05:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 14:05:54.679241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89afba-d77b-4932-a99a-7ab892997715 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:54.730407 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:54.796936 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89afba-d77b-4932-a99a-7ab892997715 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:54.836647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ca5f2-0601-40ef-bdab-224fced69142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:54.837452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ca5f2-0601-40ef-bdab-224fced69142 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:54.837727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ca5f2-0601-40ef-bdab-224fced69142 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:54.838004 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ca5f2-0601-40ef-bdab-224fced69142 None admin] PATH_INFO: `/v3/projects/e37110a664b94dff9ad18d3f264edc8e` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:54.839328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ca5f2-0601-40ef-bdab-224fced69142 None admin] RBAC: Authorizing `identity:get_project(project_id=e37110a664b94dff9ad18d3f264edc8e)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:54.840771 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ca5f2-0601-40ef-bdab-224fced69142 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:54.842532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 586/1145] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:05:54 2022] GET /identity/v3/projects/e37110a664b94dff9ad18d3f264edc8e => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:54.849293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba4e92-468c-4919-9e68-22b3d1d48099 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:54.864191 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:54.974208 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba4e92-468c-4919-9e68-22b3d1d48099 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:55.009432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b80154-d270-434a-a8cd-7504802b73ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:55.010082 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b80154-d270-434a-a8cd-7504802b73ad None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:55.010370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b80154-d270-434a-a8cd-7504802b73ad None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:55.010671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b80154-d270-434a-a8cd-7504802b73ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:55.011503 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b80154-d270-434a-a8cd-7504802b73ad None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=e37110a664b94dff9ad18d3f264edc8e, user.id=d850940933c14a8a9369b35279aea4b1) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:55.011821 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b80154-d270-434a-a8cd-7504802b73ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:55.013263 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b80154-d270-434a-a8cd-7504802b73ad None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:55.018761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 560/1146] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:05:54 2022] GET /identity/v3/role_assignments?user.id=d850940933c14a8a9369b35279aea4b1&scope.project.id=e37110a664b94dff9ad18d3f264edc8e&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:56.979844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f468a-7b10-4e7d-96e3-3174b1ee30fb None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:56.980396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f468a-7b10-4e7d-96e3-3174b1ee30fb None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:56.980396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f468a-7b10-4e7d-96e3-3174b1ee30fb None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:56.982481 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 587/1147] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:56.989929 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d63bf-65cc-420b-8985-8190f71491ca None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:56.990430 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d63bf-65cc-420b-8985-8190f71491ca None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:56.990522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d63bf-65cc-420b-8985-8190f71491ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:57.009902 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d33d63bf-65cc-420b-8985-8190f71491ca None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:57.011135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d33d63bf-65cc-420b-8985-8190f71491ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:05:57.080684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 561/1148] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:05:57.103681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f468a-7b10-4e7d-96e3-3174b1ee30fb None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:57.214948 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f468a-7b10-4e7d-96e3-3174b1ee30fb None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:57.228917 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:57.254483 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88283ba9-25b4-44b2-941e-1c6c32436570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:57.255230 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88283ba9-25b4-44b2-941e-1c6c32436570 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:57.255515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88283ba9-25b4-44b2-941e-1c6c32436570 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:57.255787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88283ba9-25b4-44b2-941e-1c6c32436570 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:57.266532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88283ba9-25b4-44b2-941e-1c6c32436570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:05:57.274100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-88283ba9-25b4-44b2-941e-1c6c32436570 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:05:57.274100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:05:57.274100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:05:57.274100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:05:57.274100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:05:57.274100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:05:57.274100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:05:57.274100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:05:57.274100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:05:57.274100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:05:57.274100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:05:57.274100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:05:57.274100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:05:57.274100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:05:57.274100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:05:57.274100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:05:57.275325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:05:57.275325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:05:57.275325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:05:57.275325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:05:57.275325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:05:57.275325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:05:57.275325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:05:57.275325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:05:57.275325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:05:57.275325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:05:57.275325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:05:57.275325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:05:57.275325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:05:57.275325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:05:57.275325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:05:57.275325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:05:57.276558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:05:57.276558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:05:57.276558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:05:57.276558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:05:57.276558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:05:57.276558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:05:57.276558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:05:57.276558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:05:57.276558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:05:57.276558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:05:57.276558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:05:57.276558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:05:57.276558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 588/1149] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:05:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:05:57.282876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d63bf-65cc-420b-8985-8190f71491ca None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:57.291002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:57.390055 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d63bf-65cc-420b-8985-8190f71491ca None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:57.425782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c527f-7df9-4eb6-930a-54220b508f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:57.426437 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c527f-7df9-4eb6-930a-54220b508f5e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:57.426734 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c527f-7df9-4eb6-930a-54220b508f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:57.427008 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c527f-7df9-4eb6-930a-54220b508f5e None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:57.427748 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c527f-7df9-4eb6-930a-54220b508f5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:05:57.428047 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c527f-7df9-4eb6-930a-54220b508f5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:57.429418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c527f-7df9-4eb6-930a-54220b508f5e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:57.438184 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 562/1150] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:05:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:57.445381 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88283ba9-25b4-44b2-941e-1c6c32436570 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:57.563210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88283ba9-25b4-44b2-941e-1c6c32436570 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:57.599474 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37065da4-c3b1-4063-88c3-3e40af5c223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:57.600370 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37065da4-c3b1-4063-88c3-3e40af5c223c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:57.600619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37065da4-c3b1-4063-88c3-3e40af5c223c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:57.600897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37065da4-c3b1-4063-88c3-3e40af5c223c None admin] PATH_INFO: `/v3/users/d850940933c14a8a9369b35279aea4b1` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:57.602211 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37065da4-c3b1-4063-88c3-3e40af5c223c None admin] RBAC: Authorizing `identity:get_user(user_id=d850940933c14a8a9369b35279aea4b1)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:57.603708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37065da4-c3b1-4063-88c3-3e40af5c223c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:57.605346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 589/1151] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:05:57 2022] GET /identity/v3/users/d850940933c14a8a9369b35279aea4b1 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:57.614342 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c527f-7df9-4eb6-930a-54220b508f5e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:57.691707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:57.725380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c527f-7df9-4eb6-930a-54220b508f5e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:57.771257 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2854baa-a700-44eb-8cf6-1a9e407bd984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:57.772120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2854baa-a700-44eb-8cf6-1a9e407bd984 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:57.772398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2854baa-a700-44eb-8cf6-1a9e407bd984 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:57.772669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2854baa-a700-44eb-8cf6-1a9e407bd984 None admin] PATH_INFO: `/v3/projects/e37110a664b94dff9ad18d3f264edc8e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:57.773854 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2854baa-a700-44eb-8cf6-1a9e407bd984 None admin] RBAC: Authorizing `identity:get_project(project_id=e37110a664b94dff9ad18d3f264edc8e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:57.775334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2854baa-a700-44eb-8cf6-1a9e407bd984 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:57.777037 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 563/1152] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:05:57 2022] GET /identity/v3/projects/e37110a664b94dff9ad18d3f264edc8e => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:05:57.783536 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37065da4-c3b1-4063-88c3-3e40af5c223c None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:05:57.828593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:05:57.902046 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37065da4-c3b1-4063-88c3-3e40af5c223c None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:05:57.944546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3123311-0b9f-4811-9e18-59510b51e81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:05:57.945434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3123311-0b9f-4811-9e18-59510b51e81c None admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:57.945719 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3123311-0b9f-4811-9e18-59510b51e81c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:57.946004 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3123311-0b9f-4811-9e18-59510b51e81c None admin] PATH_INFO: `/v3/projects/e37110a664b94dff9ad18d3f264edc8e/users/d850940933c14a8a9369b35279aea4b1/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:57.948259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3123311-0b9f-4811-9e18-59510b51e81c None admin] RBAC: Authorizing `identity:create_grant(project_id=e37110a664b94dff9ad18d3f264edc8e, user_id=d850940933c14a8a9369b35279aea4b1, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:05:57.949721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3123311-0b9f-4811-9e18-59510b51e81c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:05:57.964791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 590/1153] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:05:57 2022] PUT /identity/v3/projects/e37110a664b94dff9ad18d3f264edc8e/users/d850940933c14a8a9369b35279aea4b1/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:05:59.924355 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38623f41-7ba3-4369-aebb-25fbdec42242 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:59.925251 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38623f41-7ba3-4369-aebb-25fbdec42242 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:59.925251 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38623f41-7ba3-4369-aebb-25fbdec42242 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:59.927740 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 564/1154] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:05:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:05:59.933937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1646f9e-2a09-4c90-bffe-f661b7b2556e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:05:59.934659 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1646f9e-2a09-4c90-bffe-f661b7b2556e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:05:59.934918 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1646f9e-2a09-4c90-bffe-f661b7b2556e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:05:59.959160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-a1646f9e-2a09-4c90-bffe-f661b7b2556e None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:05:59.960388 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a1646f9e-2a09-4c90-bffe-f661b7b2556e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:06:00.034086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 591/1155] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:05:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:06:00.061566 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38623f41-7ba3-4369-aebb-25fbdec42242 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:00.171739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38623f41-7ba3-4369-aebb-25fbdec42242 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:00.209518 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d31c55-515a-4508-b40b-abdd139731e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:00.210223 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d31c55-515a-4508-b40b-abdd139731e1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:00.210533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d31c55-515a-4508-b40b-abdd139731e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:00.210804 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d31c55-515a-4508-b40b-abdd139731e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:00.213712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:00.222143 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d31c55-515a-4508-b40b-abdd139731e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:06:00.229970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a9d31c55-515a-4508-b40b-abdd139731e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:06:00.229970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:06:00.229970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:06:00.229970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:06:00.229970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:06:00.229970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:06:00.229970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:06:00.229970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:06:00.229970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:06:00.229970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:06:00.229970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:06:00.229970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:06:00.229970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:06:00.229970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:06:00.229970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:06:00.229970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:06:00.231148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:06:00.231148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:06:00.231148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:06:00.231148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:06:00.231148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:06:00.231148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:06:00.231148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:06:00.231148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:06:00.231148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:06:00.231148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:06:00.231148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:06:00.231148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:06:00.231148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:06:00.231148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:06:00.231148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:06:00.231148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:06:00.232161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:06:00.232161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:06:00.232161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:06:00.232161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:06:00.232161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:06:00.232161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:06:00.232161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:06:00.232161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:06:00.232161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:06:00.232161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:06:00.232161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:06:00.232161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:06:00.234560 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 565/1156] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:06:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:06:00.237471 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1646f9e-2a09-4c90-bffe-f661b7b2556e None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:00.281250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:00.362227 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1646f9e-2a09-4c90-bffe-f661b7b2556e None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:00.402420 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e10d0b-41d0-4699-9489-de4daa4de484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:00.403098 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e10d0b-41d0-4699-9489-de4daa4de484 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:00.403384 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e10d0b-41d0-4699-9489-de4daa4de484 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:00.403657 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e10d0b-41d0-4699-9489-de4daa4de484 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:00.404400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e10d0b-41d0-4699-9489-de4daa4de484 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:06:00.404705 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e10d0b-41d0-4699-9489-de4daa4de484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:00.406156 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e10d0b-41d0-4699-9489-de4daa4de484 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:00.414562 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 592/1157] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:06:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:00.423310 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d31c55-515a-4508-b40b-abdd139731e1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:00.527573 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d31c55-515a-4508-b40b-abdd139731e1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:00.561981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455159e6-b900-4578-b5bc-bbd99a2dc373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:00.562863 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455159e6-b900-4578-b5bc-bbd99a2dc373 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:00.563138 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455159e6-b900-4578-b5bc-bbd99a2dc373 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:00.563402 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455159e6-b900-4578-b5bc-bbd99a2dc373 None admin] PATH_INFO: `/v3/users/d850940933c14a8a9369b35279aea4b1` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:00.564603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455159e6-b900-4578-b5bc-bbd99a2dc373 None admin] RBAC: Authorizing `identity:get_user(user_id=d850940933c14a8a9369b35279aea4b1)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:00.566046 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455159e6-b900-4578-b5bc-bbd99a2dc373 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:00.567711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 566/1158] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:06:00 2022] GET /identity/v3/users/d850940933c14a8a9369b35279aea4b1 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:00.574285 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e10d0b-41d0-4699-9489-de4daa4de484 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:00.679539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:00.687123 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e10d0b-41d0-4699-9489-de4daa4de484 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:00.720177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958217b-5e5f-4620-8249-51f6e7f6925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:00.720820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958217b-5e5f-4620-8249-51f6e7f6925b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:00.721101 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958217b-5e5f-4620-8249-51f6e7f6925b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:00.721380 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958217b-5e5f-4620-8249-51f6e7f6925b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:00.806824 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958217b-5e5f-4620-8249-51f6e7f6925b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:00.808198 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958217b-5e5f-4620-8249-51f6e7f6925b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:00.911456 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:00.919761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 593/1159] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:06:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 14:06:00.926298 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455159e6-b900-4578-b5bc-bbd99a2dc373 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:00.993868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:01.038123 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455159e6-b900-4578-b5bc-bbd99a2dc373 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:01.072665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a84eb-2ca0-4f42-8f4f-9a72e5dfc29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:01.073436 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a84eb-2ca0-4f42-8f4f-9a72e5dfc29a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:01.073709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a84eb-2ca0-4f42-8f4f-9a72e5dfc29a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:01.073975 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a84eb-2ca0-4f42-8f4f-9a72e5dfc29a None admin] PATH_INFO: `/v3/projects/e37110a664b94dff9ad18d3f264edc8e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:01.075232 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a84eb-2ca0-4f42-8f4f-9a72e5dfc29a None admin] RBAC: Authorizing `identity:get_project(project_id=e37110a664b94dff9ad18d3f264edc8e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:01.076670 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a84eb-2ca0-4f42-8f4f-9a72e5dfc29a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:01.078410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 567/1160] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:06:00 2022] GET /identity/v3/projects/e37110a664b94dff9ad18d3f264edc8e => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:01.085057 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958217b-5e5f-4620-8249-51f6e7f6925b None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:01.199200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958217b-5e5f-4620-8249-51f6e7f6925b None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:01.237039 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc588e-b1d1-4328-9955-1a0ea67bbe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:01.237980 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc588e-b1d1-4328-9955-1a0ea67bbe04 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:01.238373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc588e-b1d1-4328-9955-1a0ea67bbe04 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:01.238777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc588e-b1d1-4328-9955-1a0ea67bbe04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:01.240079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc588e-b1d1-4328-9955-1a0ea67bbe04 None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=e37110a664b94dff9ad18d3f264edc8e, user.id=d850940933c14a8a9369b35279aea4b1) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:06:01.240531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc588e-b1d1-4328-9955-1a0ea67bbe04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:01.242858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc588e-b1d1-4328-9955-1a0ea67bbe04 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:01.252463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 594/1161] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:06:01 2022] GET /identity/v3/role_assignments?user.id=d850940933c14a8a9369b35279aea4b1&scope.project.id=e37110a664b94dff9ad18d3f264edc8e&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:03.275791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b423e92-a385-4a97-ad4b-553d690c4fe1 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:03.276619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b423e92-a385-4a97-ad4b-553d690c4fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:03.276619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b423e92-a385-4a97-ad4b-553d690c4fe1 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:03.278886 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 568/1162] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:06:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:06:03.286887 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3b12-3ff0-4132-a055-cca19d04a101 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:03.287324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3b12-3ff0-4132-a055-cca19d04a101 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:03.287415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3b12-3ff0-4132-a055-cca19d04a101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:03.304500 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-a83c3b12-3ff0-4132-a055-cca19d04a101 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:06:03.305678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a83c3b12-3ff0-4132-a055-cca19d04a101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:06:03.358921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:03.380611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 595/1163] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:06:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:06:03.403769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b423e92-a385-4a97-ad4b-553d690c4fe1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:03.514420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b423e92-a385-4a97-ad4b-553d690c4fe1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:03.544535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:03.550848 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6993c-5308-4019-93cd-22dd9709e573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:03.551504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6993c-5308-4019-93cd-22dd9709e573 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:03.551793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6993c-5308-4019-93cd-22dd9709e573 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:03.552069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6993c-5308-4019-93cd-22dd9709e573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:03.622349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6993c-5308-4019-93cd-22dd9709e573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:03.623839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6993c-5308-4019-93cd-22dd9709e573 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:03.726029 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 569/1164] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:06:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 14:06:03.732315 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c3b12-3ff0-4132-a055-cca19d04a101 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:03.840682 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c3b12-3ff0-4132-a055-cca19d04a101 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:03.875214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf993503-2150-4a5c-97d7-323254363f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:03.875998 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf993503-2150-4a5c-97d7-323254363f67 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:03.876282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf993503-2150-4a5c-97d7-323254363f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:03.876558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf993503-2150-4a5c-97d7-323254363f67 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:03.883382 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf993503-2150-4a5c-97d7-323254363f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:03.884829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf993503-2150-4a5c-97d7-323254363f67 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-cf993503-2150-4a5c-97d7-323254363f67 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:06:03.899085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:06:03.900265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:06:03.900265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:06:03.900265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:06:03.900265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:06:03.900265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:06:03.900265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:06:03.900265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:06:03.900265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:06:03.900265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:06:03.900265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:06:03.900265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:06:03.900265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:06:03.900265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:06:03.900265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:06:03.900265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:06:03.900265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:06:03.901299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:06:03.901299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:06:03.901299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:06:03.901299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:06:03.901299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:06:03.901299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:06:03.901299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:06:03.901299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:06:03.901299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:06:03.901299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:06:03.901299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 18 14:06:03.901299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:06:03.901299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 14:06:03.901299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:06:03.901299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 596/1165] 10.222.0.99 () {56 vars in 1117 bytes} [Mon Jul 18 14:06:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:06:03.906349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6993c-5308-4019-93cd-22dd9709e573 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:03.953711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:04.031627 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6993c-5308-4019-93cd-22dd9709e573 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:04.068278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df874c-dda2-4dbb-923b-8eb941af397c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:04.068930 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df874c-dda2-4dbb-923b-8eb941af397c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:04.069215 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df874c-dda2-4dbb-923b-8eb941af397c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:04.069491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df874c-dda2-4dbb-923b-8eb941af397c None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:04.070216 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df874c-dda2-4dbb-923b-8eb941af397c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:06:04.070554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df874c-dda2-4dbb-923b-8eb941af397c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:04.071949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df874c-dda2-4dbb-923b-8eb941af397c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:04.079111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 570/1166] 10.222.0.99 () {56 vars in 1115 bytes} [Mon Jul 18 14:06:03 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:06.054167 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254eaa4-c896-454e-b961-aad89cde24d3 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:06.055079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254eaa4-c896-454e-b961-aad89cde24d3 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:06.055079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254eaa4-c896-454e-b961-aad89cde24d3 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:06.057300 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 597/1167] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:06:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:06:06.062693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e44dc-470c-4bf7-b3aa-ac7699d9fc59 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:06.063165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e44dc-470c-4bf7-b3aa-ac7699d9fc59 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:06.063315 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e44dc-470c-4bf7-b3aa-ac7699d9fc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:06.081999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-118e44dc-470c-4bf7-b3aa-ac7699d9fc59 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:06:06.083221 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-118e44dc-470c-4bf7-b3aa-ac7699d9fc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:06:06.172804 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 571/1168] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:06:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:06:06.197997 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254eaa4-c896-454e-b961-aad89cde24d3 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:06.255325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:06.309675 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254eaa4-c896-454e-b961-aad89cde24d3 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:06.346382 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9005042-e1e9-4483-9dd5-69d9050f45d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:06.347078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9005042-e1e9-4483-9dd5-69d9050f45d2 None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:06.347359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9005042-e1e9-4483-9dd5-69d9050f45d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:06.347630 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9005042-e1e9-4483-9dd5-69d9050f45d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:06.348373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9005042-e1e9-4483-9dd5-69d9050f45d2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:06.349742 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9005042-e1e9-4483-9dd5-69d9050f45d2 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:06.366928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 598/1169] 10.222.0.99 () {60 vars in 1138 bytes} [Mon Jul 18 14:06:06 2022] POST /identity/v3/domains => generated 267 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:06:08.385410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b6897-a779-4406-986e-2b3d7b159228 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:08.386420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b6897-a779-4406-986e-2b3d7b159228 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:08.386420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b6897-a779-4406-986e-2b3d7b159228 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:08.388589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 572/1170] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:06:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:06:08.394086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63480ee-760b-4308-b34e-5b73c903a3d9 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:08.394544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63480ee-760b-4308-b34e-5b73c903a3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:08.394661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63480ee-760b-4308-b34e-5b73c903a3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:08.412914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-f63480ee-760b-4308-b34e-5b73c903a3d9 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:06:08.414037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f63480ee-760b-4308-b34e-5b73c903a3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:06:08.496632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 599/1171] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:06:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:06:08.520604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b6897-a779-4406-986e-2b3d7b159228 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:08.552363 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:08.633816 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b6897-a779-4406-986e-2b3d7b159228 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:08.684675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52621d87-d1b1-48c8-babf-60892d60b768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:08.685447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52621d87-d1b1-48c8-babf-60892d60b768 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:08.685724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52621d87-d1b1-48c8-babf-60892d60b768 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:08.685997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52621d87-d1b1-48c8-babf-60892d60b768 None admin] PATH_INFO: `/v3/domains/41ed63fac88e4b85b97404d6cd5d08ac` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:08.697539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52621d87-d1b1-48c8-babf-60892d60b768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=41ed63fac88e4b85b97404d6cd5d08ac)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:08.699097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52621d87-d1b1-48c8-babf-60892d60b768 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:08.700738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 573/1172] 10.222.0.99 () {56 vars in 1183 bytes} [Mon Jul 18 14:06:08 2022] GET /identity/v3/domains/41ed63fac88e4b85b97404d6cd5d08ac => generated 267 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:08.707288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63480ee-760b-4308-b34e-5b73c903a3d9 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:08.765544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:08.841239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63480ee-760b-4308-b34e-5b73c903a3d9 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:08.879687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ccaf0-3188-4431-80bb-2d365b42419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:08.880341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ccaf0-3188-4431-80bb-2d365b42419d None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:08.880624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ccaf0-3188-4431-80bb-2d365b42419d None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:08.880899 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ccaf0-3188-4431-80bb-2d365b42419d None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:08.881681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ccaf0-3188-4431-80bb-2d365b42419d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:08.883081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ccaf0-3188-4431-80bb-2d365b42419d None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:08.913248 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 600/1173] 10.222.0.99 () {60 vars in 1141 bytes} [Mon Jul 18 14:06:08 2022] POST /identity/v3/projects => generated 361 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:06:10.963443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402bdb3-7544-4890-99d9-5f35d9304c5b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:10.964345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402bdb3-7544-4890-99d9-5f35d9304c5b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:10.964345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402bdb3-7544-4890-99d9-5f35d9304c5b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:10.966466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 574/1174] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:06:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:06:10.975265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbc515-558a-4599-a98d-19a97b435eae None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:10.975687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbc515-558a-4599-a98d-19a97b435eae None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:10.975872 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbc515-558a-4599-a98d-19a97b435eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:10.996687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-00cbc515-558a-4599-a98d-19a97b435eae None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:06:10.997887 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-00cbc515-558a-4599-a98d-19a97b435eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:06:11.069339 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 601/1175] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:06:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:06:11.094769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402bdb3-7544-4890-99d9-5f35d9304c5b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:11.200152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:11.222744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402bdb3-7544-4890-99d9-5f35d9304c5b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:11.262036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429fc8f-3173-44b8-bdd0-6ed3cd154a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:11.262919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429fc8f-3173-44b8-bdd0-6ed3cd154a90 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:11.263193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429fc8f-3173-44b8-bdd0-6ed3cd154a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:11.263473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429fc8f-3173-44b8-bdd0-6ed3cd154a90 None admin] PATH_INFO: `/v3/domains/41ed63fac88e4b85b97404d6cd5d08ac` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:11.264744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429fc8f-3173-44b8-bdd0-6ed3cd154a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=41ed63fac88e4b85b97404d6cd5d08ac)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:11.266182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429fc8f-3173-44b8-bdd0-6ed3cd154a90 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:11.267826 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 575/1176] 10.222.0.99 () {56 vars in 1183 bytes} [Mon Jul 18 14:06:11 2022] GET /identity/v3/domains/41ed63fac88e4b85b97404d6cd5d08ac => generated 267 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:11.273866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbc515-558a-4599-a98d-19a97b435eae None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:11.295385 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:11.375511 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbc515-558a-4599-a98d-19a97b435eae None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:11.411025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bb2ab-1236-4024-afd3-7b648527162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:11.411681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bb2ab-1236-4024-afd3-7b648527162b None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:11.411957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bb2ab-1236-4024-afd3-7b648527162b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:11.412229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bb2ab-1236-4024-afd3-7b648527162b None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:11.412933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bb2ab-1236-4024-afd3-7b648527162b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:11.414365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bb2ab-1236-4024-afd3-7b648527162b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:11.437411 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 602/1177] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:06:11 2022] POST /identity/v3/users => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:06:13.457635 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54a710-e11e-4ab9-bfbc-9f163129119e None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:13.458548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54a710-e11e-4ab9-bfbc-9f163129119e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:13.458548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f54a710-e11e-4ab9-bfbc-9f163129119e None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:13.460789 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 576/1178] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:06:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:06:13.469421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbc799-6656-4bab-877b-fb0d2aab5fe7 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:13.469870 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbc799-6656-4bab-877b-fb0d2aab5fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:13.470039 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbc799-6656-4bab-877b-fb0d2aab5fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:13.489418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-d0cbc799-6656-4bab-877b-fb0d2aab5fe7 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:06:13.490654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d0cbc799-6656-4bab-877b-fb0d2aab5fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:06:13.563788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 603/1179] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:06:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:06:13.587276 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54a710-e11e-4ab9-bfbc-9f163129119e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:13.716560 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f54a710-e11e-4ab9-bfbc-9f163129119e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:13.756185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a12a0d-3eed-454e-bae1-7628fe6a1ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:13.756966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a12a0d-3eed-454e-bae1-7628fe6a1ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:13.757244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a12a0d-3eed-454e-bae1-7628fe6a1ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:13.757502 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a12a0d-3eed-454e-bae1-7628fe6a1ad5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:13.768091 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a12a0d-3eed-454e-bae1-7628fe6a1ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:06:13.775598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-47a12a0d-3eed-454e-bae1-7628fe6a1ad5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:06:13.775598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:06:13.775598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:06:13.775598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:06:13.775598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:06:13.775598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:06:13.775598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:06:13.775598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:06:13.775598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:06:13.775598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:06:13.775598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:06:13.775598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:06:13.775598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:06:13.775598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:06:13.775598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:06:13.775598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:06:13.776759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:06:13.776759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:06:13.776759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:06:13.776759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:06:13.776759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:06:13.776759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:06:13.776759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:06:13.776759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:06:13.776759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:06:13.776759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:06:13.776759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:06:13.776759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:06:13.776759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:06:13.776759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:06:13.776759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:06:13.776759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:06:13.778676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:06:13.778676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:06:13.778676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:06:13.778676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:06:13.778676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:06:13.778676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:06:13.778676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:06:13.778676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:06:13.778676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:06:13.778676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:06:13.778676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:06:13.778676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:06:13.778676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 577/1180] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:06:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:06:13.784286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbc799-6656-4bab-877b-fb0d2aab5fe7 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:13.792534 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:13.884953 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbc799-6656-4bab-877b-fb0d2aab5fe7 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:13.919712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d4c92-da4a-4821-af45-039c66c66074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:13.920365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d4c92-da4a-4821-af45-039c66c66074 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:13.920660 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d4c92-da4a-4821-af45-039c66c66074 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:13.920951 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d4c92-da4a-4821-af45-039c66c66074 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:13.921728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d4c92-da4a-4821-af45-039c66c66074 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:06:13.922033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d4c92-da4a-4821-af45-039c66c66074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:13.923439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d4c92-da4a-4821-af45-039c66c66074 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:13.931409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 604/1181] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:06:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:06:13.938055 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a12a0d-3eed-454e-bae1-7628fe6a1ad5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:13.959874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:14.048832 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a12a0d-3eed-454e-bae1-7628fe6a1ad5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:14.083829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f10ac8-4f6b-4271-8339-573ab4dbee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:14.084692 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10ac8-4f6b-4271-8339-573ab4dbee23 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:14.084972 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10ac8-4f6b-4271-8339-573ab4dbee23 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:14.085224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10ac8-4f6b-4271-8339-573ab4dbee23 None admin] PATH_INFO: `/v3/users/e5b80bedf64b40aeb7faf70c2f798ff8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:14.103088 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f10ac8-4f6b-4271-8339-573ab4dbee23 None admin] RBAC: Authorizing `identity:get_user(user_id=e5b80bedf64b40aeb7faf70c2f798ff8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:14.104533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f10ac8-4f6b-4271-8339-573ab4dbee23 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:14.106207 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 578/1182] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:06:13 2022] GET /identity/v3/users/e5b80bedf64b40aeb7faf70c2f798ff8 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:14.115643 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d4c92-da4a-4821-af45-039c66c66074 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:14.196899 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:14.233867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d4c92-da4a-4821-af45-039c66c66074 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:14.273281 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064830a1-2e62-4a5b-9138-c6503f8b8718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:14.273928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064830a1-2e62-4a5b-9138-c6503f8b8718 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:14.274213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064830a1-2e62-4a5b-9138-c6503f8b8718 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:14.274521 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064830a1-2e62-4a5b-9138-c6503f8b8718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:14.348941 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064830a1-2e62-4a5b-9138-c6503f8b8718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:14.350343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064830a1-2e62-4a5b-9138-c6503f8b8718 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:14.423862 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:14.458871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 605/1183] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:06:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 14:06:14.465090 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f10ac8-4f6b-4271-8339-573ab4dbee23 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:14.550536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:14.592538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f10ac8-4f6b-4271-8339-573ab4dbee23 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:14.629027 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddbb3b-fcf3-4f9f-916b-36cc9042be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:14.629888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddbb3b-fcf3-4f9f-916b-36cc9042be31 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:14.630174 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddbb3b-fcf3-4f9f-916b-36cc9042be31 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:14.630492 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddbb3b-fcf3-4f9f-916b-36cc9042be31 None admin] PATH_INFO: `/v3/projects/1c48dd8b44254f359301796172140ea0` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:14.631880 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddbb3b-fcf3-4f9f-916b-36cc9042be31 None admin] RBAC: Authorizing `identity:get_project(project_id=1c48dd8b44254f359301796172140ea0)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:14.633447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddbb3b-fcf3-4f9f-916b-36cc9042be31 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:14.635221 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 579/1184] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:06:14 2022] GET /identity/v3/projects/1c48dd8b44254f359301796172140ea0 => generated 361 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:14.647122 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064830a1-2e62-4a5b-9138-c6503f8b8718 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:14.756446 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064830a1-2e62-4a5b-9138-c6503f8b8718 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:14.795859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330fedd-76fa-4658-9aca-cf48a672363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:14.796498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330fedd-76fa-4658-9aca-cf48a672363c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:14.796778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330fedd-76fa-4658-9aca-cf48a672363c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:14.797050 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330fedd-76fa-4658-9aca-cf48a672363c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:14.797876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330fedd-76fa-4658-9aca-cf48a672363c None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=1c48dd8b44254f359301796172140ea0, user.id=e5b80bedf64b40aeb7faf70c2f798ff8) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:06:14.798185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330fedd-76fa-4658-9aca-cf48a672363c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:14.799650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330fedd-76fa-4658-9aca-cf48a672363c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:14.805127 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 606/1185] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:06:14 2022] GET /identity/v3/role_assignments?user.id=e5b80bedf64b40aeb7faf70c2f798ff8&scope.project.id=1c48dd8b44254f359301796172140ea0&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:16.792278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439c163-bff9-42e0-8154-e699e8489a9b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:16.793009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439c163-bff9-42e0-8154-e699e8489a9b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:16.793009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439c163-bff9-42e0-8154-e699e8489a9b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:16.795165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 580/1186] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:06:16.801659 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97585b-1e92-4c6d-a1f5-48bfb48cb22d None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:16.802088 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97585b-1e92-4c6d-a1f5-48bfb48cb22d None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:16.802236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97585b-1e92-4c6d-a1f5-48bfb48cb22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:16.828990 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-bf97585b-1e92-4c6d-a1f5-48bfb48cb22d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:06:16.830244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-bf97585b-1e92-4c6d-a1f5-48bfb48cb22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:06:16.860484 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:16.906254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 607/1187] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:06:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:06:16.934501 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439c163-bff9-42e0-8154-e699e8489a9b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:17.036410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439c163-bff9-42e0-8154-e699e8489a9b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:17.073481 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c24c3-b5b6-4302-abdf-d75819fd78cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:17.074191 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c24c3-b5b6-4302-abdf-d75819fd78cb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:17.074504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c24c3-b5b6-4302-abdf-d75819fd78cb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:17.074774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c24c3-b5b6-4302-abdf-d75819fd78cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:17.083219 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:17.086288 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c24c3-b5b6-4302-abdf-d75819fd78cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:06:17.094660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d90c24c3-b5b6-4302-abdf-d75819fd78cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:06:17.094660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:06:17.094660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:06:17.094660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:06:17.094660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:06:17.094660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:06:17.094660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:06:17.094660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:06:17.094660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:06:17.094660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:06:17.094660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:06:17.094660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:06:17.094660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:06:17.094660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:06:17.094660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:06:17.094660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:06:17.095720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:06:17.095720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:06:17.095720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:06:17.095720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:06:17.095720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:06:17.095720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:06:17.095720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:06:17.095720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:06:17.095720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:06:17.095720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:06:17.095720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:06:17.095720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:06:17.095720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:06:17.095720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:06:17.095720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:06:17.095720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:06:17.096600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:06:17.096600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:06:17.096600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:06:17.096600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:06:17.096600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:06:17.096600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:06:17.096600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:06:17.096600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:06:17.096600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:06:17.096600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:06:17.096600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:06:17.096600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:06:17.096600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 581/1188] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:06:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:06:17.102770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97585b-1e92-4c6d-a1f5-48bfb48cb22d None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:17.222952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97585b-1e92-4c6d-a1f5-48bfb48cb22d None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:17.260963 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c6755-d97f-48cb-97ae-81be5dd05f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:17.261629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c6755-d97f-48cb-97ae-81be5dd05f22 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:17.261916 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c6755-d97f-48cb-97ae-81be5dd05f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:17.262195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c6755-d97f-48cb-97ae-81be5dd05f22 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:17.262987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c6755-d97f-48cb-97ae-81be5dd05f22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:06:17.263286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c6755-d97f-48cb-97ae-81be5dd05f22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:17.264656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c6755-d97f-48cb-97ae-81be5dd05f22 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:17.272664 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 608/1189] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:06:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:17.281724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c24c3-b5b6-4302-abdf-d75819fd78cb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:17.392399 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c24c3-b5b6-4302-abdf-d75819fd78cb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:17.441052 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6513cf-e224-4619-9629-734b27938db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:17.441932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6513cf-e224-4619-9629-734b27938db5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:17.442212 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6513cf-e224-4619-9629-734b27938db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:17.442522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6513cf-e224-4619-9629-734b27938db5 None admin] PATH_INFO: `/v3/users/e5b80bedf64b40aeb7faf70c2f798ff8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:17.443865 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6513cf-e224-4619-9629-734b27938db5 None admin] RBAC: Authorizing `identity:get_user(user_id=e5b80bedf64b40aeb7faf70c2f798ff8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:17.445327 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6513cf-e224-4619-9629-734b27938db5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:17.447019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 582/1190] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:06:17 2022] GET /identity/v3/users/e5b80bedf64b40aeb7faf70c2f798ff8 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:17.453270 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c6755-d97f-48cb-97ae-81be5dd05f22 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:17.482512 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:17.571198 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c6755-d97f-48cb-97ae-81be5dd05f22 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:17.606208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f809d1-fc7d-43bc-b31e-f40273d9b002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:17.607460 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f809d1-fc7d-43bc-b31e-f40273d9b002 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:17.607943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f809d1-fc7d-43bc-b31e-f40273d9b002 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:17.608507 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f809d1-fc7d-43bc-b31e-f40273d9b002 None admin] PATH_INFO: `/v3/projects/1c48dd8b44254f359301796172140ea0` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:17.610707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f809d1-fc7d-43bc-b31e-f40273d9b002 None admin] RBAC: Authorizing `identity:get_project(project_id=1c48dd8b44254f359301796172140ea0)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:17.613206 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f809d1-fc7d-43bc-b31e-f40273d9b002 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:17.615187 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 609/1191] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:06:17 2022] GET /identity/v3/projects/1c48dd8b44254f359301796172140ea0 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:17.626054 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6513cf-e224-4619-9629-734b27938db5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:17.704604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:17.754544 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6513cf-e224-4619-9629-734b27938db5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:17.794344 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae12b5e-bf99-4606-9df6-8914a4dd452b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:17.795267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae12b5e-bf99-4606-9df6-8914a4dd452b None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:17.795575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae12b5e-bf99-4606-9df6-8914a4dd452b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:17.795885 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae12b5e-bf99-4606-9df6-8914a4dd452b None admin] PATH_INFO: `/v3/projects/1c48dd8b44254f359301796172140ea0/users/e5b80bedf64b40aeb7faf70c2f798ff8/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:17.797982 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae12b5e-bf99-4606-9df6-8914a4dd452b None admin] RBAC: Authorizing `identity:create_grant(project_id=1c48dd8b44254f359301796172140ea0, user_id=e5b80bedf64b40aeb7faf70c2f798ff8, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:17.799463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae12b5e-bf99-4606-9df6-8914a4dd452b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:17.815163 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 583/1192] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:06:17 2022] PUT /identity/v3/projects/1c48dd8b44254f359301796172140ea0/users/e5b80bedf64b40aeb7faf70c2f798ff8/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:06:19.811319 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34aacf0-0766-48f1-ad8c-34a756ed1895 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:19.811913 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34aacf0-0766-48f1-ad8c-34a756ed1895 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:19.811913 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34aacf0-0766-48f1-ad8c-34a756ed1895 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:19.813371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 610/1193] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:06:19.819887 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d2fe7-0ad8-40d5-a39b-9d1bbaff86b5 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:19.820351 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d2fe7-0ad8-40d5-a39b-9d1bbaff86b5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:19.820445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d2fe7-0ad8-40d5-a39b-9d1bbaff86b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:19.840064 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-175d2fe7-0ad8-40d5-a39b-9d1bbaff86b5 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:06:19.841256 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-175d2fe7-0ad8-40d5-a39b-9d1bbaff86b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:06:19.909374 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 584/1194] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:06:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:06:19.933326 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34aacf0-0766-48f1-ad8c-34a756ed1895 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:20.033126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:20.048851 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34aacf0-0766-48f1-ad8c-34a756ed1895 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:20.089371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6b611-ead8-4779-83ae-1c6f6a898f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:20.090088 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b611-ead8-4779-83ae-1c6f6a898f4b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:20.090368 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b611-ead8-4779-83ae-1c6f6a898f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:20.090673 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b611-ead8-4779-83ae-1c6f6a898f4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:20.102137 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6b611-ead8-4779-83ae-1c6f6a898f4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:06:20.109716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-55c6b611-ead8-4779-83ae-1c6f6a898f4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:06:20.109716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:06:20.109716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:06:20.109716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:06:20.109716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:06:20.109716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:06:20.109716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:06:20.109716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:06:20.109716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:06:20.109716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:06:20.109716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:06:20.109716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:06:20.109716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:06:20.109716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:06:20.109716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:06:20.109716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:06:20.110818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:06:20.110818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:06:20.110818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:06:20.110818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:06:20.110818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:06:20.110818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:06:20.110818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:06:20.110818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:06:20.110818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:06:20.110818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:06:20.110818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:06:20.110818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:06:20.110818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:06:20.110818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:06:20.110818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:06:20.110818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:06:20.112244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:06:20.112244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:06:20.112244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:06:20.112244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:06:20.112244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:06:20.112244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:06:20.112244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:06:20.112244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:06:20.112244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:06:20.112244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:06:20.112244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:06:20.112244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:06:20.112244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 611/1195] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:06:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:06:20.120214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d2fe7-0ad8-40d5-a39b-9d1bbaff86b5 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:20.197124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:20.239315 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d2fe7-0ad8-40d5-a39b-9d1bbaff86b5 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:20.277829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34dbe2-9576-4106-a02c-4eb8ade448b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:20.278591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34dbe2-9576-4106-a02c-4eb8ade448b4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:20.278880 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34dbe2-9576-4106-a02c-4eb8ade448b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:20.279159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34dbe2-9576-4106-a02c-4eb8ade448b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:20.279978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34dbe2-9576-4106-a02c-4eb8ade448b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:06:20.280292 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34dbe2-9576-4106-a02c-4eb8ade448b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:20.281692 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34dbe2-9576-4106-a02c-4eb8ade448b4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:20.290778 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 585/1196] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:06:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:20.297695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6b611-ead8-4779-83ae-1c6f6a898f4b None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:20.405370 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6b611-ead8-4779-83ae-1c6f6a898f4b None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:20.441139 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5d782-4ee3-4ad1-9906-a57b4c2f6371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:20.442977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5d782-4ee3-4ad1-9906-a57b4c2f6371 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:20.443267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5d782-4ee3-4ad1-9906-a57b4c2f6371 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:20.443540 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5d782-4ee3-4ad1-9906-a57b4c2f6371 None admin] PATH_INFO: `/v3/users/e5b80bedf64b40aeb7faf70c2f798ff8` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:20.444877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5d782-4ee3-4ad1-9906-a57b4c2f6371 None admin] RBAC: Authorizing `identity:get_user(user_id=e5b80bedf64b40aeb7faf70c2f798ff8)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:20.446339 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5d782-4ee3-4ad1-9906-a57b4c2f6371 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:20.448035 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 612/1197] 10.222.0.99 () {56 vars in 1177 bytes} [Mon Jul 18 14:06:20 2022] GET /identity/v3/users/e5b80bedf64b40aeb7faf70c2f798ff8 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:20.454969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34dbe2-9576-4106-a02c-4eb8ade448b4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:20.571807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34dbe2-9576-4106-a02c-4eb8ade448b4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:20.591965 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:20.608512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043f2b7-6ad4-491f-b4ab-ad5c2f7ced25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:20.609154 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043f2b7-6ad4-491f-b4ab-ad5c2f7ced25 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:20.609438 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043f2b7-6ad4-491f-b4ab-ad5c2f7ced25 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:20.609718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043f2b7-6ad4-491f-b4ab-ad5c2f7ced25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:20.683078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043f2b7-6ad4-491f-b4ab-ad5c2f7ced25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:20.684472 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043f2b7-6ad4-491f-b4ab-ad5c2f7ced25 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:20.793943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 586/1198] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:06:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 14:06:20.803427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5d782-4ee3-4ad1-9906-a57b4c2f6371 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:20.838983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:20.936310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5d782-4ee3-4ad1-9906-a57b4c2f6371 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:20.972179 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5eb7b-3844-40db-b19e-df18ed054b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:20.973026 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5eb7b-3844-40db-b19e-df18ed054b8c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:20.973303 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5eb7b-3844-40db-b19e-df18ed054b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:20.973579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5eb7b-3844-40db-b19e-df18ed054b8c None admin] PATH_INFO: `/v3/projects/1c48dd8b44254f359301796172140ea0` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:20.974900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5eb7b-3844-40db-b19e-df18ed054b8c None admin] RBAC: Authorizing `identity:get_project(project_id=1c48dd8b44254f359301796172140ea0)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:20.976331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5eb7b-3844-40db-b19e-df18ed054b8c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:20.978044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 613/1199] 10.222.0.99 () {56 vars in 1186 bytes} [Mon Jul 18 14:06:20 2022] GET /identity/v3/projects/1c48dd8b44254f359301796172140ea0 => generated 361 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:20.988230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043f2b7-6ad4-491f-b4ab-ad5c2f7ced25 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:06:21.013714 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:21.095691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043f2b7-6ad4-491f-b4ab-ad5c2f7ced25 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:06:21.134870 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbbd3a-a03c-492d-af08-7895d4df2850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:06:21.135601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbbd3a-a03c-492d-af08-7895d4df2850 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:06:21.135837 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbbd3a-a03c-492d-af08-7895d4df2850 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:06:21.136147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbbd3a-a03c-492d-af08-7895d4df2850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:06:21.136991 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbbd3a-a03c-492d-af08-7895d4df2850 None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=1c48dd8b44254f359301796172140ea0, user.id=e5b80bedf64b40aeb7faf70c2f798ff8) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:06:21.137578 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbbd3a-a03c-492d-af08-7895d4df2850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:06:21.138775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbbd3a-a03c-492d-af08-7895d4df2850 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:06:21.145717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 587/1200] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:06:20 2022] GET /identity/v3/role_assignments?user.id=e5b80bedf64b40aeb7faf70c2f798ff8&scope.project.id=1c48dd8b44254f359301796172140ea0&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:06:30.967368 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=56 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:06:31.142498 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=58 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:16.372788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ab96a-41d3-41f8-b6df-d1789316df79 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:16.373405 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ab96a-41d3-41f8-b6df-d1789316df79 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:16.373405 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ab96a-41d3-41f8-b6df-d1789316df79 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:16.375252 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 614/1201] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:07:16.381099 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d6be1-79c5-4f61-b51e-1c6ae3119324 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:16.381579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d6be1-79c5-4f61-b51e-1c6ae3119324 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:16.381684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d6be1-79c5-4f61-b51e-1c6ae3119324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:16.400700 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-366d6be1-79c5-4f61-b51e-1c6ae3119324 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:16.402105 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-366d6be1-79c5-4f61-b51e-1c6ae3119324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:16.491935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 588/1202] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:07:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:07:16.519457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ab96a-41d3-41f8-b6df-d1789316df79 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:16.651802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ab96a-41d3-41f8-b6df-d1789316df79 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:16.692670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebc87f-b3a9-44bb-b511-35ee6a8e9977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:16.693492 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc87f-b3a9-44bb-b511-35ee6a8e9977 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:16.693769 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc87f-b3a9-44bb-b511-35ee6a8e9977 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:16.694059 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc87f-b3a9-44bb-b511-35ee6a8e9977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:16.706141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebc87f-b3a9-44bb-b511-35ee6a8e9977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:16.707868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebc87f-b3a9-44bb-b511-35ee6a8e9977 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:16.728482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-b7ebc87f-b3a9-44bb-b511-35ee6a8e9977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:16.728482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:16.728482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:16.728482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:16.728482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:16.728482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:16.728482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:16.728482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:16.728482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:16.728482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:16.728482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:16.728482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:16.728482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:07:16.728482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:07:16.728482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:16.729548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:16.730598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:07:16.730598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:07:16.730598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:16.730598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:07:16.730598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 615/1203] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:07:16.736953 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d6be1-79c5-4f61-b51e-1c6ae3119324 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:16.877747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d6be1-79c5-4f61-b51e-1c6ae3119324 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:16.912633 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:16.922305 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941a573-2671-45ac-b333-45015009a0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:16.923087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941a573-2671-45ac-b333-45015009a0ca None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:16.923385 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941a573-2671-45ac-b333-45015009a0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:16.923691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941a573-2671-45ac-b333-45015009a0ca None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:16.924574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941a573-2671-45ac-b333-45015009a0ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:16.924859 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941a573-2671-45ac-b333-45015009a0ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:16.926329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941a573-2671-45ac-b333-45015009a0ca None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:16.940253 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 589/1204] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:16.947438 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebc87f-b3a9-44bb-b511-35ee6a8e9977 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:17.019496 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:17.096007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebc87f-b3a9-44bb-b511-35ee6a8e9977 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:17.148684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5910c61-952a-4ab8-a84f-b6acd4899e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:17.149386 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5910c61-952a-4ab8-a84f-b6acd4899e93 None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:17.149687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5910c61-952a-4ab8-a84f-b6acd4899e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:17.149983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5910c61-952a-4ab8-a84f-b6acd4899e93 None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:17.150732 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5910c61-952a-4ab8-a84f-b6acd4899e93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:17.152200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5910c61-952a-4ab8-a84f-b6acd4899e93 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:17.175335 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 616/1205] 10.222.0.99 () {60 vars in 1132 bytes} [Mon Jul 18 14:07:16 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:07:19.418610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f55410-00e3-4b9f-84b8-25acce7ea0b7 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:19.419124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f55410-00e3-4b9f-84b8-25acce7ea0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:19.419124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f55410-00e3-4b9f-84b8-25acce7ea0b7 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:19.420941 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 590/1206] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:07:19.425910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96703d1e-2fe0-469f-9051-a5604e4f2380 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:19.426544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96703d1e-2fe0-469f-9051-a5604e4f2380 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:19.426544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96703d1e-2fe0-469f-9051-a5604e4f2380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:19.445097 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-96703d1e-2fe0-469f-9051-a5604e4f2380 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:19.446556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-96703d1e-2fe0-469f-9051-a5604e4f2380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:19.522535 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 617/1207] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:07:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:07:19.546405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f55410-00e3-4b9f-84b8-25acce7ea0b7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:19.672058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f55410-00e3-4b9f-84b8-25acce7ea0b7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:19.707963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc2e3b-9bc6-4883-981b-186e6fec53dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:19.712041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc2e3b-9bc6-4883-981b-186e6fec53dd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:19.712333 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc2e3b-9bc6-4883-981b-186e6fec53dd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:19.712615 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc2e3b-9bc6-4883-981b-186e6fec53dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:19.723818 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc2e3b-9bc6-4883-981b-186e6fec53dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:07:19.731639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-e6bc2e3b-9bc6-4883-981b-186e6fec53dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:07:19.731639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:19.731639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:19.731639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:19.731639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:19.731639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:19.731639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:19.731639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:19.731639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:19.731639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:19.731639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:19.731639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:19.731639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:07:19.731639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:07:19.731639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:07:19.731639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:07:19.732760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:07:19.732760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:07:19.732760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:07:19.732760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:07:19.732760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:19.732760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:19.732760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:19.732760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:19.732760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:19.732760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:19.732760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:19.732760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:19.732760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:19.732760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:19.732760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:19.732760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:19.733641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:19.733641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:19.733641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:19.733641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:19.733641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:07:19.733641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:07:19.733641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:07:19.733641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:07:19.733641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:07:19.733641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:07:19.733641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:07:19.733641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:19.741111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 591/1208] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:07:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:19.741280 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96703d1e-2fe0-469f-9051-a5604e4f2380 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:19.788310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:19.857365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96703d1e-2fe0-469f-9051-a5604e4f2380 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:19.892983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927287cd-efdb-43aa-a1a2-863c08d67a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:19.893699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927287cd-efdb-43aa-a1a2-863c08d67a1e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:19.893983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927287cd-efdb-43aa-a1a2-863c08d67a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:19.894291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927287cd-efdb-43aa-a1a2-863c08d67a1e None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:19.895151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927287cd-efdb-43aa-a1a2-863c08d67a1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:19.895462 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927287cd-efdb-43aa-a1a2-863c08d67a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:19.896918 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927287cd-efdb-43aa-a1a2-863c08d67a1e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:19.915621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 618/1209] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:07:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:19.921498 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc2e3b-9bc6-4883-981b-186e6fec53dd None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:19.978691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:20.043978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc2e3b-9bc6-4883-981b-186e6fec53dd None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:20.083202 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fb086-b0c4-4667-919c-22f35f747922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:20.083998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fb086-b0c4-4667-919c-22f35f747922 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:20.084282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fb086-b0c4-4667-919c-22f35f747922 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:20.084579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fb086-b0c4-4667-919c-22f35f747922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:20.098200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fb086-b0c4-4667-919c-22f35f747922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:20.099831 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47fb086-b0c4-4667-919c-22f35f747922 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:20.118761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-e47fb086-b0c4-4667-919c-22f35f747922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:20.118761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:20.118761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:20.118761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:20.118761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:20.118761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:20.118761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:20.118761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:20.118761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:20.118761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:20.118761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:20.118761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:20.118761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:07:20.118761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:07:20.118761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:20.119969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:20.120900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:07:20.120900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:07:20.120900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:20.120900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:20.120900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 592/1210] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:20.126599 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927287cd-efdb-43aa-a1a2-863c08d67a1e None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:20.238475 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:20.241543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927287cd-efdb-43aa-a1a2-863c08d67a1e None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:20.287376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbce93-fecd-4438-a7b0-7ae5bcfb4d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:20.288265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbce93-fecd-4438-a7b0-7ae5bcfb4d85 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:20.288647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbce93-fecd-4438-a7b0-7ae5bcfb4d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:20.288933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbce93-fecd-4438-a7b0-7ae5bcfb4d85 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:20.289714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbce93-fecd-4438-a7b0-7ae5bcfb4d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:20.290119 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbce93-fecd-4438-a7b0-7ae5bcfb4d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:20.291421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbce93-fecd-4438-a7b0-7ae5bcfb4d85 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:20.304047 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 619/1211] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:20.309777 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fb086-b0c4-4667-919c-22f35f747922 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:20.422072 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fb086-b0c4-4667-919c-22f35f747922 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:20.423766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:20.460927 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be50ba-ce43-4d88-a2c2-6077f0b4fd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:20.461844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be50ba-ce43-4d88-a2c2-6077f0b4fd2e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:20.462123 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be50ba-ce43-4d88-a2c2-6077f0b4fd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:20.462424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be50ba-ce43-4d88-a2c2-6077f0b4fd2e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:20.471055 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be50ba-ce43-4d88-a2c2-6077f0b4fd2e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:20.472197 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be50ba-ce43-4d88-a2c2-6077f0b4fd2e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:20.488188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-12be50ba-ce43-4d88-a2c2-6077f0b4fd2e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 14:07:20.488188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:20.488188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:20.488188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:20.488188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:20.488188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:20.488188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:20.488188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:20.488188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:20.488188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:20.488188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:20.488188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:20.488188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:07:20.488188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:07:20.488188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:07:20.488188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:20.489311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:20.495106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:20.495106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:20.495106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:07:20.495106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:07:20.495106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:07:20.495106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:07:20.495106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:07:20.495106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:07:20.495106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 14:07:20.495106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:20.495106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 593/1212] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:20.495728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbce93-fecd-4438-a7b0-7ae5bcfb4d85 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:20.627157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbce93-fecd-4438-a7b0-7ae5bcfb4d85 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:20.664412 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f5788-71ca-46a8-8c1a-4f69f33e58a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:20.665043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f5788-71ca-46a8-8c1a-4f69f33e58a5 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:20.665351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f5788-71ca-46a8-8c1a-4f69f33e58a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:20.665622 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f5788-71ca-46a8-8c1a-4f69f33e58a5 None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:20.666537 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f5788-71ca-46a8-8c1a-4f69f33e58a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:20.666925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f5788-71ca-46a8-8c1a-4f69f33e58a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:20.668365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f5788-71ca-46a8-8c1a-4f69f33e58a5 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:20.692301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 620/1213] 10.222.0.99 () {56 vars in 1143 bytes} [Mon Jul 18 14:07:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:20.694629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be50ba-ce43-4d88-a2c2-6077f0b4fd2e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:20.811809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be50ba-ce43-4d88-a2c2-6077f0b4fd2e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:20.854088 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e837a9-6ca5-4290-ae02-396ca5a1c3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:20.854833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e837a9-6ca5-4290-ae02-396ca5a1c3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:20.855185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e837a9-6ca5-4290-ae02-396ca5a1c3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:20.855462 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e837a9-6ca5-4290-ae02-396ca5a1c3c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:20.891059 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:20.937545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e837a9-6ca5-4290-ae02-396ca5a1c3c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:20.939406 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e837a9-6ca5-4290-ae02-396ca5a1c3c1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:21.073485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 594/1214] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:07:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 14:07:21.082128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f5788-71ca-46a8-8c1a-4f69f33e58a5 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:21.104744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:21.217094 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f5788-71ca-46a8-8c1a-4f69f33e58a5 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:21.261713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecfbaa-9854-4d00-89be-6470577082d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:21.262830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecfbaa-9854-4d00-89be-6470577082d8 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:21.263236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecfbaa-9854-4d00-89be-6470577082d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:21.263656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecfbaa-9854-4d00-89be-6470577082d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:21.276779 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecfbaa-9854-4d00-89be-6470577082d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:21.278514 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecfbaa-9854-4d00-89be-6470577082d8 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:21.302561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-beecfbaa-9854-4d00-89be-6470577082d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:21.302561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:21.302561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:21.302561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:21.302561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:21.302561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:21.302561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:21.302561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:21.302561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:21.302561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:21.302561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:21.302561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:21.302561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:07:21.302561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:07:21.302561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:21.306616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:21.307820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:07:21.307820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:07:21.307820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:21.307820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:07:21.307820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 621/1215] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:21.310854 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e837a9-6ca5-4290-ae02-396ca5a1c3c1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:21.385604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:21.429355 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e837a9-6ca5-4290-ae02-396ca5a1c3c1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:21.469500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edad0a1-2a4b-4860-9cfb-1f2f8cfef1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:21.471157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edad0a1-2a4b-4860-9cfb-1f2f8cfef1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:21.471157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edad0a1-2a4b-4860-9cfb-1f2f8cfef1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:21.471157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edad0a1-2a4b-4860-9cfb-1f2f8cfef1c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:21.471723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edad0a1-2a4b-4860-9cfb-1f2f8cfef1c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:21.472033 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edad0a1-2a4b-4860-9cfb-1f2f8cfef1c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:21.473427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edad0a1-2a4b-4860-9cfb-1f2f8cfef1c8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:21.485788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 595/1216] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:21.491898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecfbaa-9854-4d00-89be-6470577082d8 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:21.570290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:21.604535 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecfbaa-9854-4d00-89be-6470577082d8 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:21.653876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2a805-23b4-4ed8-bc4c-d0e2e238b8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:21.654875 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2a805-23b4-4ed8-bc4c-d0e2e238b8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:21.655000 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2a805-23b4-4ed8-bc4c-d0e2e238b8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:21.655222 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2a805-23b4-4ed8-bc4c-d0e2e238b8f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:21.665989 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2a805-23b4-4ed8-bc4c-d0e2e238b8f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:21.667513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2a805-23b4-4ed8-bc4c-d0e2e238b8f4 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:21.687403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-f1d2a805-23b4-4ed8-bc4c-d0e2e238b8f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:07:21.687403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:21.687403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:21.687403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:21.687403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:21.687403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:21.687403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:21.687403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:21.687403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:21.687403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:21.687403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:21.687403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:21.687403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:07:21.687403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:07:21.687403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:21.688830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:21.690245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:07:21.690245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:07:21.690245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:07:21.690245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:07:21.690245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:07:21.690245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:07:21.690245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:07:21.690245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:07:21.690245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 622/1217] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:07:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:21.695125 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edad0a1-2a4b-4860-9cfb-1f2f8cfef1c8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:21.827208 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edad0a1-2a4b-4860-9cfb-1f2f8cfef1c8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:21.861457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:21.880443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4166a-97a0-404b-9344-e973bddd9b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:21.881109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4166a-97a0-404b-9344-e973bddd9b41 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:21.881388 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4166a-97a0-404b-9344-e973bddd9b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:21.881659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4166a-97a0-404b-9344-e973bddd9b41 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:21.882483 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4166a-97a0-404b-9344-e973bddd9b41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:21.882790 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4166a-97a0-404b-9344-e973bddd9b41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:21.884236 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4166a-97a0-404b-9344-e973bddd9b41 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:21.899713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 596/1218] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:07:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:21.906850 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2a805-23b4-4ed8-bc4c-d0e2e238b8f4 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:22.034014 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2a805-23b4-4ed8-bc4c-d0e2e238b8f4 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:22.067898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:22.074744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd620b-2d6d-42f4-b07b-fbc82d43a235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:22.075665 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd620b-2d6d-42f4-b07b-fbc82d43a235 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:22.075961 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd620b-2d6d-42f4-b07b-fbc82d43a235 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:22.076245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd620b-2d6d-42f4-b07b-fbc82d43a235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:22.077334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd620b-2d6d-42f4-b07b-fbc82d43a235 None admin] RBAC: Adding query filter params (role.id=ea9f1b43d91c4665ba5af180f55c663c, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=92b73e1a514148b19bb6a1d2a39e32cc) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:22.077715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd620b-2d6d-42f4-b07b-fbc82d43a235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:22.079159 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd620b-2d6d-42f4-b07b-fbc82d43a235 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:22.085347 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 623/1219] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:07:21 2022] GET /identity/v3/role_assignments?user.id=92b73e1a514148b19bb6a1d2a39e32cc&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=ea9f1b43d91c4665ba5af180f55c663c => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:24.115079 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39bca3-ee48-4238-8f95-be73e33e9507 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:24.115743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39bca3-ee48-4238-8f95-be73e33e9507 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:24.115743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39bca3-ee48-4238-8f95-be73e33e9507 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:24.117130 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 597/1220] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:07:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:07:24.122655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9c2ca-32e3-4ef2-acbe-331628b469a8 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:24.123125 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9c2ca-32e3-4ef2-acbe-331628b469a8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:24.123223 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9c2ca-32e3-4ef2-acbe-331628b469a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:24.142982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-f6d9c2ca-32e3-4ef2-acbe-331628b469a8 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:24.144307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f6d9c2ca-32e3-4ef2-acbe-331628b469a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:24.223172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 624/1221] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:07:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 14:07:24.247433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39bca3-ee48-4238-8f95-be73e33e9507 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:24.376203 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39bca3-ee48-4238-8f95-be73e33e9507 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:24.412977 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5653a-ab52-4674-89cd-760dc04d9402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:24.413776 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5653a-ab52-4674-89cd-760dc04d9402 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:24.414062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5653a-ab52-4674-89cd-760dc04d9402 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:24.414340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5653a-ab52-4674-89cd-760dc04d9402 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:24.426124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5653a-ab52-4674-89cd-760dc04d9402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:07:24.433907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-47e5653a-ab52-4674-89cd-760dc04d9402 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:07:24.433907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:24.433907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:24.433907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:24.433907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:24.433907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:24.433907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:24.433907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:24.433907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:24.433907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:24.433907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:24.433907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:24.433907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:07:24.433907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:07:24.433907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:07:24.433907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:07:24.435089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:07:24.435089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:07:24.435089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:07:24.435089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:07:24.435089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:24.435089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:24.435089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:24.435089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:24.435089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:24.435089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:24.435089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:24.435089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:24.435089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:24.435089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:24.435089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:24.435089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:24.435987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:24.435987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:24.435987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:24.435987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:24.435987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:07:24.435987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:07:24.435987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:07:24.435987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:07:24.435987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:07:24.435987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:07:24.435987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:07:24.435987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:24.435987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 598/1222] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:07:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 14:07:24.441596 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9c2ca-32e3-4ef2-acbe-331628b469a8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:24.556967 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9c2ca-32e3-4ef2-acbe-331628b469a8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:24.582855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:24.593884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8142647-ed34-4217-8254-2086de99d70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:24.594605 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8142647-ed34-4217-8254-2086de99d70a None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:24.594875 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8142647-ed34-4217-8254-2086de99d70a None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:24.595149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8142647-ed34-4217-8254-2086de99d70a None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:24.595939 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8142647-ed34-4217-8254-2086de99d70a None admin] RBAC: Adding query filter params (name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:24.596247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8142647-ed34-4217-8254-2086de99d70a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:24.597617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8142647-ed34-4217-8254-2086de99d70a None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:24.605951 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 625/1223] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:07:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:24.611911 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5653a-ab52-4674-89cd-760dc04d9402 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:24.662978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:24.723721 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5653a-ab52-4674-89cd-760dc04d9402 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:24.761361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5ba36-eecc-45c0-833e-b6fe3a71b5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:24.762339 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5ba36-eecc-45c0-833e-b6fe3a71b5fa None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:24.762768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5ba36-eecc-45c0-833e-b6fe3a71b5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:24.763083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5ba36-eecc-45c0-833e-b6fe3a71b5fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:24.775292 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5ba36-eecc-45c0-833e-b6fe3a71b5fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:24.776896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5ba36-eecc-45c0-833e-b6fe3a71b5fa None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:24.793746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-61a5ba36-eecc-45c0-833e-b6fe3a71b5fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:24.793746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:24.793746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:24.793746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:24.793746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:24.793746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:24.793746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:24.793746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:24.793746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:24.793746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:24.793746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:24.793746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:24.793746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:07:24.793746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:07:24.793746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:24.795094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:24.796041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:07:24.796041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:07:24.796041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:24.796041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:24.796041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 599/1224] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:24.801207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8142647-ed34-4217-8254-2086de99d70a None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:24.911721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8142647-ed34-4217-8254-2086de99d70a None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:24.946279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201863e8-3936-40e4-9b41-f9148cc7c760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:24.947400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201863e8-3936-40e4-9b41-f9148cc7c760 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:24.947400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201863e8-3936-40e4-9b41-f9148cc7c760 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:24.947645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201863e8-3936-40e4-9b41-f9148cc7c760 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:24.948158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201863e8-3936-40e4-9b41-f9148cc7c760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:24.948467 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201863e8-3936-40e4-9b41-f9148cc7c760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:24.949922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201863e8-3936-40e4-9b41-f9148cc7c760 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:24.962882 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 626/1225] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:24.970060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5ba36-eecc-45c0-833e-b6fe3a71b5fa None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:25.068448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:25.075411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5ba36-eecc-45c0-833e-b6fe3a71b5fa None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:25.112926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe4b86-c378-4b31-8fa5-2cc9279d9abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:25.113852 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4b86-c378-4b31-8fa5-2cc9279d9abc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:25.114147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4b86-c378-4b31-8fa5-2cc9279d9abc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:25.114515 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe4b86-c378-4b31-8fa5-2cc9279d9abc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:25.123126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe4b86-c378-4b31-8fa5-2cc9279d9abc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:25.125380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe4b86-c378-4b31-8fa5-2cc9279d9abc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:25.141677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-dffe4b86-c378-4b31-8fa5-2cc9279d9abc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 14:07:25.141677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:25.141677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:25.141677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:25.141677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:25.141677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:25.141677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:25.141677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:25.141677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:25.141677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:25.141677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:25.141677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:25.141677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:07:25.141677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:07:25.141677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:07:25.141677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:25.143150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:25.146916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:25.146916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:25.146916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:07:25.146916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:07:25.146916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:07:25.146916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:07:25.146916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:07:25.146916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:07:25.146916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 14:07:25.146916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:25.146916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 600/1226] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:25.149690 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201863e8-3936-40e4-9b41-f9148cc7c760 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:25.200306 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:25.258815 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201863e8-3936-40e4-9b41-f9148cc7c760 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:25.298368 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e08765-1abe-4d58-9ab8-6fb3a061f08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:25.299070 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e08765-1abe-4d58-9ab8-6fb3a061f08c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:25.299356 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e08765-1abe-4d58-9ab8-6fb3a061f08c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:25.299634 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e08765-1abe-4d58-9ab8-6fb3a061f08c None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:25.300488 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e08765-1abe-4d58-9ab8-6fb3a061f08c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:25.300802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e08765-1abe-4d58-9ab8-6fb3a061f08c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:25.302253 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e08765-1abe-4d58-9ab8-6fb3a061f08c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:25.322590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 627/1227] 10.222.0.99 () {56 vars in 1143 bytes} [Mon Jul 18 14:07:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:25.329549 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe4b86-c378-4b31-8fa5-2cc9279d9abc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:25.465358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe4b86-c378-4b31-8fa5-2cc9279d9abc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:25.519112 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423c7cb-abff-4e65-85a0-20b9dd133f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:25.520086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423c7cb-abff-4e65-85a0-20b9dd133f70 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:25.520389 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423c7cb-abff-4e65-85a0-20b9dd133f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:25.520709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423c7cb-abff-4e65-85a0-20b9dd133f70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:25.535668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423c7cb-abff-4e65-85a0-20b9dd133f70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:25.537313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423c7cb-abff-4e65-85a0-20b9dd133f70 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:25.556209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-8423c7cb-abff-4e65-85a0-20b9dd133f70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:25.556209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:25.556209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:25.556209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:25.556209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:25.556209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:25.556209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:25.556209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:25.556209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:25.556209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:25.556209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:25.556209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:25.556209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:07:25.556209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:07:25.556209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:25.557283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:25.558210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:07:25.558210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:07:25.558210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:25.558210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:25.558606 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 601/1228] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:25.564696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e08765-1abe-4d58-9ab8-6fb3a061f08c None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:25.679692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e08765-1abe-4d58-9ab8-6fb3a061f08c None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:25.682417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:25.720270 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879f5f6-2aa1-4586-b7e4-34ba98540f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:25.721105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879f5f6-2aa1-4586-b7e4-34ba98540f4c None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:25.721466 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879f5f6-2aa1-4586-b7e4-34ba98540f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:25.721807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879f5f6-2aa1-4586-b7e4-34ba98540f4c None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:25.722716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879f5f6-2aa1-4586-b7e4-34ba98540f4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:25.723029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879f5f6-2aa1-4586-b7e4-34ba98540f4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:25.724748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879f5f6-2aa1-4586-b7e4-34ba98540f4c None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:25.742359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 628/1229] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:25.746084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423c7cb-abff-4e65-85a0-20b9dd133f70 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:25.758762 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:25.869483 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423c7cb-abff-4e65-85a0-20b9dd133f70 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:25.908418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4daa1-b841-4f7d-addc-ec230c51ac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:25.909375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4daa1-b841-4f7d-addc-ec230c51ac70 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:25.909750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4daa1-b841-4f7d-addc-ec230c51ac70 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:25.910173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4daa1-b841-4f7d-addc-ec230c51ac70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:25.917562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4daa1-b841-4f7d-addc-ec230c51ac70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:25.919417 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4daa1-b841-4f7d-addc-ec230c51ac70 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:25.936468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f7a4daa1-b841-4f7d-addc-ec230c51ac70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:07:25.936468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:25.936468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:25.936468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:25.936468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:25.936468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:25.936468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:25.936468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:25.936468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:25.936468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:25.936468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:25.936468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:25.936468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:07:25.936468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:07:25.936468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:25.937681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:25.938763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:07:25.938763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:07:25.938763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:07:25.938763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:07:25.938763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:07:25.938763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:07:25.938763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:07:25.938763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:25.938763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 602/1230] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:07:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:25.944467 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879f5f6-2aa1-4586-b7e4-34ba98540f4c None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:26.062683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879f5f6-2aa1-4586-b7e4-34ba98540f4c None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:26.103094 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090b3ee-eacd-4315-ab54-ddf6ba9ce17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:26.103970 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090b3ee-eacd-4315-ab54-ddf6ba9ce17f None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:26.104336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090b3ee-eacd-4315-ab54-ddf6ba9ce17f None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:26.104755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090b3ee-eacd-4315-ab54-ddf6ba9ce17f None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:26.105725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090b3ee-eacd-4315-ab54-ddf6ba9ce17f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:26.106273 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090b3ee-eacd-4315-ab54-ddf6ba9ce17f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:26.108119 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090b3ee-eacd-4315-ab54-ddf6ba9ce17f None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:26.120980 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 629/1231] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:07:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:26.127816 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4daa1-b841-4f7d-addc-ec230c51ac70 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:26.201378 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:26.236594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4daa1-b841-4f7d-addc-ec230c51ac70 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:26.275997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab2cd3-0151-41e7-b357-570fedec74f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:26.276998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab2cd3-0151-41e7-b357-570fedec74f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:26.277444 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab2cd3-0151-41e7-b357-570fedec74f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:26.277868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab2cd3-0151-41e7-b357-570fedec74f7 None admin] PATH_INFO: `/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/92b73e1a514148b19bb6a1d2a39e32cc/roles/ea9f1b43d91c4665ba5af180f55c663c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:26.294297 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab2cd3-0151-41e7-b357-570fedec74f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=50b78e16c86b4e6cac3a725f536a8274, user_id=92b73e1a514148b19bb6a1d2a39e32cc, role_id=ea9f1b43d91c4665ba5af180f55c663c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:26.296913 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab2cd3-0151-41e7-b357-570fedec74f7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:26.310605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 603/1232] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:07:26 2022] PUT /identity/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/92b73e1a514148b19bb6a1d2a39e32cc/roles/ea9f1b43d91c4665ba5af180f55c663c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:28.475371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537f22b-ed80-4188-9849-2b349c5312b2 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:28.475894 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537f22b-ed80-4188-9849-2b349c5312b2 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:28.475894 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537f22b-ed80-4188-9849-2b349c5312b2 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:28.477427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 630/1233] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:07:28.483484 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dffaf2-3578-4b75-a382-fedc8146b114 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:28.483958 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dffaf2-3578-4b75-a382-fedc8146b114 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:28.484206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dffaf2-3578-4b75-a382-fedc8146b114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:28.504178 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-02dffaf2-3578-4b75-a382-fedc8146b114 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:28.505543 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-02dffaf2-3578-4b75-a382-fedc8146b114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:28.578456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 604/1234] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:07:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:07:28.604711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537f22b-ed80-4188-9849-2b349c5312b2 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:28.632655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:28.713457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537f22b-ed80-4188-9849-2b349c5312b2 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:28.751945 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d7340-6945-402b-bd54-75f3cb4707a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:28.752956 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d7340-6945-402b-bd54-75f3cb4707a4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:28.753235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d7340-6945-402b-bd54-75f3cb4707a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:28.753586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d7340-6945-402b-bd54-75f3cb4707a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:28.765440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d7340-6945-402b-bd54-75f3cb4707a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:07:28.774453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-9d0d7340-6945-402b-bd54-75f3cb4707a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:07:28.774453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:28.774453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:28.774453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:28.774453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:28.774453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:28.774453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:28.774453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:28.774453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:28.774453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:28.774453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:28.774453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:28.774453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:07:28.774453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:07:28.774453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:07:28.774453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:07:28.775547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:07:28.775547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:07:28.775547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:07:28.775547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:07:28.775547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:28.775547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:28.775547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:28.775547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:28.775547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:28.775547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:28.775547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:28.775547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:28.775547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:28.775547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:28.775547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:28.775547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:28.776421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:28.776421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:28.776421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:28.776421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:28.776421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:07:28.776421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:07:28.776421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:07:28.776421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:07:28.776421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:07:28.776421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:07:28.776421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 14:07:28.776421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:07:28.776421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 631/1235] 10.222.0.99 () {56 vars in 1102 bytes} [Mon Jul 18 14:07:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:28.782132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dffaf2-3578-4b75-a382-fedc8146b114 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:28.831008 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:28.899538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dffaf2-3578-4b75-a382-fedc8146b114 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:28.935083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25821a18-4b02-4fff-a00e-a6b57a9e8139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:28.935849 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25821a18-4b02-4fff-a00e-a6b57a9e8139 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:28.936198 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25821a18-4b02-4fff-a00e-a6b57a9e8139 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:28.936538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25821a18-4b02-4fff-a00e-a6b57a9e8139 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:28.937360 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25821a18-4b02-4fff-a00e-a6b57a9e8139 None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:28.937666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25821a18-4b02-4fff-a00e-a6b57a9e8139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:28.939081 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25821a18-4b02-4fff-a00e-a6b57a9e8139 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:28.947218 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 605/1236] 10.222.0.99 () {56 vars in 1103 bytes} [Mon Jul 18 14:07:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:28.954025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d7340-6945-402b-bd54-75f3cb4707a4 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:29.049866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:29.070830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d7340-6945-402b-bd54-75f3cb4707a4 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:29.108267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c2c9a-5b01-4f1d-9825-053627fa8feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:29.109062 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c2c9a-5b01-4f1d-9825-053627fa8feb None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:29.109348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c2c9a-5b01-4f1d-9825-053627fa8feb None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:29.109618 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c2c9a-5b01-4f1d-9825-053627fa8feb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:29.122414 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c2c9a-5b01-4f1d-9825-053627fa8feb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:29.124371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c2c9a-5b01-4f1d-9825-053627fa8feb None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:29.146138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-310c2c9a-5b01-4f1d-9825-053627fa8feb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:29.146138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:29.146138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:29.146138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:29.146138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:29.146138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:29.146138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:29.146138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:29.146138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:29.146138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:29.146138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:29.146138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:29.146138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:07:29.146138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:07:29.146138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:29.147186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:29.149047 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:07:29.149047 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:07:29.149047 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:29.149047 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:07:29.149047 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 632/1237] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:29.153983 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25821a18-4b02-4fff-a00e-a6b57a9e8139 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:29.267562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25821a18-4b02-4fff-a00e-a6b57a9e8139 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:29.277154 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:29.305453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ac46e-55ac-49fc-bdea-1fd9dff644f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:29.306041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ac46e-55ac-49fc-bdea-1fd9dff644f8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:29.306323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ac46e-55ac-49fc-bdea-1fd9dff644f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:29.306630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ac46e-55ac-49fc-bdea-1fd9dff644f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:29.307361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ac46e-55ac-49fc-bdea-1fd9dff644f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:29.307667 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ac46e-55ac-49fc-bdea-1fd9dff644f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:29.309222 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ac46e-55ac-49fc-bdea-1fd9dff644f8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:29.321961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 606/1238] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:29.328227 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c2c9a-5b01-4f1d-9825-053627fa8feb None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:29.437484 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c2c9a-5b01-4f1d-9825-053627fa8feb None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:29.477325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73915fd7-837b-49fd-a96c-3d4a568c97a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:29.478183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73915fd7-837b-49fd-a96c-3d4a568c97a4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:29.478534 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73915fd7-837b-49fd-a96c-3d4a568c97a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:29.478810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73915fd7-837b-49fd-a96c-3d4a568c97a4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:29.482371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:29.488089 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73915fd7-837b-49fd-a96c-3d4a568c97a4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:29.489574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73915fd7-837b-49fd-a96c-3d4a568c97a4 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:29.504950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-73915fd7-837b-49fd-a96c-3d4a568c97a4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 14:07:29.504950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:29.504950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:29.504950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:29.504950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:29.504950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:29.504950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:29.504950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:29.504950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:29.504950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:29.504950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:29.504950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:29.504950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:07:29.504950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:07:29.504950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:07:29.504950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:29.506152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:29.507363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:29.507363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:29.507363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:07:29.507363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:07:29.507363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:07:29.507363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:07:29.507363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:07:29.507363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:07:29.507363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 14:07:29.507363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:07:29.507363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 633/1239] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:29.514352 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ac46e-55ac-49fc-bdea-1fd9dff644f8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:29.633253 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ac46e-55ac-49fc-bdea-1fd9dff644f8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:29.672739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86212b-0558-45b5-98a6-42369cf8525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:29.673405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86212b-0558-45b5-98a6-42369cf8525f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:29.673698 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86212b-0558-45b5-98a6-42369cf8525f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:29.673951 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86212b-0558-45b5-98a6-42369cf8525f None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:29.674859 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86212b-0558-45b5-98a6-42369cf8525f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:29.675169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86212b-0558-45b5-98a6-42369cf8525f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:29.676607 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86212b-0558-45b5-98a6-42369cf8525f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:29.696101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 607/1240] 10.222.0.99 () {56 vars in 1143 bytes} [Mon Jul 18 14:07:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:29.703032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73915fd7-837b-49fd-a96c-3d4a568c97a4 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:29.816316 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73915fd7-837b-49fd-a96c-3d4a568c97a4 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:29.873876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf715b-87cf-4869-beb7-691befef7a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:29.874640 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf715b-87cf-4869-beb7-691befef7a0b None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:29.874881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf715b-87cf-4869-beb7-691befef7a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:29.875160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf715b-87cf-4869-beb7-691befef7a0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:29.945883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:29.952966 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf715b-87cf-4869-beb7-691befef7a0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:29.954443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf715b-87cf-4869-beb7-691befef7a0b None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:30.062494 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 634/1241] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:07:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 14:07:30.068332 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86212b-0558-45b5-98a6-42369cf8525f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:30.099592 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:30.184365 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86212b-0558-45b5-98a6-42369cf8525f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:30.219116 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5eeec-1ba5-4e73-b7e1-481c6be786b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:30.220003 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5eeec-1ba5-4e73-b7e1-481c6be786b6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:30.220402 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5eeec-1ba5-4e73-b7e1-481c6be786b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:30.220695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5eeec-1ba5-4e73-b7e1-481c6be786b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:30.232735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5eeec-1ba5-4e73-b7e1-481c6be786b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:30.234840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5eeec-1ba5-4e73-b7e1-481c6be786b6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:30.255617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f9c5eeec-1ba5-4e73-b7e1-481c6be786b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:30.255617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:30.255617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:30.255617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:30.255617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:30.255617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:30.255617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:30.255617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:30.255617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:30.255617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:30.255617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:30.255617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:30.255617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:07:30.255617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:07:30.255617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:30.256808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:30.258020 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:07:30.258020 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:07:30.258020 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:30.258020 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:30.258020 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 608/1242] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:30.263044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf715b-87cf-4869-beb7-691befef7a0b None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:30.378081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:30.384850 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf715b-87cf-4869-beb7-691befef7a0b None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:30.424902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbc9a7-4767-4b92-bae5-7cda089d6b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:30.425568 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbc9a7-4767-4b92-bae5-7cda089d6b64 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:30.425884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbc9a7-4767-4b92-bae5-7cda089d6b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:30.426163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbc9a7-4767-4b92-bae5-7cda089d6b64 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:30.426930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbc9a7-4767-4b92-bae5-7cda089d6b64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:30.427235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbc9a7-4767-4b92-bae5-7cda089d6b64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:30.428687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbc9a7-4767-4b92-bae5-7cda089d6b64 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:30.441813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 635/1243] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:30.448519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5eeec-1ba5-4e73-b7e1-481c6be786b6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:30.537661 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:30.571567 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5eeec-1ba5-4e73-b7e1-481c6be786b6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:30.613027 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79c209-9d93-4354-9041-83356fff516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:30.613807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79c209-9d93-4354-9041-83356fff516f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:30.614089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79c209-9d93-4354-9041-83356fff516f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:30.614366 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79c209-9d93-4354-9041-83356fff516f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:30.621481 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79c209-9d93-4354-9041-83356fff516f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:30.623021 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79c209-9d93-4354-9041-83356fff516f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:30.638022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-9f79c209-9d93-4354-9041-83356fff516f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:07:30.638022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:30.638022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:30.638022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:30.638022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:30.638022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:30.638022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:30.638022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:30.638022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:30.638022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:30.638022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:30.638022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:30.638022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:07:30.638022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:07:30.638022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:30.639044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:30.639942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:07:30.639942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:07:30.639942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:07:30.639942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:07:30.639942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:07:30.639942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:07:30.639942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:07:30.639942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:30.639942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 609/1244] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:07:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:30.645133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbc9a7-4767-4b92-bae5-7cda089d6b64 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:30.753145 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbc9a7-4767-4b92-bae5-7cda089d6b64 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:30.786622 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7198ba5-1fe1-4571-aedf-6bf4a49f815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:30.787492 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7198ba5-1fe1-4571-aedf-6bf4a49f815e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:30.787949 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7198ba5-1fe1-4571-aedf-6bf4a49f815e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:30.788174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7198ba5-1fe1-4571-aedf-6bf4a49f815e None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:30.788957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7198ba5-1fe1-4571-aedf-6bf4a49f815e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:30.789263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7198ba5-1fe1-4571-aedf-6bf4a49f815e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:30.790725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7198ba5-1fe1-4571-aedf-6bf4a49f815e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:30.804883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 636/1245] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:07:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:07:30.811362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79c209-9d93-4354-9041-83356fff516f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:30.925180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79c209-9d93-4354-9041-83356fff516f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:30.960581 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0e204-6e0d-450f-8710-0ab5803dfd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:30.961277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0e204-6e0d-450f-8710-0ab5803dfd2b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:30.961561 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0e204-6e0d-450f-8710-0ab5803dfd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:30.961835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0e204-6e0d-450f-8710-0ab5803dfd2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:30.962722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0e204-6e0d-450f-8710-0ab5803dfd2b None admin] RBAC: Adding query filter params (role.id=ea9f1b43d91c4665ba5af180f55c663c, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=92b73e1a514148b19bb6a1d2a39e32cc) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:30.963033 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0e204-6e0d-450f-8710-0ab5803dfd2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:30.964523 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0e204-6e0d-450f-8710-0ab5803dfd2b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:30.976543 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 610/1246] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:07:30 2022] GET /identity/v3/role_assignments?user.id=92b73e1a514148b19bb6a1d2a39e32cc&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=ea9f1b43d91c4665ba5af180f55c663c => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:33.096920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb52fff-e177-4c83-bc4e-baaff196fe42 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:33.097537 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb52fff-e177-4c83-bc4e-baaff196fe42 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:33.097537 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb52fff-e177-4c83-bc4e-baaff196fe42 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:33.098883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 637/1247] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:07:33.104417 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf96a5-e148-4366-ba09-3c5387bafd32 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:33.104998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf96a5-e148-4366-ba09-3c5387bafd32 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:33.104998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf96a5-e148-4366-ba09-3c5387bafd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:33.111109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:33.125519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-efcf96a5-e148-4366-ba09-3c5387bafd32 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:33.126757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-efcf96a5-e148-4366-ba09-3c5387bafd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:33.201039 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 611/1248] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:07:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:07:33.227250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb52fff-e177-4c83-bc4e-baaff196fe42 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:33.246290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:33.344885 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb52fff-e177-4c83-bc4e-baaff196fe42 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:33.389286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216610a2-38ce-44ad-b3c6-d952b5f958eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:33.390144 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216610a2-38ce-44ad-b3c6-d952b5f958eb None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:33.390468 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216610a2-38ce-44ad-b3c6-d952b5f958eb None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:33.390755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216610a2-38ce-44ad-b3c6-d952b5f958eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:33.403613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216610a2-38ce-44ad-b3c6-d952b5f958eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:07:33.412217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-216610a2-38ce-44ad-b3c6-d952b5f958eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:07:33.412217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:33.412217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:33.412217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:33.412217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:33.412217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:33.412217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:33.412217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:33.412217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:33.412217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:33.412217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:33.412217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:33.412217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:07:33.412217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:07:33.412217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:07:33.412217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:07:33.414197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:07:33.414197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:07:33.414197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:07:33.414197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:07:33.414197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:33.414197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:33.414197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:33.414197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:33.414197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:33.414197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:33.414197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:33.414197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:33.414197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:33.414197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:33.414197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:33.414197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:33.416099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:33.416099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:33.416099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:33.416099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:33.416099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:07:33.416099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:07:33.416099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:07:33.416099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:07:33.416099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:07:33.416099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:07:33.416099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:07:33.416099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:07:33.416099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 638/1249] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:07:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:33.421120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf96a5-e148-4366-ba09-3c5387bafd32 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:33.536724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf96a5-e148-4366-ba09-3c5387bafd32 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:33.570425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:33.576026 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a5f6b-290e-4f43-a7e4-223627704de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:33.576929 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a5f6b-290e-4f43-a7e4-223627704de3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:33.577441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a5f6b-290e-4f43-a7e4-223627704de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:33.577759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a5f6b-290e-4f43-a7e4-223627704de3 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:33.578549 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a5f6b-290e-4f43-a7e4-223627704de3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:33.578880 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a5f6b-290e-4f43-a7e4-223627704de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:33.580313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a5f6b-290e-4f43-a7e4-223627704de3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:33.589093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 612/1250] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:07:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:33.595067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216610a2-38ce-44ad-b3c6-d952b5f958eb None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:33.680309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:33.708642 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216610a2-38ce-44ad-b3c6-d952b5f958eb None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:33.746659 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de851560-7c69-439c-8c0e-3cc4be0c8823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:33.747451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de851560-7c69-439c-8c0e-3cc4be0c8823 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:33.747786 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de851560-7c69-439c-8c0e-3cc4be0c8823 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:33.748176 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de851560-7c69-439c-8c0e-3cc4be0c8823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:33.761354 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de851560-7c69-439c-8c0e-3cc4be0c8823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:33.762901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de851560-7c69-439c-8c0e-3cc4be0c8823 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:33.782298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-de851560-7c69-439c-8c0e-3cc4be0c8823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:33.782298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:33.782298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:33.782298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:33.782298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:33.782298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:33.782298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:33.782298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:33.782298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:33.782298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:33.782298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:33.782298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:33.782298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:07:33.782298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:07:33.782298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:33.783495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:33.784585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:07:33.784585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:07:33.784585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:33.784585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:07:33.784585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 639/1251] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:33.789518 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a5f6b-290e-4f43-a7e4-223627704de3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:33.904503 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a5f6b-290e-4f43-a7e4-223627704de3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:33.945594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fba527-011f-4245-bde8-a79566616357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:33.946549 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fba527-011f-4245-bde8-a79566616357 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:33.946845 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fba527-011f-4245-bde8-a79566616357 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:33.947206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fba527-011f-4245-bde8-a79566616357 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:33.948051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fba527-011f-4245-bde8-a79566616357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:33.948442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fba527-011f-4245-bde8-a79566616357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:33.950083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fba527-011f-4245-bde8-a79566616357 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:33.965174 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 613/1252] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:33.971631 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de851560-7c69-439c-8c0e-3cc4be0c8823 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:34.082259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de851560-7c69-439c-8c0e-3cc4be0c8823 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:34.110155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:34.121439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbe7d3-1e5b-40cf-a8a5-0c31981d5fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:34.122279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbe7d3-1e5b-40cf-a8a5-0c31981d5fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:34.122598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbe7d3-1e5b-40cf-a8a5-0c31981d5fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:34.122922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbe7d3-1e5b-40cf-a8a5-0c31981d5fa3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:34.131597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbe7d3-1e5b-40cf-a8a5-0c31981d5fa3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:34.135320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbe7d3-1e5b-40cf-a8a5-0c31981d5fa3 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:34.150728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-2abbe7d3-1e5b-40cf-a8a5-0c31981d5fa3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 14:07:34.150728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:34.150728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:34.150728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:34.150728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:34.150728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:34.150728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:34.150728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:34.150728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:34.150728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:34.150728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:34.150728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:34.150728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:07:34.150728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:07:34.150728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:07:34.150728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:34.151773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:34.152792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:34.152792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:34.152792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:07:34.152792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:07:34.152792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:07:34.152792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:07:34.152792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:07:34.152792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:07:34.152792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 14:07:34.152792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:07:34.152792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 640/1253] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:34.158159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fba527-011f-4245-bde8-a79566616357 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:34.222146 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:34.276131 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fba527-011f-4245-bde8-a79566616357 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:34.325543 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34d042-7136-4e81-a00f-5479f2499d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:34.326272 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34d042-7136-4e81-a00f-5479f2499d9b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:34.326596 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34d042-7136-4e81-a00f-5479f2499d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:34.326871 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34d042-7136-4e81-a00f-5479f2499d9b None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:34.327820 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34d042-7136-4e81-a00f-5479f2499d9b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:34.328121 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34d042-7136-4e81-a00f-5479f2499d9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:34.329586 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34d042-7136-4e81-a00f-5479f2499d9b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:34.350519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 614/1254] 10.222.0.99 () {56 vars in 1143 bytes} [Mon Jul 18 14:07:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:34.356649 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbe7d3-1e5b-40cf-a8a5-0c31981d5fa3 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:34.487201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbe7d3-1e5b-40cf-a8a5-0c31981d5fa3 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:34.525105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923b978-769a-49f0-afe8-4f34c9e152ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:34.525766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923b978-769a-49f0-afe8-4f34c9e152ed None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:34.526049 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923b978-769a-49f0-afe8-4f34c9e152ed None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:34.526327 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923b978-769a-49f0-afe8-4f34c9e152ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:34.597323 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:34.616035 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923b978-769a-49f0-afe8-4f34c9e152ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:34.617819 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923b978-769a-49f0-afe8-4f34c9e152ed None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:34.732981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 641/1255] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:07:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 14:07:34.740103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34d042-7136-4e81-a00f-5479f2499d9b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:34.852255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34d042-7136-4e81-a00f-5479f2499d9b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:34.870793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:34.896225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28da4c-9529-46db-a825-35ad3a04a92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:34.897249 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28da4c-9529-46db-a825-35ad3a04a92a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:34.897648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28da4c-9529-46db-a825-35ad3a04a92a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:34.897984 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28da4c-9529-46db-a825-35ad3a04a92a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:34.912109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28da4c-9529-46db-a825-35ad3a04a92a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:34.913669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28da4c-9529-46db-a825-35ad3a04a92a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:34.935605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-8d28da4c-9529-46db-a825-35ad3a04a92a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:34.935605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:34.935605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:34.935605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:34.935605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:34.935605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:34.935605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:34.935605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:34.935605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:34.935605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:34.935605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:34.935605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:34.935605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:07:34.935605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:07:34.935605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:34.936811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:34.937788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:07:34.937788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:07:34.937788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:34.937788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:34.937788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 615/1256] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:34.943217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923b978-769a-49f0-afe8-4f34c9e152ed None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:35.046879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:35.064289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923b978-769a-49f0-afe8-4f34c9e152ed None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:35.103003 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420454a3-075a-401e-99b8-99b63662eaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:35.103802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420454a3-075a-401e-99b8-99b63662eaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:35.104177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420454a3-075a-401e-99b8-99b63662eaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:35.104456 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420454a3-075a-401e-99b8-99b63662eaa9 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:35.105313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420454a3-075a-401e-99b8-99b63662eaa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:35.105684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420454a3-075a-401e-99b8-99b63662eaa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:35.107126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420454a3-075a-401e-99b8-99b63662eaa9 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:35.120261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 642/1257] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:07:35.126605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28da4c-9529-46db-a825-35ad3a04a92a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:35.241402 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28da4c-9529-46db-a825-35ad3a04a92a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:35.281076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb76adb-ec7c-494d-b115-d2b7d87eb41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:35.281870 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb76adb-ec7c-494d-b115-d2b7d87eb41d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:35.282148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb76adb-ec7c-494d-b115-d2b7d87eb41d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:35.282449 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb76adb-ec7c-494d-b115-d2b7d87eb41d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:35.289947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb76adb-ec7c-494d-b115-d2b7d87eb41d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:35.291474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb76adb-ec7c-494d-b115-d2b7d87eb41d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:35.305722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-cdb76adb-ec7c-494d-b115-d2b7d87eb41d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:07:35.305722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:35.305722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:35.305722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:35.305722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:35.305722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:35.305722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:35.305722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:35.305722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:35.305722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:35.305722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:35.305722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:35.305722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:07:35.305722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:07:35.305722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:35.306718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:35.307948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:07:35.307948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:07:35.307948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:07:35.307948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:07:35.307948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:07:35.307948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:07:35.307948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:07:35.307948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:35.307948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 616/1258] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:07:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:35.313175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420454a3-075a-401e-99b8-99b63662eaa9 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:35.426902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420454a3-075a-401e-99b8-99b63662eaa9 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:35.462224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dc431-0a23-4d68-a436-b3f76e30cf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:35.462916 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dc431-0a23-4d68-a436-b3f76e30cf7f None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:35.463192 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dc431-0a23-4d68-a436-b3f76e30cf7f None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:35.463463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dc431-0a23-4d68-a436-b3f76e30cf7f None admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:35.464273 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dc431-0a23-4d68-a436-b3f76e30cf7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:35.464560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dc431-0a23-4d68-a436-b3f76e30cf7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:35.466421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dc431-0a23-4d68-a436-b3f76e30cf7f None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:35.480537 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 643/1259] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:07:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:35.486907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb76adb-ec7c-494d-b115-d2b7d87eb41d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:35.515869 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:35.602184 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb76adb-ec7c-494d-b115-d2b7d87eb41d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:35.640113 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e05d3-cdfa-4183-be7e-9c1177ce3699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:35.640799 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e05d3-cdfa-4183-be7e-9c1177ce3699 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:35.641156 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e05d3-cdfa-4183-be7e-9c1177ce3699 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:35.641445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e05d3-cdfa-4183-be7e-9c1177ce3699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:35.642339 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e05d3-cdfa-4183-be7e-9c1177ce3699 None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=92b73e1a514148b19bb6a1d2a39e32cc) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:35.642694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e05d3-cdfa-4183-be7e-9c1177ce3699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:35.644125 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e05d3-cdfa-4183-be7e-9c1177ce3699 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:35.650095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 617/1260] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:07:35 2022] GET /identity/v3/role_assignments?user.id=92b73e1a514148b19bb6a1d2a39e32cc&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:37.655804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba6b19-f651-4d40-b0b3-2e8cb4a856cd None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:37.656402 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba6b19-f651-4d40-b0b3-2e8cb4a856cd None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:37.656402 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba6b19-f651-4d40-b0b3-2e8cb4a856cd None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:37.657713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 644/1261] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:07:37.663966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab905e4-63a9-4665-aeae-725f6982db17 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:37.664735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab905e4-63a9-4665-aeae-725f6982db17 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:37.664991 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab905e4-63a9-4665-aeae-725f6982db17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:37.690278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6ab905e4-63a9-4665-aeae-725f6982db17 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:37.691520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6ab905e4-63a9-4665-aeae-725f6982db17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:37.764893 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 618/1262] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:07:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:07:37.787861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba6b19-f651-4d40-b0b3-2e8cb4a856cd None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:37.800450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:37.914438 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba6b19-f651-4d40-b0b3-2e8cb4a856cd None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:37.951437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a63bb-0849-4fe7-8831-cb4af65c66ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:37.952223 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a63bb-0849-4fe7-8831-cb4af65c66ae None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:37.952506 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a63bb-0849-4fe7-8831-cb4af65c66ae None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:37.952800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a63bb-0849-4fe7-8831-cb4af65c66ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:37.964694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a63bb-0849-4fe7-8831-cb4af65c66ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:07:37.972463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-f28a63bb-0849-4fe7-8831-cb4af65c66ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:07:37.972463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:37.972463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:37.972463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:37.972463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:37.972463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:37.972463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:37.972463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:37.972463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:37.972463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:37.972463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:37.972463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:37.972463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:07:37.972463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:07:37.972463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:07:37.972463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:07:37.973533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:07:37.973533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:07:37.973533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:07:37.973533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:07:37.973533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:37.973533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:37.973533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:37.973533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:37.973533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:37.973533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:37.973533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:37.973533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:37.973533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:37.973533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:37.973533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:37.973533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:37.974777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:37.974777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:37.974777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:37.974777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:37.974777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:07:37.974777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:07:37.974777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:07:37.974777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:07:37.974777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:07:37.974777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:07:37.974777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:07:37.974777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:07:37.974777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 645/1263] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:07:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:37.980068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab905e4-63a9-4665-aeae-725f6982db17 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:37.999973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:38.107677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab905e4-63a9-4665-aeae-725f6982db17 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:38.159679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee4c3f-ea57-488f-a499-9e632504ffb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:38.160364 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee4c3f-ea57-488f-a499-9e632504ffb4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:38.160644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee4c3f-ea57-488f-a499-9e632504ffb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:38.160922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee4c3f-ea57-488f-a499-9e632504ffb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:38.161682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee4c3f-ea57-488f-a499-9e632504ffb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:38.161990 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee4c3f-ea57-488f-a499-9e632504ffb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:38.163443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee4c3f-ea57-488f-a499-9e632504ffb4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:38.172634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 619/1264] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:07:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:38.181163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a63bb-0849-4fe7-8831-cb4af65c66ae None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:38.256277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:38.293359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a63bb-0849-4fe7-8831-cb4af65c66ae None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:38.329551 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b5863-6781-41be-aa03-68b7eefc7ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:38.330359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b5863-6781-41be-aa03-68b7eefc7ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:38.330674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b5863-6781-41be-aa03-68b7eefc7ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:38.330948 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b5863-6781-41be-aa03-68b7eefc7ac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:38.342606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b5863-6781-41be-aa03-68b7eefc7ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:38.344065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b5863-6781-41be-aa03-68b7eefc7ac4 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:38.362099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-ed0b5863-6781-41be-aa03-68b7eefc7ac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:38.362099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:38.362099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:38.362099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:38.362099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:38.362099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:38.362099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:38.362099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:38.362099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:38.362099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:38.362099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:38.362099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:38.362099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:07:38.362099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:07:38.362099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:38.363112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:38.369051 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:07:38.369051 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:07:38.369051 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:38.369051 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:07:38.369051 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 646/1265] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:38.371569 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee4c3f-ea57-488f-a499-9e632504ffb4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:38.490216 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:38.510280 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee4c3f-ea57-488f-a499-9e632504ffb4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:38.545542 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b68a94-d658-42ba-a167-72c6bbfd9935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:38.546192 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b68a94-d658-42ba-a167-72c6bbfd9935 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:38.546501 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b68a94-d658-42ba-a167-72c6bbfd9935 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:38.546782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b68a94-d658-42ba-a167-72c6bbfd9935 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:38.547508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b68a94-d658-42ba-a167-72c6bbfd9935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:38.547809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b68a94-d658-42ba-a167-72c6bbfd9935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:38.549193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b68a94-d658-42ba-a167-72c6bbfd9935 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:38.561617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 620/1266] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:38.567690 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b5863-6781-41be-aa03-68b7eefc7ac4 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:38.669203 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b5863-6781-41be-aa03-68b7eefc7ac4 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:38.695254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:38.712358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0187d0-75c7-4a67-acb6-5f7e4bd42f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:38.713161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0187d0-75c7-4a67-acb6-5f7e4bd42f68 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:38.713447 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0187d0-75c7-4a67-acb6-5f7e4bd42f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:38.713723 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0187d0-75c7-4a67-acb6-5f7e4bd42f68 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:38.721401 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0187d0-75c7-4a67-acb6-5f7e4bd42f68 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:38.722873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0187d0-75c7-4a67-acb6-5f7e4bd42f68 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:38.737161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-be0187d0-75c7-4a67-acb6-5f7e4bd42f68 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 14:07:38.737161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:38.737161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:38.737161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:38.737161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:38.737161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:38.737161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:38.737161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:38.737161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:38.737161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:38.737161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:38.737161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:38.737161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:07:38.737161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:07:38.737161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:07:38.737161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:38.738232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:38.746740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:38.746740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:38.746740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:07:38.746740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:07:38.746740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:07:38.746740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:07:38.746740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:07:38.746740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:07:38.746740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 14:07:38.746740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:07:38.746740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 647/1267] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:38.747431 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b68a94-d658-42ba-a167-72c6bbfd9935 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:38.858895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b68a94-d658-42ba-a167-72c6bbfd9935 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:38.902198 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e4ca0-ad6e-4d41-bbe4-a8073657f8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:38.902985 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e4ca0-ad6e-4d41-bbe4-a8073657f8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:38.903271 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e4ca0-ad6e-4d41-bbe4-a8073657f8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:38.903542 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e4ca0-ad6e-4d41-bbe4-a8073657f8d4 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:38.904391 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e4ca0-ad6e-4d41-bbe4-a8073657f8d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:38.904700 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e4ca0-ad6e-4d41-bbe4-a8073657f8d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:38.906184 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e4ca0-ad6e-4d41-bbe4-a8073657f8d4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:38.915090 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:38.924654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 621/1268] 10.222.0.99 () {56 vars in 1143 bytes} [Mon Jul 18 14:07:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:38.930734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0187d0-75c7-4a67-acb6-5f7e4bd42f68 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:39.039425 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0187d0-75c7-4a67-acb6-5f7e4bd42f68 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:39.078227 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79c4aa-331f-45f9-ad5d-011f705bc0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:39.079035 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79c4aa-331f-45f9-ad5d-011f705bc0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:39.079320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79c4aa-331f-45f9-ad5d-011f705bc0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:39.079600 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79c4aa-331f-45f9-ad5d-011f705bc0e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:39.091417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79c4aa-331f-45f9-ad5d-011f705bc0e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:39.092950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79c4aa-331f-45f9-ad5d-011f705bc0e6 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:39.110580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-8d79c4aa-331f-45f9-ad5d-011f705bc0e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:39.110580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:39.110580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:39.110580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:39.110580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:39.110580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:39.110580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:39.110580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:39.110580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:39.110580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:39.110580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:39.110580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:39.110580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:07:39.110580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:07:39.110580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:39.111606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:39.112873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:07:39.112873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:07:39.112873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:39.112873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:07:39.112873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 648/1269] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:39.118470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e4ca0-ad6e-4d41-bbe4-a8073657f8d4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:39.223296 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e4ca0-ad6e-4d41-bbe4-a8073657f8d4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:39.257752 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca6308-a19e-4364-b0ea-7701c0e4a05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:39.258425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca6308-a19e-4364-b0ea-7701c0e4a05e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:39.258707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca6308-a19e-4364-b0ea-7701c0e4a05e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:39.258981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca6308-a19e-4364-b0ea-7701c0e4a05e None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:39.259700 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca6308-a19e-4364-b0ea-7701c0e4a05e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:39.260024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca6308-a19e-4364-b0ea-7701c0e4a05e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:39.261402 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca6308-a19e-4364-b0ea-7701c0e4a05e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:39.272735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 622/1270] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:39.280648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79c4aa-331f-45f9-ad5d-011f705bc0e6 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:39.318534 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:39.398575 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79c4aa-331f-45f9-ad5d-011f705bc0e6 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:39.436137 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cbc55-fc39-47be-93dc-6530ed145f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:39.436918 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cbc55-fc39-47be-93dc-6530ed145f75 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:39.437203 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cbc55-fc39-47be-93dc-6530ed145f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:39.437477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cbc55-fc39-47be-93dc-6530ed145f75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:39.444468 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cbc55-fc39-47be-93dc-6530ed145f75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:39.445920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cbc55-fc39-47be-93dc-6530ed145f75 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:39.460515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-3c4cbc55-fc39-47be-93dc-6530ed145f75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:07:39.460515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:39.460515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:39.460515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:39.460515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:39.460515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:39.460515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:39.460515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:39.460515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:39.460515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:39.460515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:39.460515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:39.460515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:07:39.460515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:07:39.460515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:39.461544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:39.462755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:07:39.462755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:07:39.462755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:07:39.462755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:07:39.462755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:07:39.462755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:07:39.462755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:07:39.462755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:07:39.462755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 649/1271] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:07:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:39.468855 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca6308-a19e-4364-b0ea-7701c0e4a05e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:39.540583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:39.582192 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca6308-a19e-4364-b0ea-7701c0e4a05e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:39.620411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4bcad-ef0e-4aae-bb71-251cb7c839bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:39.621063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4bcad-ef0e-4aae-bb71-251cb7c839bf None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:39.621358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4bcad-ef0e-4aae-bb71-251cb7c839bf None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:39.621636 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4bcad-ef0e-4aae-bb71-251cb7c839bf None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:39.622445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4bcad-ef0e-4aae-bb71-251cb7c839bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:39.622749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4bcad-ef0e-4aae-bb71-251cb7c839bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:39.624513 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4bcad-ef0e-4aae-bb71-251cb7c839bf None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:39.637693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 623/1272] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:07:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:39.644048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cbc55-fc39-47be-93dc-6530ed145f75 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:39.749641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:39.761821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cbc55-fc39-47be-93dc-6530ed145f75 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:39.800537 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00638032-fd72-47f9-be03-fa71e3bc5bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:39.801436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00638032-fd72-47f9-be03-fa71e3bc5bd8 None admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:39.801722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00638032-fd72-47f9-be03-fa71e3bc5bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:39.801997 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00638032-fd72-47f9-be03-fa71e3bc5bd8 None admin] PATH_INFO: `/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/92b73e1a514148b19bb6a1d2a39e32cc/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:39.804232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00638032-fd72-47f9-be03-fa71e3bc5bd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=50b78e16c86b4e6cac3a725f536a8274, user_id=92b73e1a514148b19bb6a1d2a39e32cc, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:39.805677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00638032-fd72-47f9-be03-fa71e3bc5bd8 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:39.821080 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 650/1273] 10.222.0.99 () {58 vars in 1439 bytes} [Mon Jul 18 14:07:39 2022] PUT /identity/v3/projects/50b78e16c86b4e6cac3a725f536a8274/users/92b73e1a514148b19bb6a1d2a39e32cc/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:07:41.814794 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a53444-8942-4fcf-83d3-1c8b8c8f9952 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:41.815381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a53444-8942-4fcf-83d3-1c8b8c8f9952 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:41.815381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a53444-8942-4fcf-83d3-1c8b8c8f9952 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:41.816744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 624/1274] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:07:41.823074 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebb302-072b-4695-9c40-2fd78372caab None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:41.823777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebb302-072b-4695-9c40-2fd78372caab None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:41.823959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebb302-072b-4695-9c40-2fd78372caab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:41.844225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-fbebb302-072b-4695-9c40-2fd78372caab None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:41.845447 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-fbebb302-072b-4695-9c40-2fd78372caab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:41.920278 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 651/1275] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:07:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:07:41.948726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a53444-8942-4fcf-83d3-1c8b8c8f9952 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:42.059250 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a53444-8942-4fcf-83d3-1c8b8c8f9952 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:42.079526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:42.100792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ab266-5af3-430e-984f-35f1f3868fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:42.101584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab266-5af3-430e-984f-35f1f3868fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:42.101869 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab266-5af3-430e-984f-35f1f3868fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:42.102145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ab266-5af3-430e-984f-35f1f3868fe9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:42.112270 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ab266-5af3-430e-984f-35f1f3868fe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 14:07:42.119829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-3e4ab266-5af3-430e-984f-35f1f3868fe9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:07:42.119829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:42.119829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:42.119829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:42.119829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:42.119829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:42.119829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:42.119829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:42.119829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:42.119829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:42.119829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:42.119829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:42.119829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 14:07:42.119829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 14:07:42.119829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 14:07:42.119829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 14:07:42.120798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 14:07:42.120798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 14:07:42.120798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 14:07:42.120798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 14:07:42.120798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:42.120798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:42.120798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:42.120798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:42.120798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:42.120798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:42.120798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:42.120798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:42.120798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:42.120798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:42.120798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:42.120798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:42.122182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:42.122182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:42.122182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:42.122182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:42.122182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 14:07:42.122182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 14:07:42.122182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 14:07:42.122182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 14:07:42.122182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 14:07:42.122182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 14:07:42.122182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 14:07:42.122182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:42.122182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 625/1276] 10.222.0.99 () {56 vars in 1096 bytes} [Mon Jul 18 14:07:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:42.127696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebb302-072b-4695-9c40-2fd78372caab None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:42.212352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:42.230699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebb302-072b-4695-9c40-2fd78372caab None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:42.265331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420012c-f47c-437a-a999-2c106363e229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:42.265988 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420012c-f47c-437a-a999-2c106363e229 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:42.266271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420012c-f47c-437a-a999-2c106363e229 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:42.266576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420012c-f47c-437a-a999-2c106363e229 None admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:42.267322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420012c-f47c-437a-a999-2c106363e229 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:42.267627 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420012c-f47c-437a-a999-2c106363e229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:42.269040 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420012c-f47c-437a-a999-2c106363e229 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:42.277123 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 652/1277] 10.222.0.99 () {56 vars in 1099 bytes} [Mon Jul 18 14:07:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:42.283165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ab266-5af3-430e-984f-35f1f3868fe9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:42.387407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ab266-5af3-430e-984f-35f1f3868fe9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:42.428875 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97335bf-d55c-4be1-b0ad-e60e9f2a260e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:42.429661 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97335bf-d55c-4be1-b0ad-e60e9f2a260e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:42.429943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97335bf-d55c-4be1-b0ad-e60e9f2a260e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:42.430309 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97335bf-d55c-4be1-b0ad-e60e9f2a260e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:42.441519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97335bf-d55c-4be1-b0ad-e60e9f2a260e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:42.443037 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97335bf-d55c-4be1-b0ad-e60e9f2a260e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:42.460666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b97335bf-d55c-4be1-b0ad-e60e9f2a260e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:42.460666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:42.460666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:42.460666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:42.460666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:42.460666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:42.460666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:42.460666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:42.460666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:42.460666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:42.460666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:42.460666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:42.460666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:07:42.460666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:07:42.460666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:42.461758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:42.463277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:07:42.463277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:07:42.463277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:42.463277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:42.463277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 626/1278] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:42.470157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420012c-f47c-437a-a999-2c106363e229 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:42.579337 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420012c-f47c-437a-a999-2c106363e229 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:42.617734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f7b53-4671-4b9a-a01e-149a4c6be052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:42.618425 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f7b53-4671-4b9a-a01e-149a4c6be052 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:42.618695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f7b53-4671-4b9a-a01e-149a4c6be052 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:42.618977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f7b53-4671-4b9a-a01e-149a4c6be052 None admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:42.619702 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f7b53-4671-4b9a-a01e-149a4c6be052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:42.620015 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f7b53-4671-4b9a-a01e-149a4c6be052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:42.621414 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f7b53-4671-4b9a-a01e-149a4c6be052 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:42.634076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 653/1279] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:42.641186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97335bf-d55c-4be1-b0ad-e60e9f2a260e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:42.675224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:42.749004 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97335bf-d55c-4be1-b0ad-e60e9f2a260e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:42.783987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a96f5-37b4-4402-a85b-2fa956203c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:42.784769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a96f5-37b4-4402-a85b-2fa956203c32 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:42.785045 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a96f5-37b4-4402-a85b-2fa956203c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:42.785315 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a96f5-37b4-4402-a85b-2fa956203c32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:42.793025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a96f5-37b4-4402-a85b-2fa956203c32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:42.794516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a96f5-37b4-4402-a85b-2fa956203c32 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:42.808657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-e90a96f5-37b4-4402-a85b-2fa956203c32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 14:07:42.808657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:42.808657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:42.808657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:42.808657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:42.808657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:42.808657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:42.808657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:42.808657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:42.808657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:42.808657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:42.808657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:42.808657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 14:07:42.808657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 14:07:42.808657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 14:07:42.808657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:42.809730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:42.810919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:42.810919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:42.810919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 14:07:42.810919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 14:07:42.810919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 14:07:42.810919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 14:07:42.810919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 14:07:42.810919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 14:07:42.810919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 14:07:42.810919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:42.810919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 627/1280] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:42.816673 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f7b53-4671-4b9a-a01e-149a4c6be052 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:42.822746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:42.952289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f7b53-4671-4b9a-a01e-149a4c6be052 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:42.991620 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0b545-e13a-41cb-be63-8105089e650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:42.992627 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0b545-e13a-41cb-be63-8105089e650e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:42.993099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0b545-e13a-41cb-be63-8105089e650e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:42.993518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0b545-e13a-41cb-be63-8105089e650e None admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:42.994908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0b545-e13a-41cb-be63-8105089e650e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:42.995373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0b545-e13a-41cb-be63-8105089e650e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:42.997173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0b545-e13a-41cb-be63-8105089e650e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:43.015975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 654/1281] 10.222.0.99 () {56 vars in 1143 bytes} [Mon Jul 18 14:07:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:43.022122 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a96f5-37b4-4402-a85b-2fa956203c32 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:43.119731 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:43.131057 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a96f5-37b4-4402-a85b-2fa956203c32 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:43.167823 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3274db9-75f5-4de8-813d-7d08d9583ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:43.168514 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3274db9-75f5-4de8-813d-7d08d9583ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:43.168808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3274db9-75f5-4de8-813d-7d08d9583ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:43.169082 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3274db9-75f5-4de8-813d-7d08d9583ac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:43.247653 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3274db9-75f5-4de8-813d-7d08d9583ac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:43.249520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3274db9-75f5-4de8-813d-7d08d9583ac1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:43.341082 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:43.354124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 628/1282] 10.222.0.99 () {58 vars in 1282 bytes} [Mon Jul 18 14:07:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 14:07:43.360928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0b545-e13a-41cb-be63-8105089e650e None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:43.437094 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:43.479379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0b545-e13a-41cb-be63-8105089e650e None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:43.515067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c5040-6e51-43f0-98c1-afba7388b7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:43.515788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c5040-6e51-43f0-98c1-afba7388b7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:43.516071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c5040-6e51-43f0-98c1-afba7388b7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:43.516351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c5040-6e51-43f0-98c1-afba7388b7a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:43.527276 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c5040-6e51-43f0-98c1-afba7388b7a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:43.528792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c5040-6e51-43f0-98c1-afba7388b7a5 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:43.547128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-cc1c5040-6e51-43f0-98c1-afba7388b7a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:43.547128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:43.547128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:43.547128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:43.547128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:43.547128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:43.547128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:43.547128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:43.547128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:43.547128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:43.547128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:43.547128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:43.547128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 14:07:43.547128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 14:07:43.547128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:43.548169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:43.549528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 14:07:43.549528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 14:07:43.549528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 14:07:43.549528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:07:43.549528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 655/1283] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:43.557357 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3274db9-75f5-4de8-813d-7d08d9583ac1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:43.661618 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3274db9-75f5-4de8-813d-7d08d9583ac1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:43.697926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8a65a-6541-49cc-8195-a62731de1489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:43.698609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8a65a-6541-49cc-8195-a62731de1489 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:43.698896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8a65a-6541-49cc-8195-a62731de1489 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:43.699206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8a65a-6541-49cc-8195-a62731de1489 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:43.699932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8a65a-6541-49cc-8195-a62731de1489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:43.700240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8a65a-6541-49cc-8195-a62731de1489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:43.701747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8a65a-6541-49cc-8195-a62731de1489 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:43.713098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 629/1284] 10.222.0.99 () {56 vars in 1109 bytes} [Mon Jul 18 14:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:43.719745 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c5040-6e51-43f0-98c1-afba7388b7a5 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:43.841721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c5040-6e51-43f0-98c1-afba7388b7a5 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:43.864197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:43.890551 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b1214-9385-42af-9b1a-0a9799cdaa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:43.891348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b1214-9385-42af-9b1a-0a9799cdaa84 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:43.891637 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b1214-9385-42af-9b1a-0a9799cdaa84 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:43.891910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b1214-9385-42af-9b1a-0a9799cdaa84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:43.899379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b1214-9385-42af-9b1a-0a9799cdaa84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:43.900831 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b1214-9385-42af-9b1a-0a9799cdaa84 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:43.914806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application [None req-453b1214-9385-42af-9b1a-0a9799cdaa84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:07:43.914806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:43.914806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:43.914806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:43.914806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:43.914806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:43.914806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:43.914806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:43.914806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:43.914806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:43.914806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:43.914806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:43.914806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 14:07:43.914806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 14:07:43.914806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:43.915969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:43.917011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 14:07:43.917011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 14:07:43.917011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 14:07:43.917011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 14:07:43.917011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 14:07:43.917011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 14:07:43.917011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 14:07:43.917011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: ERROR keystone.server.flask.application Jul 18 14:07:43.917011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 656/1285] 10.222.0.99 () {56 vars in 1111 bytes} [Mon Jul 18 14:07:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:43.924568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8a65a-6541-49cc-8195-a62731de1489 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:43.982780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:44.038301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8a65a-6541-49cc-8195-a62731de1489 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:44.074480 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6dfe2-1c56-4d3c-af15-ba2bc21addad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:44.075128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6dfe2-1c56-4d3c-af15-ba2bc21addad None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:44.075408 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6dfe2-1c56-4d3c-af15-ba2bc21addad None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:44.075680 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6dfe2-1c56-4d3c-af15-ba2bc21addad None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:44.076496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6dfe2-1c56-4d3c-af15-ba2bc21addad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:44.076826 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6dfe2-1c56-4d3c-af15-ba2bc21addad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:44.078285 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6dfe2-1c56-4d3c-af15-ba2bc21addad None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:44.090488 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 630/1286] 10.222.0.99 () {56 vars in 1148 bytes} [Mon Jul 18 14:07:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:44.097954 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b1214-9385-42af-9b1a-0a9799cdaa84 None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:44.204060 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b1214-9385-42af-9b1a-0a9799cdaa84 None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:44.241457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533e11d-cf6a-40e6-ae54-cfbc84fce2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:44.242106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e11d-cf6a-40e6-ae54-cfbc84fce2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:44.242428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e11d-cf6a-40e6-ae54-cfbc84fce2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:44.242697 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533e11d-cf6a-40e6-ae54-cfbc84fce2d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:44.243531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533e11d-cf6a-40e6-ae54-cfbc84fce2d0 None admin] RBAC: Adding query filter params (role.id=67cd90b899c54fe38f14a99c18fa2ce2, scope.project.id=50b78e16c86b4e6cac3a725f536a8274, user.id=92b73e1a514148b19bb6a1d2a39e32cc) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:44.243844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533e11d-cf6a-40e6-ae54-cfbc84fce2d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:44.245284 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533e11d-cf6a-40e6-ae54-cfbc84fce2d0 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:44.251679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 657/1287] 10.222.0.99 () {56 vars in 1374 bytes} [Mon Jul 18 14:07:44 2022] GET /identity/v3/role_assignments?user.id=92b73e1a514148b19bb6a1d2a39e32cc&scope.project.id=50b78e16c86b4e6cac3a725f536a8274&role.id=67cd90b899c54fe38f14a99c18fa2ce2 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:46.397547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10df9b-58c3-4ca8-9566-3c29f10f9547 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.398463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10df9b-58c3-4ca8-9566-3c29f10f9547 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.398463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10df9b-58c3-4ca8-9566-3c29f10f9547 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.400595 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 631/1288] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:07:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:07:46.407386 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b84c36-342d-4e09-b3be-64e2b8f2f6d4 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.407855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b84c36-342d-4e09-b3be-64e2b8f2f6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.407959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b84c36-342d-4e09-b3be-64e2b8f2f6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.435129 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-58b84c36-342d-4e09-b3be-64e2b8f2f6d4 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:46.436312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-58b84c36-342d-4e09-b3be-64e2b8f2f6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:46.466479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:46.515460 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 658/1289] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:07:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:07:46.539798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10df9b-58c3-4ca8-9566-3c29f10f9547 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.664731 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10df9b-58c3-4ca8-9566-3c29f10f9547 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.676325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:46.701422 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4601f8-a6e1-44b9-a61f-f17055ba2046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.702207 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4601f8-a6e1-44b9-a61f-f17055ba2046 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.702537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4601f8-a6e1-44b9-a61f-f17055ba2046 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.702805 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4601f8-a6e1-44b9-a61f-f17055ba2046 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.703460 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4601f8-a6e1-44b9-a61f-f17055ba2046 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.704847 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4601f8-a6e1-44b9-a61f-f17055ba2046 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-2d4601f8-a6e1-44b9-a61f-f17055ba2046 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:46.716712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:46.717943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:46.717943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:46.717943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:46.717943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:46.717943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:46.717943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:46.717943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:07:46.717943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:07:46.717943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:07:46.717943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:07:46.717943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:46.717943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:46.717943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:46.717943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:46.717943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:46.717943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:46.719107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:46.719107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:46.719107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:46.719107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:46.719107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:46.719107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:46.719107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:46.719107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:46.719107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:46.719107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:46.719107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:07:46.719107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:07:46.719107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 14:07:46.719107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:46.719107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 632/1290] 10.222.0.99 () {56 vars in 1117 bytes} [Mon Jul 18 14:07:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:46.726109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b84c36-342d-4e09-b3be-64e2b8f2f6d4 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.824450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b84c36-342d-4e09-b3be-64e2b8f2f6d4 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:46.858502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfe44d-ca4b-40bc-8344-e5c227a9045e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:46.858966 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe44d-ca4b-40bc-8344-e5c227a9045e None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:46.859257 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe44d-ca4b-40bc-8344-e5c227a9045e None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:46.859540 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfe44d-ca4b-40bc-8344-e5c227a9045e None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:46.860248 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfe44d-ca4b-40bc-8344-e5c227a9045e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:46.860573 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfe44d-ca4b-40bc-8344-e5c227a9045e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:46.861933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfe44d-ca4b-40bc-8344-e5c227a9045e None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:46.868006 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 659/1291] 10.222.0.99 () {56 vars in 1116 bytes} [Mon Jul 18 14:07:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:46.875277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4601f8-a6e1-44b9-a61f-f17055ba2046 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:46.979830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4601f8-a6e1-44b9-a61f-f17055ba2046 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:47.014251 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc19fb-4387-4c85-a1a3-30f420276e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:47.014935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc19fb-4387-4c85-a1a3-30f420276e42 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:47.015224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc19fb-4387-4c85-a1a3-30f420276e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:47.015503 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc19fb-4387-4c85-a1a3-30f420276e42 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:47.016218 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc19fb-4387-4c85-a1a3-30f420276e42 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:47.016531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc19fb-4387-4c85-a1a3-30f420276e42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:47.017922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc19fb-4387-4c85-a1a3-30f420276e42 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:47.022597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 633/1292] 10.222.0.99 () {56 vars in 1116 bytes} [Mon Jul 18 14:07:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:48.979576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485058a7-8b6c-49db-98db-f68396ef4aa4 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.980484 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485058a7-8b6c-49db-98db-f68396ef4aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.980484 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485058a7-8b6c-49db-98db-f68396ef4aa4 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:48.982638 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 660/1293] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:07:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:07:48.991410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970ce4d-bddb-4233-acde-66f911d31ca9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:48.992158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970ce4d-bddb-4233-acde-66f911d31ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:48.992325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970ce4d-bddb-4233-acde-66f911d31ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:49.012968 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a970ce4d-bddb-4233-acde-66f911d31ca9 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:49.014170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a970ce4d-bddb-4233-acde-66f911d31ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:49.047833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:49.113203 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 634/1294] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:07:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:07:49.143744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485058a7-8b6c-49db-98db-f68396ef4aa4 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:49.178379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:49.271006 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485058a7-8b6c-49db-98db-f68396ef4aa4 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:49.313734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7133f-f3bb-4d2b-9a8a-dab3b9a35e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:49.314438 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7133f-f3bb-4d2b-9a8a-dab3b9a35e90 None admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:49.314720 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7133f-f3bb-4d2b-9a8a-dab3b9a35e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:49.315001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7133f-f3bb-4d2b-9a8a-dab3b9a35e90 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:49.315726 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7133f-f3bb-4d2b-9a8a-dab3b9a35e90 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:49.317105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7133f-f3bb-4d2b-9a8a-dab3b9a35e90 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:49.338299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 661/1295] 10.222.0.99 () {60 vars in 1141 bytes} [Mon Jul 18 14:07:49 2022] POST /identity/v3/services => generated 246 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:07:51.325232 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1b778-28a8-4620-a02b-32bbbbc72514 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:51.326205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1b778-28a8-4620-a02b-32bbbbc72514 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:51.326205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1b778-28a8-4620-a02b-32bbbbc72514 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:51.328254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 635/1296] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:07:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:07:51.336930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1ff9a-a76d-4873-8972-57ccca142057 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:51.337365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1ff9a-a76d-4873-8972-57ccca142057 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:51.337512 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1ff9a-a76d-4873-8972-57ccca142057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:51.362657 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-b3f1ff9a-a76d-4873-8972-57ccca142057 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:51.363844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b3f1ff9a-a76d-4873-8972-57ccca142057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:51.443879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 662/1297] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:07:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:07:51.468690 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1b778-28a8-4620-a02b-32bbbbc72514 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:51.580370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1b778-28a8-4620-a02b-32bbbbc72514 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:51.614130 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b8b16-dccf-4f83-b106-e78188790ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:51.614940 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b8b16-dccf-4f83-b106-e78188790ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:51.615221 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b8b16-dccf-4f83-b106-e78188790ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:51.615491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b8b16-dccf-4f83-b106-e78188790ac8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:51.616141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b8b16-dccf-4f83-b106-e78188790ac8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:51.617521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b8b16-dccf-4f83-b106-e78188790ac8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-598b8b16-dccf-4f83-b106-e78188790ac8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:51.629682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:51.631284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:51.631284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:51.631284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:51.631284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:51.631284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:51.631284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:51.631284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:07:51.631284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:07:51.631284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:07:51.631284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:07:51.631284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:51.631284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:51.631284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:51.631284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:51.631284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:51.631284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:51.633006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:51.633006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:51.633006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:51.633006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:51.633006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:51.633006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:51.633006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:51.633006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:51.633006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:51.633006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:51.633006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:07:51.633006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:07:51.633006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 14:07:51.633006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:51.633006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 636/1298] 10.222.0.99 () {56 vars in 1117 bytes} [Mon Jul 18 14:07:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:51.639995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1ff9a-a76d-4873-8972-57ccca142057 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:51.662534 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:51.743468 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1ff9a-a76d-4873-8972-57ccca142057 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:51.777977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23827dde-16f1-417a-9a98-9075360ad3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:51.778654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23827dde-16f1-417a-9a98-9075360ad3ae None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:51.778928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23827dde-16f1-417a-9a98-9075360ad3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:51.779201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23827dde-16f1-417a-9a98-9075360ad3ae None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:51.779905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23827dde-16f1-417a-9a98-9075360ad3ae None admin] RBAC: Adding query filter params (name=placement) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:51.780209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23827dde-16f1-417a-9a98-9075360ad3ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:51.781576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23827dde-16f1-417a-9a98-9075360ad3ae None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:51.786864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 663/1299] 10.222.0.99 () {56 vars in 1116 bytes} [Mon Jul 18 14:07:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:51.793471 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b8b16-dccf-4f83-b106-e78188790ac8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:51.829990 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:51.915788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b8b16-dccf-4f83-b106-e78188790ac8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:51.958654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1231a-89c3-44a9-8e74-c80363b2812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:51.959635 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1231a-89c3-44a9-8e74-c80363b2812a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:51.960084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1231a-89c3-44a9-8e74-c80363b2812a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:51.960513 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1231a-89c3-44a9-8e74-c80363b2812a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:51.961775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1231a-89c3-44a9-8e74-c80363b2812a None admin] RBAC: Adding query filter params (interface=public, service_id=2c3059bf87464a9fbdb94c59d5f3cebd, region_id=RegionOne) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:51.962267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1231a-89c3-44a9-8e74-c80363b2812a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:51.964530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1231a-89c3-44a9-8e74-c80363b2812a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:51.970517 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 637/1300] 10.222.0.99 () {56 vars in 1251 bytes} [Mon Jul 18 14:07:51 2022] GET /identity/v3/endpoints?service_id=2c3059bf87464a9fbdb94c59d5f3cebd&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:51.978699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23827dde-16f1-417a-9a98-9075360ad3ae None admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:52.066245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:52.085716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23827dde-16f1-417a-9a98-9075360ad3ae None admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:52.119508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a600c-5a1a-4c3e-a32b-fa307a3c6956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:52.120162 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a600c-5a1a-4c3e-a32b-fa307a3c6956 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:52.120443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a600c-5a1a-4c3e-a32b-fa307a3c6956 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:52.120740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a600c-5a1a-4c3e-a32b-fa307a3c6956 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:52.121427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a600c-5a1a-4c3e-a32b-fa307a3c6956 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:52.122829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a600c-5a1a-4c3e-a32b-fa307a3c6956 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:52.129929 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 664/1301] 10.222.0.99 () {56 vars in 1087 bytes} [Mon Jul 18 14:07:51 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:07:54.106945 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b97071-cf0a-4581-8a86-2f88468f64e0 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:54.107504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b97071-cf0a-4581-8a86-2f88468f64e0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:54.107504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b97071-cf0a-4581-8a86-2f88468f64e0 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:54.108894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 638/1302] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:07:54.118009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a8d1-d1b6-48b9-b4db-44b5a890169f None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:54.118744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a8d1-d1b6-48b9-b4db-44b5a890169f None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:54.119063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17a8d1-d1b6-48b9-b4db-44b5a890169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:54.138710 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-1c17a8d1-d1b6-48b9-b4db-44b5a890169f None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:07:54.139972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1c17a8d1-d1b6-48b9-b4db-44b5a890169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:07:54.213868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 665/1303] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:07:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 14:07:54.237264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b97071-cf0a-4581-8a86-2f88468f64e0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:54.345817 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:54.357601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b97071-cf0a-4581-8a86-2f88468f64e0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:54.393406 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a8ae8-965d-4378-8f6b-6d23962a3ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:54.394202 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a8ae8-965d-4378-8f6b-6d23962a3ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:54.394517 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a8ae8-965d-4378-8f6b-6d23962a3ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:54.394795 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a8ae8-965d-4378-8f6b-6d23962a3ac6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:54.395449 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a8ae8-965d-4378-8f6b-6d23962a3ac6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:54.396858 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a8ae8-965d-4378-8f6b-6d23962a3ac6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-1e3a8ae8-965d-4378-8f6b-6d23962a3ac6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 14:07:54.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 14:07:54.410340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 14:07:54.410340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 14:07:54.410340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 14:07:54.410340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 14:07:54.410340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 14:07:54.410340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 14:07:54.410340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 14:07:54.410340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 14:07:54.410340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 14:07:54.410340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 14:07:54.410340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 14:07:54.410340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 14:07:54.410340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 14:07:54.410340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 14:07:54.410340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 14:07:54.410340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 14:07:54.411293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 14:07:54.411293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Jul 18 14:07:54.411293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 14:07:54.411293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Jul 18 14:07:54.411293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 14:07:54.411293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 14:07:54.411293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 14:07:54.411293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Jul 18 14:07:54.411293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 14:07:54.411293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Jul 18 14:07:54.411293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 14:07:54.411293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 14:07:54.411293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 14:07:54.411293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: ERROR keystone.server.flask.application Jul 18 14:07:54.411293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 639/1304] 10.222.0.99 () {56 vars in 1117 bytes} [Mon Jul 18 14:07:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 14:07:54.416847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17a8d1-d1b6-48b9-b4db-44b5a890169f None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:54.507241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:07:54.534834 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17a8d1-d1b6-48b9-b4db-44b5a890169f None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:54.583339 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfa41e-3a5b-4fe7-a12f-099d25bc5590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:54.583995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfa41e-3a5b-4fe7-a12f-099d25bc5590 None admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:54.584279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfa41e-3a5b-4fe7-a12f-099d25bc5590 None admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:54.584561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfa41e-3a5b-4fe7-a12f-099d25bc5590 None admin] PATH_INFO: `/v3/services` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:54.585269 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfa41e-3a5b-4fe7-a12f-099d25bc5590 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:07:54.585585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfa41e-3a5b-4fe7-a12f-099d25bc5590 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:54.587005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfa41e-3a5b-4fe7-a12f-099d25bc5590 None admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:54.593277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 666/1305] 10.222.0.99 () {56 vars in 1116 bytes} [Mon Jul 18 14:07:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:07:54.600200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a8ae8-965d-4378-8f6b-6d23962a3ac6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:07:54.716227 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a8ae8-965d-4378-8f6b-6d23962a3ac6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:07:54.750845 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89b2af-36e4-46d6-985e-86c86c3d1b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:07:54.751484 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b2af-36e4-46d6-985e-86c86c3d1b1a None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:07:54.751766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b2af-36e4-46d6-985e-86c86c3d1b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:07:54.752041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89b2af-36e4-46d6-985e-86c86c3d1b1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:07:54.752787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89b2af-36e4-46d6-985e-86c86c3d1b1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:07:54.754169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89b2af-36e4-46d6-985e-86c86c3d1b1a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:07:54.775384 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 640/1306] 10.222.0.99 () {60 vars in 1144 bytes} [Mon Jul 18 14:07:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:08:04.589293 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=30 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:04.770596 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:58.072283 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732416f0-6425-4c6e-9363-2fad6752905e None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:58.072758 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732416f0-6425-4c6e-9363-2fad6752905e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:58.072852 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732416f0-6425-4c6e-9363-2fad6752905e None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:58.078068 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 667/1307] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:08:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:08:58.079545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99203d-9043-41ca-907d-563f2d041267 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:58.080156 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99203d-9043-41ca-907d-563f2d041267 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:58.080156 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99203d-9043-41ca-907d-563f2d041267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:58.244775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-da99203d-9043-41ca-907d-563f2d041267 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:58.247854 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-da99203d-9043-41ca-907d-563f2d041267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:58.424607 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 641/1308] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:58.473426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e364f-1946-45f0-b710-115fcfcebe89 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:58.474084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e364f-1946-45f0-b710-115fcfcebe89 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:58.474596 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e364f-1946-45f0-b710-115fcfcebe89 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:58.476430 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 668/1309] 10.222.0.99 () {54 vars in 965 bytes} [Mon Jul 18 14:08:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:08:58.483550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a741b-a307-4d71-b08e-5742e687a555 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:58.483875 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a741b-a307-4d71-b08e-5742e687a555 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:58.484111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a741b-a307-4d71-b08e-5742e687a555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:58.570790 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-564a741b-a307-4d71-b08e-5742e687a555 None None] MFA Rules not processed for user `abc51e98d0054609b6ce10723f70bf49`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:08:58.572234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-564a741b-a307-4d71-b08e-5742e687a555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:58.595548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:58.661336 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 642/1310] 10.222.0.99 () {58 vars in 1062 bytes} [Mon Jul 18 14:08:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:08:58.669972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e364f-1946-45f0-b710-115fcfcebe89 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:08:58.672177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-028e364f-1946-45f0-b710-115fcfcebe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:58.832246 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e364f-1946-45f0-b710-115fcfcebe89 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:08:58.921143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac24bfd-b69f-4433-8388-7636ed560da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:08:58.921814 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24bfd-b69f-4433-8388-7636ed560da4 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:08:58.922100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24bfd-b69f-4433-8388-7636ed560da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:08:58.922378 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24bfd-b69f-4433-8388-7636ed560da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:08:58.924080 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-bac24bfd-b69f-4433-8388-7636ed560da4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:08:58.987940 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:08:59.049886 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac24bfd-b69f-4433-8388-7636ed560da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:08:59.051741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac24bfd-b69f-4433-8388-7636ed560da4 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:08:59.072652 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 669/1311] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:09:01.376177 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e2d0d-a47b-401c-87bd-fff8574f4345 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:01.376791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e2d0d-a47b-401c-87bd-fff8574f4345 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:01.376791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e2d0d-a47b-401c-87bd-fff8574f4345 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:01.378117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 643/1312] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:01.383362 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824b6af-b6e9-4268-aad2-96bf83bae6ab None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:01.383789 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824b6af-b6e9-4268-aad2-96bf83bae6ab None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:01.383930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824b6af-b6e9-4268-aad2-96bf83bae6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:01.464998 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-a824b6af-b6e9-4268-aad2-96bf83bae6ab None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:01.466150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a824b6af-b6e9-4268-aad2-96bf83bae6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:01.567983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 670/1313] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:01.621015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888bb47-4059-47ef-86ce-b13f5cf1e5a7 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:01.621390 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888bb47-4059-47ef-86ce-b13f5cf1e5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:01.621811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888bb47-4059-47ef-86ce-b13f5cf1e5a7 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:01.623672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 644/1314] 10.222.0.99 () {54 vars in 965 bytes} [Mon Jul 18 14:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:01.630171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a88115-3a0a-4b87-8cee-d20a880c3528 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:01.630505 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a88115-3a0a-4b87-8cee-d20a880c3528 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:01.630787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a88115-3a0a-4b87-8cee-d20a880c3528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:01.641820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:01.716293 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-95a88115-3a0a-4b87-8cee-d20a880c3528 None None] MFA Rules not processed for user `abc51e98d0054609b6ce10723f70bf49`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:01.717451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-95a88115-3a0a-4b87-8cee-d20a880c3528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:01.799124 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 671/1315] 10.222.0.99 () {58 vars in 1062 bytes} [Mon Jul 18 14:09:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:01.808366 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888bb47-4059-47ef-86ce-b13f5cf1e5a7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:01.809985 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4888bb47-4059-47ef-86ce-b13f5cf1e5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:01.921107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888bb47-4059-47ef-86ce-b13f5cf1e5a7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:01.997170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:02.000098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db0b4e-7954-4ee1-aad8-c0d258b78593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:02.001088 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db0b4e-7954-4ee1-aad8-c0d258b78593 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:02.001579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db0b4e-7954-4ee1-aad8-c0d258b78593 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:02.002066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db0b4e-7954-4ee1-aad8-c0d258b78593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:02.003780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-33db0b4e-7954-4ee1-aad8-c0d258b78593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:02.121134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db0b4e-7954-4ee1-aad8-c0d258b78593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:02.123001 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db0b4e-7954-4ee1-aad8-c0d258b78593 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:02.147850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 645/1316] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:04.682467 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fc8f8-c84e-42d1-828b-adeda76c0e93 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:04.683409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fc8f8-c84e-42d1-828b-adeda76c0e93 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:04.683508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fc8f8-c84e-42d1-828b-adeda76c0e93 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:04.685674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 672/1317] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:09:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:04.693634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35984ba-fb87-4652-8c7f-418a36476735 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:04.694103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35984ba-fb87-4652-8c7f-418a36476735 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:04.694196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35984ba-fb87-4652-8c7f-418a36476735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:04.763699 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c35984ba-fb87-4652-8c7f-418a36476735 None None] MFA Rules not processed for user `9a6745d8d2ca460e887dba39a4d91854`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:04.764901 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c35984ba-fb87-4652-8c7f-418a36476735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:04.821601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:04.868983 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 646/1318] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:09:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:09:04.909481 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fc8f8-c84e-42d1-828b-adeda76c0e93 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:04.911962 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a12fc8f8-c84e-42d1-828b-adeda76c0e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:05.021239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fc8f8-c84e-42d1-828b-adeda76c0e93 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:05.024081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:05.096326 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae766e-6f62-4db4-8bec-6e81caec5197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:05.097022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae766e-6f62-4db4-8bec-6e81caec5197 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:05.097287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae766e-6f62-4db4-8bec-6e81caec5197 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:05.097583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae766e-6f62-4db4-8bec-6e81caec5197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:05.099267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-57ae766e-6f62-4db4-8bec-6e81caec5197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:05.211247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae766e-6f62-4db4-8bec-6e81caec5197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:05.212787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae766e-6f62-4db4-8bec-6e81caec5197 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:05.231397 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 673/1319] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:07.963775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4f654-e3d8-4a82-945a-b546deff7f19 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:07.964253 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4f654-e3d8-4a82-945a-b546deff7f19 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:07.964376 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4f654-e3d8-4a82-945a-b546deff7f19 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:07.965749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 647/1320] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:07.973027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bb1df-176d-4bc6-9087-5dec1fb9b536 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:07.973849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bb1df-176d-4bc6-9087-5dec1fb9b536 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:07.973985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bb1df-176d-4bc6-9087-5dec1fb9b536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:08.017451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:08.043641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-0e0bb1df-176d-4bc6-9087-5dec1fb9b536 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:08.044905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-0e0bb1df-176d-4bc6-9087-5dec1fb9b536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:08.149767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 674/1321] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:09:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:08.199372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4f654-e3d8-4a82-945a-b546deff7f19 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:08.200209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-46e4f654-e3d8-4a82-945a-b546deff7f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:08.314350 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4f654-e3d8-4a82-945a-b546deff7f19 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:08.403439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf84f5-36ea-4e2e-9fa0-4ff784eceffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:08.404097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf84f5-36ea-4e2e-9fa0-4ff784eceffb service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:08.404378 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf84f5-36ea-4e2e-9fa0-4ff784eceffb service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:08.404650 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf84f5-36ea-4e2e-9fa0-4ff784eceffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:08.406314 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4edf84f5-36ea-4e2e-9fa0-4ff784eceffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:08.414203 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:08.522519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf84f5-36ea-4e2e-9fa0-4ff784eceffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:08.523908 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf84f5-36ea-4e2e-9fa0-4ff784eceffb service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:08.542989 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 648/1322] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:11.248285 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace12f-e819-4d8b-b9f4-67fb6399da73 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:11.248869 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace12f-e819-4d8b-b9f4-67fb6399da73 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:11.248869 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace12f-e819-4d8b-b9f4-67fb6399da73 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:11.250218 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 675/1323] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:11.255545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c42225-a4f5-43b5-8c7c-0b2daf4c1ccf None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:11.256029 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c42225-a4f5-43b5-8c7c-0b2daf4c1ccf None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:11.256131 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c42225-a4f5-43b5-8c7c-0b2daf4c1ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:11.323709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f2c42225-a4f5-43b5-8c7c-0b2daf4c1ccf None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:11.324904 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f2c42225-a4f5-43b5-8c7c-0b2daf4c1ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:11.388317 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:11.428813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 649/1324] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:11.465616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bace12f-e819-4d8b-b9f4-67fb6399da73 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:11.467228 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8bace12f-e819-4d8b-b9f4-67fb6399da73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:11.578923 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bace12f-e819-4d8b-b9f4-67fb6399da73 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:11.592203 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:11.667085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c8308-0d3e-4fc8-8bff-a1dc6accc660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:11.667747 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c8308-0d3e-4fc8-8bff-a1dc6accc660 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:11.668032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c8308-0d3e-4fc8-8bff-a1dc6accc660 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:11.668308 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c8308-0d3e-4fc8-8bff-a1dc6accc660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:11.669981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-303c8308-0d3e-4fc8-8bff-a1dc6accc660 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:11.785874 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c8308-0d3e-4fc8-8bff-a1dc6accc660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:11.787284 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c8308-0d3e-4fc8-8bff-a1dc6accc660 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:11.807304 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 676/1325] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:09:13.884430 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dfa13-9997-40cd-ad97-7cc9aace00b1 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:13.884999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dfa13-9997-40cd-ad97-7cc9aace00b1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:13.884999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dfa13-9997-40cd-ad97-7cc9aace00b1 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:13.886425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 650/1326] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:13.891912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec1fe8-802e-47e2-b6e0-5d72ce54a1cd None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:13.892367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec1fe8-802e-47e2-b6e0-5d72ce54a1cd None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:13.892456 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec1fe8-802e-47e2-b6e0-5d72ce54a1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:13.939701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:13.959210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-00ec1fe8-802e-47e2-b6e0-5d72ce54a1cd None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:13.960418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-00ec1fe8-802e-47e2-b6e0-5d72ce54a1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:14.071914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 677/1327] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:14.108963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dfa13-9997-40cd-ad97-7cc9aace00b1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:14.110580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4f8dfa13-9997-40cd-ad97-7cc9aace00b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:14.230109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dfa13-9997-40cd-ad97-7cc9aace00b1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:14.303544 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22662ae-10ab-4248-a71f-dde2e227af78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:14.304195 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22662ae-10ab-4248-a71f-dde2e227af78 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:14.304478 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22662ae-10ab-4248-a71f-dde2e227af78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:14.304749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22662ae-10ab-4248-a71f-dde2e227af78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:14.306433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e22662ae-10ab-4248-a71f-dde2e227af78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:14.323520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:14.423290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22662ae-10ab-4248-a71f-dde2e227af78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:14.424743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22662ae-10ab-4248-a71f-dde2e227af78 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:14.445146 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 651/1328] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:16.495820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6512bf8-9972-4a59-970f-f287e2ee36ae None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:16.496390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6512bf8-9972-4a59-970f-f287e2ee36ae None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:16.496390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6512bf8-9972-4a59-970f-f287e2ee36ae None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:16.498109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 678/1329] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:16.503906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafe333-7531-48e6-8ff4-cc217bd3777e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:16.504393 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafe333-7531-48e6-8ff4-cc217bd3777e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:16.504520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafe333-7531-48e6-8ff4-cc217bd3777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:16.578329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3cafe333-7531-48e6-8ff4-cc217bd3777e None None] MFA Rules not processed for user `9a6745d8d2ca460e887dba39a4d91854`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:16.579560 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3cafe333-7531-48e6-8ff4-cc217bd3777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:16.646257 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:16.679998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 652/1330] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:09:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:16.718799 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6512bf8-9972-4a59-970f-f287e2ee36ae None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:16.720382 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b6512bf8-9972-4a59-970f-f287e2ee36ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:16.842208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6512bf8-9972-4a59-970f-f287e2ee36ae None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:16.863724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:16.919026 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba477d-877d-4582-a813-1bf724c1f546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:16.919671 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba477d-877d-4582-a813-1bf724c1f546 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:16.919948 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba477d-877d-4582-a813-1bf724c1f546 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:16.920201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba477d-877d-4582-a813-1bf724c1f546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:16.921827 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f8ba477d-877d-4582-a813-1bf724c1f546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:17.036389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba477d-877d-4582-a813-1bf724c1f546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:17.037848 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba477d-877d-4582-a813-1bf724c1f546 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:17.057251 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 679/1331] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:19.339574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9fe51-49b3-4b7c-b4ce-03c2ec68a71c None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:19.340469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9fe51-49b3-4b7c-b4ce-03c2ec68a71c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:19.340469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9fe51-49b3-4b7c-b4ce-03c2ec68a71c None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:19.342473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 653/1332] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:09:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:19.348783 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b470aa3-fad3-4e87-9cd5-64248e57f147 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:19.349506 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b470aa3-fad3-4e87-9cd5-64248e57f147 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:19.349641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b470aa3-fad3-4e87-9cd5-64248e57f147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:19.417442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:19.420996 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-5b470aa3-fad3-4e87-9cd5-64248e57f147 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:19.422900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5b470aa3-fad3-4e87-9cd5-64248e57f147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:19.525099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 680/1333] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:19.565576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9fe51-49b3-4b7c-b4ce-03c2ec68a71c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:19.568101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-99b9fe51-49b3-4b7c-b4ce-03c2ec68a71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:19.687248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9fe51-49b3-4b7c-b4ce-03c2ec68a71c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:19.768001 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a50da9-e546-47f1-90cd-2463cb9f336a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:19.768650 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a50da9-e546-47f1-90cd-2463cb9f336a service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:19.768938 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a50da9-e546-47f1-90cd-2463cb9f336a service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:19.769217 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a50da9-e546-47f1-90cd-2463cb9f336a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:19.770898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c4a50da9-e546-47f1-90cd-2463cb9f336a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:19.800381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:19.888698 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a50da9-e546-47f1-90cd-2463cb9f336a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:19.890153 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a50da9-e546-47f1-90cd-2463cb9f336a service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:19.911506 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 654/1334] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:21.985375 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8587d4-5a56-40dd-9bff-250a2f28c775 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:21.985931 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8587d4-5a56-40dd-9bff-250a2f28c775 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:21.986036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8587d4-5a56-40dd-9bff-250a2f28c775 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:21.988308 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 681/1335] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:09:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:21.995749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927c64a-031b-4ec0-9640-82af1e6982bf None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:21.996202 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927c64a-031b-4ec0-9640-82af1e6982bf None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:21.996312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927c64a-031b-4ec0-9640-82af1e6982bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:22.062969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6927c64a-031b-4ec0-9640-82af1e6982bf None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:22.064175 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6927c64a-031b-4ec0-9640-82af1e6982bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:22.150129 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:22.174248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 655/1336] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:09:22.221790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8587d4-5a56-40dd-9bff-250a2f28c775 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:22.224325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9c8587d4-5a56-40dd-9bff-250a2f28c775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:22.359415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8587d4-5a56-40dd-9bff-250a2f28c775 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:22.389148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:22.443982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5ade5-fa1e-4fa9-8139-bfdd68916bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:22.444644 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5ade5-fa1e-4fa9-8139-bfdd68916bea service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:22.444930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5ade5-fa1e-4fa9-8139-bfdd68916bea service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:22.445236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5ade5-fa1e-4fa9-8139-bfdd68916bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:22.447016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f6c5ade5-fa1e-4fa9-8139-bfdd68916bea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:22.563997 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5ade5-fa1e-4fa9-8139-bfdd68916bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:22.565585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5ade5-fa1e-4fa9-8139-bfdd68916bea service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:22.584988 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 682/1337] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:25.117190 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aae8e7-ee22-4cd1-8e58-b16baa405816 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:25.117821 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aae8e7-ee22-4cd1-8e58-b16baa405816 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:25.117821 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aae8e7-ee22-4cd1-8e58-b16baa405816 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:25.119280 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 656/1338] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:25.126213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd45951-5c90-445e-894f-22370eea9e3e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:25.126778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd45951-5c90-445e-894f-22370eea9e3e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:25.126778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd45951-5c90-445e-894f-22370eea9e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:25.202968 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-6dd45951-5c90-445e-894f-22370eea9e3e None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:25.204202 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6dd45951-5c90-445e-894f-22370eea9e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:25.213247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:25.324742 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 683/1339] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:09:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:25.367446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aae8e7-ee22-4cd1-8e58-b16baa405816 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:25.369038 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-32aae8e7-ee22-4cd1-8e58-b16baa405816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:25.498729 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aae8e7-ee22-4cd1-8e58-b16baa405816 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:25.576974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2dda4-132e-4712-943c-5771187d3d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:25.577611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2dda4-132e-4712-943c-5771187d3d89 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:25.577890 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2dda4-132e-4712-943c-5771187d3d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:25.578164 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2dda4-132e-4712-943c-5771187d3d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:25.579815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fba2dda4-132e-4712-943c-5771187d3d89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:25.617823 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:25.703371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2dda4-132e-4712-943c-5771187d3d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:25.704827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2dda4-132e-4712-943c-5771187d3d89 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:25.722895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 657/1340] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:09:29.994707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8267bfa-21a1-4bda-8e05-e997193df0a4 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:29.995246 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8267bfa-21a1-4bda-8e05-e997193df0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:29.995246 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8267bfa-21a1-4bda-8e05-e997193df0a4 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:29.996695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 684/1341] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:30.002324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248ecc3-c413-43e5-b693-cfd536c5be96 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:30.002790 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248ecc3-c413-43e5-b693-cfd536c5be96 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:30.002900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248ecc3-c413-43e5-b693-cfd536c5be96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:30.071928 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3248ecc3-c413-43e5-b693-cfd536c5be96 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:30.073221 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3248ecc3-c413-43e5-b693-cfd536c5be96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:30.164456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:30.177985 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 658/1342] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:30.217557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8267bfa-21a1-4bda-8e05-e997193df0a4 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:30.219265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f8267bfa-21a1-4bda-8e05-e997193df0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:30.337325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8267bfa-21a1-4bda-8e05-e997193df0a4 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:30.379256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:30.421693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19dc1f-a9f9-4ebe-a5ff-a850905c62d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:30.422420 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19dc1f-a9f9-4ebe-a5ff-a850905c62d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:30.422722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19dc1f-a9f9-4ebe-a5ff-a850905c62d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:30.423037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19dc1f-a9f9-4ebe-a5ff-a850905c62d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:30.425242 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-fe19dc1f-a9f9-4ebe-a5ff-a850905c62d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:30.545859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19dc1f-a9f9-4ebe-a5ff-a850905c62d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:30.547413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19dc1f-a9f9-4ebe-a5ff-a850905c62d0 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:30.568289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 685/1343] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:33.170681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0eb5df-c313-405b-94e8-7007072a7346 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:33.171269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0eb5df-c313-405b-94e8-7007072a7346 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:33.171269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0eb5df-c313-405b-94e8-7007072a7346 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:33.172920 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 659/1344] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:33.178676 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094b58f-06c4-4325-9daf-042f3a1dc9f3 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:33.179152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094b58f-06c4-4325-9daf-042f3a1dc9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:33.179242 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094b58f-06c4-4325-9daf-042f3a1dc9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:33.253632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-e094b58f-06c4-4325-9daf-042f3a1dc9f3 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:33.254889 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e094b58f-06c4-4325-9daf-042f3a1dc9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:33.275172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:33.363419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 686/1345] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:09:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:33.401130 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0eb5df-c313-405b-94e8-7007072a7346 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:33.402782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ab0eb5df-c313-405b-94e8-7007072a7346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:33.513466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0eb5df-c313-405b-94e8-7007072a7346 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:33.589136 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067fa13-02d4-4364-a463-72f863393b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:33.589807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067fa13-02d4-4364-a463-72f863393b4e service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:33.590087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067fa13-02d4-4364-a463-72f863393b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:33.590372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067fa13-02d4-4364-a463-72f863393b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:33.592028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5067fa13-02d4-4364-a463-72f863393b4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:33.639144 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:33.709991 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067fa13-02d4-4364-a463-72f863393b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:33.711450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067fa13-02d4-4364-a463-72f863393b4e service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:33.732377 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 660/1346] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:38.064603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916207c7-2a2d-4281-b2d0-ba42b6c1f221 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:38.065146 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916207c7-2a2d-4281-b2d0-ba42b6c1f221 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:38.065146 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916207c7-2a2d-4281-b2d0-ba42b6c1f221 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:38.066789 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 687/1347] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:38.072470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc0bad-28bf-43df-afa3-776c5c4ef255 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:38.072966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc0bad-28bf-43df-afa3-776c5c4ef255 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:38.073049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc0bad-28bf-43df-afa3-776c5c4ef255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:38.154170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-50fc0bad-28bf-43df-afa3-776c5c4ef255 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:38.155483 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-50fc0bad-28bf-43df-afa3-776c5c4ef255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:38.268086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:38.271441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 661/1348] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:38.309905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916207c7-2a2d-4281-b2d0-ba42b6c1f221 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:38.311571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-916207c7-2a2d-4281-b2d0-ba42b6c1f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:38.428018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916207c7-2a2d-4281-b2d0-ba42b6c1f221 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:38.480558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:38.511036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26add72-a3c5-483a-beba-55bc153a228a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:38.511723 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26add72-a3c5-483a-beba-55bc153a228a service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:38.512000 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26add72-a3c5-483a-beba-55bc153a228a service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:38.512281 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26add72-a3c5-483a-beba-55bc153a228a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:38.514017 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b26add72-a3c5-483a-beba-55bc153a228a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:38.628561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26add72-a3c5-483a-beba-55bc153a228a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:38.630042 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26add72-a3c5-483a-beba-55bc153a228a service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:38.649175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 688/1349] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:43.587011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717630fa-1e45-4165-864b-89229717c9db None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:43.587946 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717630fa-1e45-4165-864b-89229717c9db None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:43.588365 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717630fa-1e45-4165-864b-89229717c9db None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:43.590196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 662/1350] 10.222.0.99 () {54 vars in 921 bytes} [Mon Jul 18 14:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:43.595213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c276fc7-da15-422c-be1f-ad46760ac67a None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:43.595945 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c276fc7-da15-422c-be1f-ad46760ac67a None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:43.596361 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c276fc7-da15-422c-be1f-ad46760ac67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:43.681035 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-1c276fc7-da15-422c-be1f-ad46760ac67a None None] MFA Rules not processed for user `92b73e1a514148b19bb6a1d2a39e32cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:43.683336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1c276fc7-da15-422c-be1f-ad46760ac67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:43.704483 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:43.802258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 689/1351] 10.222.0.99 () {58 vars in 1018 bytes} [Mon Jul 18 14:09:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:47.999462 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832803e8-bb66-44ba-bc57-a4c200c0cdd0 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:48.000049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832803e8-bb66-44ba-bc57-a4c200c0cdd0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:48.000049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832803e8-bb66-44ba-bc57-a4c200c0cdd0 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:48.001635 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 663/1352] 10.222.0.99 () {54 vars in 921 bytes} [Mon Jul 18 14:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:48.007046 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3785e-dd1a-4927-86ca-123566b30ddd None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:48.007569 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3785e-dd1a-4927-86ca-123566b30ddd None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:48.007852 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3785e-dd1a-4927-86ca-123566b30ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:48.092009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-02e3785e-dd1a-4927-86ca-123566b30ddd None None] MFA Rules not processed for user `92b73e1a514148b19bb6a1d2a39e32cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:48.093218 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-02e3785e-dd1a-4927-86ca-123566b30ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:48.209862 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:48.232806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 690/1353] 10.222.0.99 () {58 vars in 1018 bytes} [Mon Jul 18 14:09:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:49.367708 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1ba7-1fb8-4c7e-9675-b5404ee28bae None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:49.368288 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1ba7-1fb8-4c7e-9675-b5404ee28bae None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:49.368288 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1ba7-1fb8-4c7e-9675-b5404ee28bae None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:49.369653 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 664/1354] 10.222.0.99 () {54 vars in 921 bytes} [Mon Jul 18 14:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:49.379396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3ba1-354c-4e9e-9b45-fa2b35489d8b None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:49.379957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3ba1-354c-4e9e-9b45-fa2b35489d8b None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:49.379957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3ba1-354c-4e9e-9b45-fa2b35489d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:49.469972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-54db3ba1-354c-4e9e-9b45-fa2b35489d8b None None] MFA Rules not processed for user `92b73e1a514148b19bb6a1d2a39e32cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:49.471130 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-54db3ba1-354c-4e9e-9b45-fa2b35489d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:49.583092 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 691/1355] 10.222.0.99 () {58 vars in 1018 bytes} [Mon Jul 18 14:09:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:52.954656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcd0bc-0298-4f92-8137-9a7ab3a87f66 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:52.955633 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcd0bc-0298-4f92-8137-9a7ab3a87f66 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:52.956116 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcd0bc-0298-4f92-8137-9a7ab3a87f66 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:52.958619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 665/1356] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:09:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:52.964464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926ad6d-e9a3-4f44-98cb-4592c4c6edd8 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:52.965382 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926ad6d-e9a3-4f44-98cb-4592c4c6edd8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:52.966691 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926ad6d-e9a3-4f44-98cb-4592c4c6edd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:53.009473 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:53.048173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-a926ad6d-e9a3-4f44-98cb-4592c4c6edd8 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:53.049632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a926ad6d-e9a3-4f44-98cb-4592c4c6edd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:53.170484 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 692/1357] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:53.230107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46233e1e-417b-4cea-bb21-a8836268c933 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:53.230688 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46233e1e-417b-4cea-bb21-a8836268c933 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:53.231110 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46233e1e-417b-4cea-bb21-a8836268c933 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:53.232619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 666/1358] 10.222.0.99 () {54 vars in 962 bytes} [Mon Jul 18 14:09:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:53.241572 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbcc12-5048-4cd5-ba28-261f9d97e947 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:53.242641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbcc12-5048-4cd5-ba28-261f9d97e947 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:53.243799 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbcc12-5048-4cd5-ba28-261f9d97e947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:53.332283 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-e9bbcc12-5048-4cd5-ba28-261f9d97e947 None None] MFA Rules not processed for user `b1b66b55e0374152828913910c4002f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:53.333505 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e9bbcc12-5048-4cd5-ba28-261f9d97e947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:53.387963 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:53.457423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 693/1359] 10.222.0.99 () {58 vars in 1059 bytes} [Mon Jul 18 14:09:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:53.465405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46233e1e-417b-4cea-bb21-a8836268c933 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:53.467260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-46233e1e-417b-4cea-bb21-a8836268c933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:53.620844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46233e1e-417b-4cea-bb21-a8836268c933 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:53.696638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:53.738546 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a564af-0c3b-4ec0-ad0b-6bfe54f09efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:53.739128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a564af-0c3b-4ec0-ad0b-6bfe54f09efc service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:53.739412 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a564af-0c3b-4ec0-ad0b-6bfe54f09efc service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:53.739687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a564af-0c3b-4ec0-ad0b-6bfe54f09efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:53.741323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-46a564af-0c3b-4ec0-ad0b-6bfe54f09efc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:53.835290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a564af-0c3b-4ec0-ad0b-6bfe54f09efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:53.836990 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a564af-0c3b-4ec0-ad0b-6bfe54f09efc service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:53.857287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 667/1360] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:56.088202 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4086ce-2ed2-4b45-ac3c-f1eedaba3592 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.088761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4086ce-2ed2-4b45-ac3c-f1eedaba3592 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.088761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4086ce-2ed2-4b45-ac3c-f1eedaba3592 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.090221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 694/1361] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:09:56.095721 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15272f10-ee3d-4bc5-8b0f-a92c3ab4ab6b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.096210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15272f10-ee3d-4bc5-8b0f-a92c3ab4ab6b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.096292 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15272f10-ee3d-4bc5-8b0f-a92c3ab4ab6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.173679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-15272f10-ee3d-4bc5-8b0f-a92c3ab4ab6b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:56.174928 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-15272f10-ee3d-4bc5-8b0f-a92c3ab4ab6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:56.213903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:56.283023 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 668/1362] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:56.329204 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4086ce-2ed2-4b45-ac3c-f1eedaba3592 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:56.330769 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ce4086ce-2ed2-4b45-ac3c-f1eedaba3592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:56.515908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4086ce-2ed2-4b45-ac3c-f1eedaba3592 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:56.530921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:56.657231 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c3702-7cb1-4844-82ff-70dedf57abb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:56.657891 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c3702-7cb1-4844-82ff-70dedf57abb2 service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:56.658176 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c3702-7cb1-4844-82ff-70dedf57abb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:56.658483 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c3702-7cb1-4844-82ff-70dedf57abb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:56.660224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-0e2c3702-7cb1-4844-82ff-70dedf57abb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:56.757745 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c3702-7cb1-4844-82ff-70dedf57abb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:56.759378 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c3702-7cb1-4844-82ff-70dedf57abb2 service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:56.778706 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 695/1363] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:09:59.098754 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2627596-7158-4a8d-81b7-82e8e35e9166 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:59.099267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2627596-7158-4a8d-81b7-82e8e35e9166 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:59.099267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2627596-7158-4a8d-81b7-82e8e35e9166 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:59.100613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 669/1364] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:59.106333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d56ba-3aab-4998-8713-165fcca49b41 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:59.107176 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d56ba-3aab-4998-8713-165fcca49b41 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:59.107455 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d56ba-3aab-4998-8713-165fcca49b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:59.128244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:59.201367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-730d56ba-3aab-4998-8713-165fcca49b41 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:59.203099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-730d56ba-3aab-4998-8713-165fcca49b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:59.310448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 696/1365] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:59.358538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd0a1e-9bdd-4efb-919c-166e8a2cf152 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:59.358794 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd0a1e-9bdd-4efb-919c-166e8a2cf152 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:59.359294 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd0a1e-9bdd-4efb-919c-166e8a2cf152 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:59.360998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 670/1366] 10.222.0.99 () {54 vars in 962 bytes} [Mon Jul 18 14:09:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:09:59.366929 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed2501-6499-4ca0-b2e3-53f571c2868e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:59.367308 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed2501-6499-4ca0-b2e3-53f571c2868e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:59.367685 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed2501-6499-4ca0-b2e3-53f571c2868e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:59.447309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-4eed2501-6499-4ca0-b2e3-53f571c2868e None None] MFA Rules not processed for user `b1b66b55e0374152828913910c4002f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:09:59.448682 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-4eed2501-6499-4ca0-b2e3-53f571c2868e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:59.487064 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:59.577666 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 697/1367] 10.222.0.99 () {58 vars in 1059 bytes} [Mon Jul 18 14:09:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:09:59.585908 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd0a1e-9bdd-4efb-919c-166e8a2cf152 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:09:59.587638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dddd0a1e-9bdd-4efb-919c-166e8a2cf152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:59.746648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd0a1e-9bdd-4efb-919c-166e8a2cf152 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:09:59.767922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:09:59.871707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c14920-f3fc-4683-8f5a-f00e48321eed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:09:59.872823 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c14920-f3fc-4683-8f5a-f00e48321eed service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:09:59.873226 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c14920-f3fc-4683-8f5a-f00e48321eed service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:09:59.873601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c14920-f3fc-4683-8f5a-f00e48321eed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:09:59.875415 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-58c14920-f3fc-4683-8f5a-f00e48321eed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:09:59.970303 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c14920-f3fc-4683-8f5a-f00e48321eed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:09:59.972120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c14920-f3fc-4683-8f5a-f00e48321eed service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:09:59.992176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 671/1368] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:00.947068 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed33c0-fadc-4488-80ca-2f421cdcfef9 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:00.947640 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed33c0-fadc-4488-80ca-2f421cdcfef9 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:00.947640 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed33c0-fadc-4488-80ca-2f421cdcfef9 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:00.948972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 698/1369] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:00.954661 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe35e3-cced-4a2e-bced-8667805d13f1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:00.955109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe35e3-cced-4a2e-bced-8667805d13f1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:00.955366 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe35e3-cced-4a2e-bced-8667805d13f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:00.987940 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:01.028530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d1fe35e3-cced-4a2e-bced-8667805d13f1 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:01.030718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d1fe35e3-cced-4a2e-bced-8667805d13f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:01.150695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 672/1370] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:01.452763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd2a54-c31c-4887-a5dd-e6dcd69dbeb0 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:01.453124 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd2a54-c31c-4887-a5dd-e6dcd69dbeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:01.453382 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd2a54-c31c-4887-a5dd-e6dcd69dbeb0 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:01.455010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 699/1371] 10.222.0.99 () {54 vars in 964 bytes} [Mon Jul 18 14:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:01.460524 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299ed20-0d19-4145-b3bd-4705a8e5a33c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:01.460916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299ed20-0d19-4145-b3bd-4705a8e5a33c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:01.461271 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299ed20-0d19-4145-b3bd-4705a8e5a33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:01.548107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a299ed20-0d19-4145-b3bd-4705a8e5a33c None None] MFA Rules not processed for user `19eb97598f774389ad927867a7023fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:01.549394 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a299ed20-0d19-4145-b3bd-4705a8e5a33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:01.599586 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:01.633201 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 673/1372] 10.222.0.99 () {58 vars in 1061 bytes} [Mon Jul 18 14:10:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:01.640825 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd2a54-c31c-4887-a5dd-e6dcd69dbeb0 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:01.642348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-efcd2a54-c31c-4887-a5dd-e6dcd69dbeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:01.754929 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd2a54-c31c-4887-a5dd-e6dcd69dbeb0 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:01.799359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:01.836424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6ac4e-8ba0-4bbf-afb3-875be4b18ad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:01.837165 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6ac4e-8ba0-4bbf-afb3-875be4b18ad7 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:01.837477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6ac4e-8ba0-4bbf-afb3-875be4b18ad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:01.837725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6ac4e-8ba0-4bbf-afb3-875be4b18ad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:01.839452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-54c6ac4e-8ba0-4bbf-afb3-875be4b18ad7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:01.955073 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6ac4e-8ba0-4bbf-afb3-875be4b18ad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:01.956558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6ac4e-8ba0-4bbf-afb3-875be4b18ad7 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:01.976124 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 700/1373] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:10:02.109151 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33b84b-8985-4014-bfca-51f1eff4b840 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:02.109845 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33b84b-8985-4014-bfca-51f1eff4b840 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:02.109845 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33b84b-8985-4014-bfca-51f1eff4b840 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:02.118322 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 674/1374] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:10:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:02.119087 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1060b3a-04e0-407b-85a4-3ee03361a381 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:02.119087 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1060b3a-04e0-407b-85a4-3ee03361a381 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:02.119087 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1060b3a-04e0-407b-85a4-3ee03361a381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:02.187327 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-e1060b3a-04e0-407b-85a4-3ee03361a381 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:02.188540 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e1060b3a-04e0-407b-85a4-3ee03361a381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:02.209825 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:02.307048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 701/1375] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:02.335552 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33b84b-8985-4014-bfca-51f1eff4b840 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:02.337155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4c33b84b-8985-4014-bfca-51f1eff4b840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:02.496134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33b84b-8985-4014-bfca-51f1eff4b840 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:02.550815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:02.614263 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ae893-f7e7-4de2-bd62-f6793f1aa3ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:02.614948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ae893-f7e7-4de2-bd62-f6793f1aa3ee service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:02.615258 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ae893-f7e7-4de2-bd62-f6793f1aa3ee service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:02.615512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ae893-f7e7-4de2-bd62-f6793f1aa3ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:02.617179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8c7ae893-f7e7-4de2-bd62-f6793f1aa3ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:02.716568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ae893-f7e7-4de2-bd62-f6793f1aa3ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:02.718358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ae893-f7e7-4de2-bd62-f6793f1aa3ee service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:02.737812 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 675/1376] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:04.760117 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4941d-9c18-4ef2-b1fe-271a69d1105e None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:04.760667 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4941d-9c18-4ef2-b1fe-271a69d1105e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:04.760667 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4941d-9c18-4ef2-b1fe-271a69d1105e None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:04.762132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 702/1377] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:04.767457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd51513-8355-44fb-83a3-92f464f5ea5a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:04.767928 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd51513-8355-44fb-83a3-92f464f5ea5a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:04.768023 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd51513-8355-44fb-83a3-92f464f5ea5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:04.840112 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cdd51513-8355-44fb-83a3-92f464f5ea5a None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:04.841317 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cdd51513-8355-44fb-83a3-92f464f5ea5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:04.848387 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:04.954043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 676/1378] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:05.003044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4941d-9c18-4ef2-b1fe-271a69d1105e None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:05.004584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-18f4941d-9c18-4ef2-b1fe-271a69d1105e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:05.177976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4941d-9c18-4ef2-b1fe-271a69d1105e None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:05.181769 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:05.295625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20dcf5-f46b-4292-ab10-32552e999bde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:05.296289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20dcf5-f46b-4292-ab10-32552e999bde service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:05.296879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20dcf5-f46b-4292-ab10-32552e999bde service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:05.297159 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20dcf5-f46b-4292-ab10-32552e999bde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:05.298860 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-cc20dcf5-f46b-4292-ab10-32552e999bde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:05.417059 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20dcf5-f46b-4292-ab10-32552e999bde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:05.418708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20dcf5-f46b-4292-ab10-32552e999bde service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:05.436972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 703/1379] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:07.495383 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b5f41-d268-459a-9316-90073513af58 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:07.495908 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b5f41-d268-459a-9316-90073513af58 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:07.495908 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b5f41-d268-459a-9316-90073513af58 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:07.497781 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 677/1380] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:07.503378 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac21315-8ba0-4ee0-985b-c8d32e75eeea None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:07.504376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac21315-8ba0-4ee0-985b-c8d32e75eeea None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:07.505102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac21315-8ba0-4ee0-985b-c8d32e75eeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:07.520449 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:07.594334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-eac21315-8ba0-4ee0-985b-c8d32e75eeea None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:07.595953 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-eac21315-8ba0-4ee0-985b-c8d32e75eeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:07.718432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 704/1381] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:07.758545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b5f41-d268-459a-9316-90073513af58 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:07.760058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-032b5f41-d268-459a-9316-90073513af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:07.903803 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:07.915664 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b5f41-d268-459a-9316-90073513af58 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:08.034529 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45451a21-1dce-4237-a994-eeb09da4942d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:08.035184 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45451a21-1dce-4237-a994-eeb09da4942d service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:08.035467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45451a21-1dce-4237-a994-eeb09da4942d service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:08.035743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45451a21-1dce-4237-a994-eeb09da4942d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:08.037373 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-45451a21-1dce-4237-a994-eeb09da4942d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:08.133907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45451a21-1dce-4237-a994-eeb09da4942d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:08.135563 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45451a21-1dce-4237-a994-eeb09da4942d service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:08.151679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:08.160496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 678/1382] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:10.415186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd26d05-c72d-486e-9c3a-2f38ecf3dfd8 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:10.416176 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd26d05-c72d-486e-9c3a-2f38ecf3dfd8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:10.416176 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd26d05-c72d-486e-9c3a-2f38ecf3dfd8 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:10.417105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 705/1383] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:10.422643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede384c6-c482-4aa4-aa44-dde14163d158 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:10.423290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede384c6-c482-4aa4-aa44-dde14163d158 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:10.423290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede384c6-c482-4aa4-aa44-dde14163d158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:10.500614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ede384c6-c482-4aa4-aa44-dde14163d158 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:10.502235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ede384c6-c482-4aa4-aa44-dde14163d158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:10.608667 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 679/1384] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:10.654603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd26d05-c72d-486e-9c3a-2f38ecf3dfd8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:10.656735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2bd26d05-c72d-486e-9c3a-2f38ecf3dfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:10.777621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:10.842799 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd26d05-c72d-486e-9c3a-2f38ecf3dfd8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:10.962301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ee4ab-ce93-427a-9746-603bb30a6cb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:10.962905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ee4ab-ce93-427a-9746-603bb30a6cb8 service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:10.963205 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ee4ab-ce93-427a-9746-603bb30a6cb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:10.963513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ee4ab-ce93-427a-9746-603bb30a6cb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:10.965187 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-200ee4ab-ce93-427a-9746-603bb30a6cb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:11.032818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:11.082378 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ee4ab-ce93-427a-9746-603bb30a6cb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:11.084112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ee4ab-ce93-427a-9746-603bb30a6cb8 service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:11.103023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 706/1385] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:13.158964 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f1355-1e19-438e-8440-e53880584d59 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:13.159448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f1355-1e19-438e-8440-e53880584d59 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:13.159546 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f1355-1e19-438e-8440-e53880584d59 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:13.161023 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 680/1386] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:13.166804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebc9b6-5801-4313-a70d-6f62eb6e78e1 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:13.167398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebc9b6-5801-4313-a70d-6f62eb6e78e1 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:13.167398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebc9b6-5801-4313-a70d-6f62eb6e78e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:13.241707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-2cebc9b6-5801-4313-a70d-6f62eb6e78e1 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:13.243581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2cebc9b6-5801-4313-a70d-6f62eb6e78e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:13.346856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 707/1387] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:10:13.392575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f1355-1e19-438e-8440-e53880584d59 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:13.394068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-502f1355-1e19-438e-8440-e53880584d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:13.472258 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:13.547512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f1355-1e19-438e-8440-e53880584d59 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:13.687009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38eae81-dd45-4b68-aa4d-fe74c4f58a19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:13.687664 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38eae81-dd45-4b68-aa4d-fe74c4f58a19 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:13.687951 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38eae81-dd45-4b68-aa4d-fe74c4f58a19 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:13.688231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38eae81-dd45-4b68-aa4d-fe74c4f58a19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:13.689898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d38eae81-dd45-4b68-aa4d-fe74c4f58a19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:13.736556 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:13.790997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38eae81-dd45-4b68-aa4d-fe74c4f58a19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:13.792644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38eae81-dd45-4b68-aa4d-fe74c4f58a19 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:13.811307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 681/1388] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:15.860239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a45a4-b1f2-4f31-b773-6ac6901148fa None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:15.860851 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a45a4-b1f2-4f31-b773-6ac6901148fa None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:15.860851 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a45a4-b1f2-4f31-b773-6ac6901148fa None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:15.862271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 708/1389] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:15.867928 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf9f8d-1b2a-4809-abd2-a98e159b3a8f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:15.868339 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf9f8d-1b2a-4809-abd2-a98e159b3a8f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:15.868552 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf9f8d-1b2a-4809-abd2-a98e159b3a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:15.935238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1ecf9f8d-1b2a-4809-abd2-a98e159b3a8f None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:15.936466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1ecf9f8d-1b2a-4809-abd2-a98e159b3a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:16.035419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 682/1390] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:16.080750 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a45a4-b1f2-4f31-b773-6ac6901148fa None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:16.082274 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-006a45a4-b1f2-4f31-b773-6ac6901148fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:16.116121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:16.240067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a45a4-b1f2-4f31-b773-6ac6901148fa None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:16.346359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:16.359253 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1dc4b-f27c-4f99-b59c-152171427c26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:16.359908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1dc4b-f27c-4f99-b59c-152171427c26 service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:16.360190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1dc4b-f27c-4f99-b59c-152171427c26 service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:16.360462 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1dc4b-f27c-4f99-b59c-152171427c26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:16.362117 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f4f1dc4b-f27c-4f99-b59c-152171427c26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:16.461572 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1dc4b-f27c-4f99-b59c-152171427c26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:16.463206 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1dc4b-f27c-4f99-b59c-152171427c26 service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:16.483626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 709/1391] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:17.059798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23b410-1226-47e3-83d0-f969c4ed9b87 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:17.060369 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23b410-1226-47e3-83d0-f969c4ed9b87 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:17.060369 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23b410-1226-47e3-83d0-f969c4ed9b87 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:17.061754 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 683/1392] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:17.067258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7575bd6-fa2f-426d-bd9c-bd464f17d9a2 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:17.067722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7575bd6-fa2f-426d-bd9c-bd464f17d9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:17.067818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7575bd6-fa2f-426d-bd9c-bd464f17d9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:17.258141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-a7575bd6-fa2f-426d-bd9c-bd464f17d9a2 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:17.259384 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a7575bd6-fa2f-426d-bd9c-bd464f17d9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:17.329621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:17.368039 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 710/1393] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:17.424072 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd59bd-900b-4c9f-9eaa-542f743c7ee2 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:17.424361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd59bd-900b-4c9f-9eaa-542f743c7ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:17.424640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd59bd-900b-4c9f-9eaa-542f743c7ee2 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:17.426063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 684/1394] 10.222.0.99 () {54 vars in 961 bytes} [Mon Jul 18 14:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:17.431448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13661e56-e204-4bfa-95de-baee7614afba None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:17.431945 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13661e56-e204-4bfa-95de-baee7614afba None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:17.432226 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13661e56-e204-4bfa-95de-baee7614afba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:17.508100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-13661e56-e204-4bfa-95de-baee7614afba None None] MFA Rules not processed for user `927543219de847b88b97fbe4f343d2be`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:17.509672 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-13661e56-e204-4bfa-95de-baee7614afba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:17.590365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 711/1395] 10.222.0.99 () {58 vars in 1058 bytes} [Mon Jul 18 14:10:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:17.598273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd59bd-900b-4c9f-9eaa-542f743c7ee2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:17.599822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c8fd59bd-900b-4c9f-9eaa-542f743c7ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:17.614213 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:17.715907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd59bd-900b-4c9f-9eaa-542f743c7ee2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:17.792780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb712a64-016a-4a45-9e22-e3add3baec8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '927543219de847b88b97fbe4f343d2be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:17.793433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb712a64-016a-4a45-9e22-e3add3baec8c service glance] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:17.793714 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb712a64-016a-4a45-9e22-e3add3baec8c service glance] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:17.793968 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb712a64-016a-4a45-9e22-e3add3baec8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:17.795659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fb712a64-016a-4a45-9e22-e3add3baec8c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:17.864180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:17.906408 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb712a64-016a-4a45-9e22-e3add3baec8c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:17.907866 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb712a64-016a-4a45-9e22-e3add3baec8c service glance] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:17.926077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 685/1396] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:18.528361 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b41978-c4b9-45eb-b11b-e3a987c1154f None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:18.529001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b41978-c4b9-45eb-b11b-e3a987c1154f None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:18.529001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b41978-c4b9-45eb-b11b-e3a987c1154f None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:18.530287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 712/1397] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:18.536265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22800-6e3a-4b13-aa7f-6a179e19535f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:18.537228 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22800-6e3a-4b13-aa7f-6a179e19535f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:18.537509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22800-6e3a-4b13-aa7f-6a179e19535f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:18.610190 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-24a22800-6e3a-4b13-aa7f-6a179e19535f None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:18.611494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-24a22800-6e3a-4b13-aa7f-6a179e19535f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:18.652150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b7390-65e4-453f-a73f-6f76466b1400 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:18.652434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b7390-65e4-453f-a73f-6f76466b1400 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:18.652705 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b7390-65e4-453f-a73f-6f76466b1400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:18.720212 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-f22b7390-65e4-453f-a73f-6f76466b1400 None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:18.721377 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f22b7390-65e4-453f-a73f-6f76466b1400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:18.723033 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 686/1398] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:18.729935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:18.768813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a22800-6e3a-4b13-aa7f-6a179e19535f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:18.770022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-24a22800-6e3a-4b13-aa7f-6a179e19535f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:18.796484 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:18.809987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 713/1399] 10.222.0.99 () {58 vars in 1009 bytes} [Mon Jul 18 14:10:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:10:18.856448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7f8d-2da0-4395-b0fc-556c40aa59ff None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:18.856734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7f8d-2da0-4395-b0fc-556c40aa59ff None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:18.857092 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d7f8d-2da0-4395-b0fc-556c40aa59ff None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:18.858589 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 714/1400] 10.222.0.99 () {54 vars in 943 bytes} [Mon Jul 18 14:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:18.864780 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc312c6d-ba6b-436f-968a-71bd7a95e76e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:18.865067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc312c6d-ba6b-436f-968a-71bd7a95e76e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:18.865343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc312c6d-ba6b-436f-968a-71bd7a95e76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:18.890650 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a22800-6e3a-4b13-aa7f-6a179e19535f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:18.940145 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-cc312c6d-ba6b-436f-968a-71bd7a95e76e None None] MFA Rules not processed for user `55fe1a286c2045d5bcd49895a878a3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:18.941437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-cc312c6d-ba6b-436f-968a-71bd7a95e76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:19.007636 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8fc1b-5b12-44e5-9521-c0beed31bcc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:19.008200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8fc1b-5b12-44e5-9521-c0beed31bcc0 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:19.008481 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8fc1b-5b12-44e5-9521-c0beed31bcc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:19.008758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8fc1b-5b12-44e5-9521-c0beed31bcc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:19.010453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-70b8fc1b-5b12-44e5-9521-c0beed31bcc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:19.029031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:19.031454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:19.054569 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 715/1401] 10.222.0.99 () {58 vars in 1040 bytes} [Mon Jul 18 14:10:18 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:10:19.064072 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc312c6d-ba6b-436f-968a-71bd7a95e76e None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:19.073405 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc312c6d-ba6b-436f-968a-71bd7a95e76e None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:19.104730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8fc1b-5b12-44e5-9521-c0beed31bcc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:19.106176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8fc1b-5b12-44e5-9521-c0beed31bcc0 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:19.126211 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 687/1402] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:10:19.185550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94aeaa-c95e-420f-8c5d-dc415370f055 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:19.186532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94aeaa-c95e-420f-8c5d-dc415370f055 service swift] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:19.186813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94aeaa-c95e-420f-8c5d-dc415370f055 service swift] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:19.187089 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94aeaa-c95e-420f-8c5d-dc415370f055 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:19.188768 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-bf94aeaa-c95e-420f-8c5d-dc415370f055 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:19.283586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94aeaa-c95e-420f-8c5d-dc415370f055 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:19.285290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94aeaa-c95e-420f-8c5d-dc415370f055 service swift] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:19.294789 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 716/1403] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:10:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:10:21.195549 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7bc85-f931-4509-909a-8b1df5244825 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:21.196240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7bc85-f931-4509-909a-8b1df5244825 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:21.196240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7bc85-f931-4509-909a-8b1df5244825 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:21.197507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 688/1404] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:21.202971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ea69-71f0-4a41-ac87-133d5c0c21ec None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:21.203424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ea69-71f0-4a41-ac87-133d5c0c21ec None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:21.203518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4ea69-71f0-4a41-ac87-133d5c0c21ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:21.213757 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:21.278418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-14d4ea69-71f0-4a41-ac87-133d5c0c21ec None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:21.279757 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-14d4ea69-71f0-4a41-ac87-133d5c0c21ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:21.391980 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 717/1405] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:21.438061 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7bc85-f931-4509-909a-8b1df5244825 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:21.441142 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dff7bc85-f931-4509-909a-8b1df5244825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:21.607382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:21.610635 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7bc85-f931-4509-909a-8b1df5244825 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:21.733163 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a18223-efea-4116-a002-da786ccf76f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:21.733723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a18223-efea-4116-a002-da786ccf76f9 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:21.734007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a18223-efea-4116-a002-da786ccf76f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:21.734284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a18223-efea-4116-a002-da786ccf76f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:21.735961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-35a18223-efea-4116-a002-da786ccf76f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:21.836998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a18223-efea-4116-a002-da786ccf76f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:21.838847 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a18223-efea-4116-a002-da786ccf76f9 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:21.866662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 689/1406] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:23.900598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6487e-d3b3-44d5-bbc6-30a60a48841a None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:23.901199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6487e-d3b3-44d5-bbc6-30a60a48841a None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:23.901199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6487e-d3b3-44d5-bbc6-30a60a48841a None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:23.902608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 718/1407] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:23.907944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcccab0-08a2-4fc1-9470-8c5a6a675402 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:23.908393 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcccab0-08a2-4fc1-9470-8c5a6a675402 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:23.908477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcccab0-08a2-4fc1-9470-8c5a6a675402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:23.913797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:23.981530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3bcccab0-08a2-4fc1-9470-8c5a6a675402 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:23.983193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3bcccab0-08a2-4fc1-9470-8c5a6a675402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:24.088341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 690/1408] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:10:24.132553 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6487e-d3b3-44d5-bbc6-30a60a48841a None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:24.134142 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-67b6487e-d3b3-44d5-bbc6-30a60a48841a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:24.235568 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:24.303986 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6487e-d3b3-44d5-bbc6-30a60a48841a None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:24.430753 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6bd142-78ac-45b7-b217-9098eb597153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:24.431823 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bd142-78ac-45b7-b217-9098eb597153 service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:24.432266 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bd142-78ac-45b7-b217-9098eb597153 service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:24.433007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bd142-78ac-45b7-b217-9098eb597153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:24.434679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3d6bd142-78ac-45b7-b217-9098eb597153 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:24.496208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:24.545054 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bd142-78ac-45b7-b217-9098eb597153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:24.546692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6bd142-78ac-45b7-b217-9098eb597153 service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:24.565953 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 719/1409] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:34.086128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=64 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:34.563289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=23 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:41.649495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46ab18-87e4-4cab-a372-cc2770ec5e09 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:41.650076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46ab18-87e4-4cab-a372-cc2770ec5e09 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:41.650076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46ab18-87e4-4cab-a372-cc2770ec5e09 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:41.651641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 691/1410] 10.222.0.99 () {54 vars in 918 bytes} [Mon Jul 18 14:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:41.657843 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fb18e-8645-42db-8dd6-e229446a4d34 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:41.658289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fb18e-8645-42db-8dd6-e229446a4d34 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:41.658440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fb18e-8645-42db-8dd6-e229446a4d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:41.740184 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-048fb18e-8645-42db-8dd6-e229446a4d34 None None] MFA Rules not processed for user `92b73e1a514148b19bb6a1d2a39e32cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:41.741376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-048fb18e-8645-42db-8dd6-e229446a4d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:41.877978 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 720/1411] 10.222.0.99 () {58 vars in 1015 bytes} [Mon Jul 18 14:10:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:41.893638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2830d3a-ac1e-437b-b66d-0d7bbb8a7d14 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:41.893927 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2830d3a-ac1e-437b-b66d-0d7bbb8a7d14 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:41.894202 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2830d3a-ac1e-437b-b66d-0d7bbb8a7d14 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:41.895628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 692/1412] 10.222.0.99 () {54 vars in 918 bytes} [Mon Jul 18 14:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:41.901013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba70cf-6093-4f45-a07e-4dd23c9b18ca None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:41.901212 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba70cf-6093-4f45-a07e-4dd23c9b18ca None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:41.901521 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba70cf-6093-4f45-a07e-4dd23c9b18ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:41.977224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:41.980561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-52ba70cf-6093-4f45-a07e-4dd23c9b18ca None None] MFA Rules not processed for user `b1b66b55e0374152828913910c4002f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:41.982506 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-52ba70cf-6093-4f45-a07e-4dd23c9b18ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:42.111327 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 721/1413] 10.222.0.99 () {58 vars in 1015 bytes} [Mon Jul 18 14:10:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:44.592663 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251aa43f-744b-496b-beab-392268ed4624 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:44.593265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251aa43f-744b-496b-beab-392268ed4624 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:44.593265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251aa43f-744b-496b-beab-392268ed4624 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:44.594627 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 693/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:44.600693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d4024-58a8-4f17-88b7-456353b9b3e7 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:44.601141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d4024-58a8-4f17-88b7-456353b9b3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:44.601271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d4024-58a8-4f17-88b7-456353b9b3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:44.681001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-058d4024-58a8-4f17-88b7-456353b9b3e7 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:44.682275 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-058d4024-58a8-4f17-88b7-456353b9b3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:44.749697 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:44.804441 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 722/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:44.853881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251aa43f-744b-496b-beab-392268ed4624 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:44.857158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-251aa43f-744b-496b-beab-392268ed4624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:45.033811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251aa43f-744b-496b-beab-392268ed4624 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:45.114062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:45.160099 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5f1c7-c6f2-453a-a69e-933b13f165c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:45.160940 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5f1c7-c6f2-453a-a69e-933b13f165c4 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:45.161225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5f1c7-c6f2-453a-a69e-933b13f165c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:45.161504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5f1c7-c6f2-453a-a69e-933b13f165c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:45.163255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e6f5f1c7-c6f2-453a-a69e-933b13f165c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:45.269124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5f1c7-c6f2-453a-a69e-933b13f165c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:45.271778 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5f1c7-c6f2-453a-a69e-933b13f165c4 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:45.297133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 694/1416] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:46.221068 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceedd41-6c19-4668-90eb-321f27efe80d None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:46.221963 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceedd41-6c19-4668-90eb-321f27efe80d None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:46.221963 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceedd41-6c19-4668-90eb-321f27efe80d None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:46.224213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 723/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:10:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:46.229619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01196cc-cf50-48e2-a51c-97994058a858 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:46.230085 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01196cc-cf50-48e2-a51c-97994058a858 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:46.230290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01196cc-cf50-48e2-a51c-97994058a858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:46.307582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f01196cc-cf50-48e2-a51c-97994058a858 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:46.308716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f01196cc-cf50-48e2-a51c-97994058a858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:46.344118 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:46.418760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 695/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:46.574305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceedd41-6c19-4668-90eb-321f27efe80d None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:46.576907 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-fceedd41-6c19-4668-90eb-321f27efe80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:46.738856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceedd41-6c19-4668-90eb-321f27efe80d None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:46.782623 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:46.862415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56157cb6-54a6-4353-b3d7-25349a9b70da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:46.863070 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56157cb6-54a6-4353-b3d7-25349a9b70da service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:46.863352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56157cb6-54a6-4353-b3d7-25349a9b70da service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:46.863624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56157cb6-54a6-4353-b3d7-25349a9b70da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:46.865271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-56157cb6-54a6-4353-b3d7-25349a9b70da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:46.973252 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56157cb6-54a6-4353-b3d7-25349a9b70da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:46.974886 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56157cb6-54a6-4353-b3d7-25349a9b70da service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:46.994587 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 724/1419] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:47.895670 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9f884-ace8-4fbd-b271-a6ac518a8ef5 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:47.897100 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9f884-ace8-4fbd-b271-a6ac518a8ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:47.897433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9f884-ace8-4fbd-b271-a6ac518a8ef5 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:47.899636 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 696/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:10:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:47.906919 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6b2a8-361c-4fa7-b77d-69e441800306 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:47.907349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6b2a8-361c-4fa7-b77d-69e441800306 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:47.907468 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6b2a8-361c-4fa7-b77d-69e441800306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:47.968083 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:47.990183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-b3d6b2a8-361c-4fa7-b77d-69e441800306 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:47.991540 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b3d6b2a8-361c-4fa7-b77d-69e441800306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:48.105571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 725/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:10:48.274419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9f884-ace8-4fbd-b271-a6ac518a8ef5 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:48.276048 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-87c9f884-ace8-4fbd-b271-a6ac518a8ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:48.432085 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9f884-ace8-4fbd-b271-a6ac518a8ef5 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:48.444795 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:48.562974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31911ad9-fa11-4484-9cb3-2f79f1720e68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:48.563630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31911ad9-fa11-4484-9cb3-2f79f1720e68 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:48.563915 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31911ad9-fa11-4484-9cb3-2f79f1720e68 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:48.564190 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31911ad9-fa11-4484-9cb3-2f79f1720e68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:48.565840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-31911ad9-fa11-4484-9cb3-2f79f1720e68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:48.659049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31911ad9-fa11-4484-9cb3-2f79f1720e68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:48.660654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31911ad9-fa11-4484-9cb3-2f79f1720e68 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:48.679423 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 697/1422] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:49.571963 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ac6c4-056f-4fec-8867-7f71e5b184e8 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:49.572820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ac6c4-056f-4fec-8867-7f71e5b184e8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:49.572820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ac6c4-056f-4fec-8867-7f71e5b184e8 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:49.574881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 726/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:10:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:49.581222 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c636cb-5e84-4fa3-b818-01aae57b1470 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:49.582151 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c636cb-5e84-4fa3-b818-01aae57b1470 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:49.582151 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c636cb-5e84-4fa3-b818-01aae57b1470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:49.606093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:49.668672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e3c636cb-5e84-4fa3-b818-01aae57b1470 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:49.669875 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e3c636cb-5e84-4fa3-b818-01aae57b1470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:49.782575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 698/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:49.932055 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ac6c4-056f-4fec-8867-7f71e5b184e8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:49.933575 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-4b2ac6c4-056f-4fec-8867-7f71e5b184e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:50.070017 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:50.116605 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ac6c4-056f-4fec-8867-7f71e5b184e8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:50.248492 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13887c-f3bc-4c54-8df3-ccba57f57de6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:50.249063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13887c-f3bc-4c54-8df3-ccba57f57de6 service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:50.249344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13887c-f3bc-4c54-8df3-ccba57f57de6 service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:50.249614 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13887c-f3bc-4c54-8df3-ccba57f57de6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:50.251314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1f13887c-f3bc-4c54-8df3-ccba57f57de6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:50.348395 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:50.365009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13887c-f3bc-4c54-8df3-ccba57f57de6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:50.366701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13887c-f3bc-4c54-8df3-ccba57f57de6 service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:50.385695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 727/1425] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:51.238864 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b43593-5c01-4301-979c-b8df5a13837d None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:51.239711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b43593-5c01-4301-979c-b8df5a13837d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:51.239989 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b43593-5c01-4301-979c-b8df5a13837d None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:51.242016 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 699/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:10:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:51.249078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2dc4a-416d-4e2a-8987-b94979f8534b None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:51.249530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2dc4a-416d-4e2a-8987-b94979f8534b None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:51.249625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2dc4a-416d-4e2a-8987-b94979f8534b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:51.335463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-5ae2dc4a-416d-4e2a-8987-b94979f8534b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:51.337384 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5ae2dc4a-416d-4e2a-8987-b94979f8534b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:51.459854 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 728/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:51.608953 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b43593-5c01-4301-979c-b8df5a13837d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:51.610493 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d1b43593-5c01-4301-979c-b8df5a13837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:51.725148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:51.794054 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b43593-5c01-4301-979c-b8df5a13837d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:51.929115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3e17b-4b23-4b7e-93f3-de0fbdbe9567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:51.929775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3e17b-4b23-4b7e-93f3-de0fbdbe9567 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:51.930060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3e17b-4b23-4b7e-93f3-de0fbdbe9567 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:51.930334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3e17b-4b23-4b7e-93f3-de0fbdbe9567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:51.932044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-30a3e17b-4b23-4b7e-93f3-de0fbdbe9567 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:51.983813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:52.025708 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3e17b-4b23-4b7e-93f3-de0fbdbe9567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:52.027357 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3e17b-4b23-4b7e-93f3-de0fbdbe9567 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:52.047542 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 700/1428] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:52.863415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a11cbd-bb15-4bca-9a7f-e92b7f8a2cd9 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:52.865160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a11cbd-bb15-4bca-9a7f-e92b7f8a2cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:52.865160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a11cbd-bb15-4bca-9a7f-e92b7f8a2cd9 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:52.867607 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 729/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:10:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:52.874707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad5b91-23f9-46f4-84cf-0fbfb92400b6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:52.875175 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad5b91-23f9-46f4-84cf-0fbfb92400b6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:52.875285 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad5b91-23f9-46f4-84cf-0fbfb92400b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:52.949914 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-00ad5b91-23f9-46f4-84cf-0fbfb92400b6 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:52.951177 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-00ad5b91-23f9-46f4-84cf-0fbfb92400b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:53.065505 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 701/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:53.226693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a11cbd-bb15-4bca-9a7f-e92b7f8a2cd9 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:53.228839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d5a11cbd-bb15-4bca-9a7f-e92b7f8a2cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:53.287180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:53.394803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a11cbd-bb15-4bca-9a7f-e92b7f8a2cd9 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:53.518243 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c30abe-f235-42a9-904e-f5f3c1cc377a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:53.518838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c30abe-f235-42a9-904e-f5f3c1cc377a service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:53.519118 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c30abe-f235-42a9-904e-f5f3c1cc377a service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:53.519390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c30abe-f235-42a9-904e-f5f3c1cc377a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:53.521045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-28c30abe-f235-42a9-904e-f5f3c1cc377a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:53.528201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:53.614146 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c30abe-f235-42a9-904e-f5f3c1cc377a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:53.615787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c30abe-f235-42a9-904e-f5f3c1cc377a service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:53.635756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 730/1431] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:54.465625 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382b51d-0060-4191-8df1-d111402b48f2 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:54.466241 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382b51d-0060-4191-8df1-d111402b48f2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:54.466241 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0382b51d-0060-4191-8df1-d111402b48f2 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:54.467605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 702/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:54.473728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0288f26-584b-4d9e-9d06-c187542dff08 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:54.474511 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0288f26-584b-4d9e-9d06-c187542dff08 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:54.474657 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0288f26-584b-4d9e-9d06-c187542dff08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:54.565200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-d0288f26-584b-4d9e-9d06-c187542dff08 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:54.567342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d0288f26-584b-4d9e-9d06-c187542dff08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:54.651141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:54.681385 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 731/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:54.836694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382b51d-0060-4191-8df1-d111402b48f2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:54.838957 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0382b51d-0060-4191-8df1-d111402b48f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:54.864906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:54.998542 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0382b51d-0060-4191-8df1-d111402b48f2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:55.091517 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:55.119724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77653d1b-2499-4a3c-a9d8-291dc0d3f295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:55.120383 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77653d1b-2499-4a3c-a9d8-291dc0d3f295 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:55.120668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77653d1b-2499-4a3c-a9d8-291dc0d3f295 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:55.120945 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77653d1b-2499-4a3c-a9d8-291dc0d3f295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:55.123023 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-77653d1b-2499-4a3c-a9d8-291dc0d3f295 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:55.217926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77653d1b-2499-4a3c-a9d8-291dc0d3f295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:55.219644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77653d1b-2499-4a3c-a9d8-291dc0d3f295 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:55.239635 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 703/1434] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:56.039982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab9e20-2227-4378-9c40-4d97d5e53fba None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:56.040471 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab9e20-2227-4378-9c40-4d97d5e53fba None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:56.040597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab9e20-2227-4378-9c40-4d97d5e53fba None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:56.041931 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 732/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:56.048438 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b5691-7fb1-4e4d-b636-9c9d1c96e3fc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:56.049181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b5691-7fb1-4e4d-b636-9c9d1c96e3fc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:56.049358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b5691-7fb1-4e4d-b636-9c9d1c96e3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:56.138723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b40b5691-7fb1-4e4d-b636-9c9d1c96e3fc None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:56.139986 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b40b5691-7fb1-4e4d-b636-9c9d1c96e3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:56.185470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:56.250605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 704/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:56.409836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab9e20-2227-4378-9c40-4d97d5e53fba None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:56.412387 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-44ab9e20-2227-4378-9c40-4d97d5e53fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:56.576503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab9e20-2227-4378-9c40-4d97d5e53fba None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:56.636126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:56.701822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b632c99-08fe-40a4-abca-32d7ae8e410f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:56.702360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b632c99-08fe-40a4-abca-32d7ae8e410f service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:56.702675 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b632c99-08fe-40a4-abca-32d7ae8e410f service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:56.702943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b632c99-08fe-40a4-abca-32d7ae8e410f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:56.704594 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3b632c99-08fe-40a4-abca-32d7ae8e410f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:56.819099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b632c99-08fe-40a4-abca-32d7ae8e410f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:56.820694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b632c99-08fe-40a4-abca-32d7ae8e410f service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:56.841683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 733/1437] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:10:57.644844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17172ba-4d28-404d-9e66-a947c36914e1 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:57.645427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17172ba-4d28-404d-9e66-a947c36914e1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:57.645427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17172ba-4d28-404d-9e66-a947c36914e1 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:57.646899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 705/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:10:57.652778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe39cb1-d5d2-473e-be2d-153f2c94fbf3 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:57.653458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe39cb1-d5d2-473e-be2d-153f2c94fbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:57.653568 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe39cb1-d5d2-473e-be2d-153f2c94fbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:57.737320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-0fe39cb1-d5d2-473e-be2d-153f2c94fbf3 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:10:57.738562 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-0fe39cb1-d5d2-473e-be2d-153f2c94fbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:57.740867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:57.853048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 734/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:10:58.003302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17172ba-4d28-404d-9e66-a947c36914e1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:10:58.004718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f17172ba-4d28-404d-9e66-a947c36914e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:58.178658 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17172ba-4d28-404d-9e66-a947c36914e1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:10:58.208916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:10:58.308817 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3343539-6950-4d4e-90c8-855c7e829e05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:10:58.309470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3343539-6950-4d4e-90c8-855c7e829e05 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:10:58.309747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3343539-6950-4d4e-90c8-855c7e829e05 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:10:58.310019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3343539-6950-4d4e-90c8-855c7e829e05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:10:58.311690 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f3343539-6950-4d4e-90c8-855c7e829e05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:10:58.409255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3343539-6950-4d4e-90c8-855c7e829e05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:10:58.410911 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3343539-6950-4d4e-90c8-855c7e829e05 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:10:58.429173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 706/1440] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:00.394230 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0a1f8-8a7f-4b3e-92a5-926a8ce6e16b None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:00.394781 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0a1f8-8a7f-4b3e-92a5-926a8ce6e16b None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:00.394781 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0a1f8-8a7f-4b3e-92a5-926a8ce6e16b None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:00.396175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 735/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:11:00.401487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a2c37-5833-4329-a792-09be2066e8db None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:00.401952 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a2c37-5833-4329-a792-09be2066e8db None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:00.402050 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a2c37-5833-4329-a792-09be2066e8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:00.443273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:00.471008 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-094a2c37-5833-4329-a792-09be2066e8db None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:00.472244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-094a2c37-5833-4329-a792-09be2066e8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:00.574837 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 707/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:00.623026 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0a1f8-8a7f-4b3e-92a5-926a8ce6e16b None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:00.624627 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-00c0a1f8-8a7f-4b3e-92a5-926a8ce6e16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:00.744079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0a1f8-8a7f-4b3e-92a5-926a8ce6e16b None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:00.780805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:00.830642 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e795d64-592e-4cae-bc3b-545bffab976e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:00.831296 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e795d64-592e-4cae-bc3b-545bffab976e service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:00.831581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e795d64-592e-4cae-bc3b-545bffab976e service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:00.831854 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e795d64-592e-4cae-bc3b-545bffab976e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:00.833516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-4e795d64-592e-4cae-bc3b-545bffab976e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:00.953794 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e795d64-592e-4cae-bc3b-545bffab976e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:00.955283 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e795d64-592e-4cae-bc3b-545bffab976e service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:00.975846 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 736/1443] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:03.156375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cc1e4-189e-4018-a5d9-eddbee9fd214 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:03.156921 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cc1e4-189e-4018-a5d9-eddbee9fd214 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:03.156921 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cc1e4-189e-4018-a5d9-eddbee9fd214 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:03.158339 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 708/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:11:03.164672 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c8086-2ac5-467d-ab7f-19ea963e902c None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:03.165148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c8086-2ac5-467d-ab7f-19ea963e902c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:03.165258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c8086-2ac5-467d-ab7f-19ea963e902c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:03.237251 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-1d2c8086-2ac5-467d-ab7f-19ea963e902c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:03.238504 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1d2c8086-2ac5-467d-ab7f-19ea963e902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:03.254677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:03.364812 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 737/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:03.409528 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cc1e4-189e-4018-a5d9-eddbee9fd214 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:03.411095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c89cc1e4-189e-4018-a5d9-eddbee9fd214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:03.527555 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cc1e4-189e-4018-a5d9-eddbee9fd214 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:03.543467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:03.607043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7cfa6-3bb0-4441-bd4d-a3e1e805d7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:03.607686 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7cfa6-3bb0-4441-bd4d-a3e1e805d7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:03.607962 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7cfa6-3bb0-4441-bd4d-a3e1e805d7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:03.608232 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7cfa6-3bb0-4441-bd4d-a3e1e805d7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:03.609877 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c0b7cfa6-3bb0-4441-bd4d-a3e1e805d7f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:03.730738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7cfa6-3bb0-4441-bd4d-a3e1e805d7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:03.732096 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7cfa6-3bb0-4441-bd4d-a3e1e805d7f9 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:03.753385 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 709/1446] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:06.067165 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31558dbd-4ad3-4afa-9edd-ee072066cdf6 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:06.067682 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31558dbd-4ad3-4afa-9edd-ee072066cdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:06.067793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31558dbd-4ad3-4afa-9edd-ee072066cdf6 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:06.069907 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 738/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:11:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:11:06.077660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c142946-693b-4425-a991-d840c81b7890 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:06.078069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c142946-693b-4425-a991-d840c81b7890 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:06.078224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c142946-693b-4425-a991-d840c81b7890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:06.133808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:06.163117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1c142946-693b-4425-a991-d840c81b7890 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:06.164878 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1c142946-693b-4425-a991-d840c81b7890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:06.286080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 710/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:06.327260 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31558dbd-4ad3-4afa-9edd-ee072066cdf6 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:06.329777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-31558dbd-4ad3-4afa-9edd-ee072066cdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:06.450200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31558dbd-4ad3-4afa-9edd-ee072066cdf6 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:06.494466 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:06.529721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcd9dc-e766-4cfb-929b-3c1f74faed6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:06.530372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcd9dc-e766-4cfb-929b-3c1f74faed6a service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:06.530704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcd9dc-e766-4cfb-929b-3c1f74faed6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:06.530980 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcd9dc-e766-4cfb-929b-3c1f74faed6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:06.532633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-91bcd9dc-e766-4cfb-929b-3c1f74faed6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:06.638772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcd9dc-e766-4cfb-929b-3c1f74faed6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:06.640209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcd9dc-e766-4cfb-929b-3c1f74faed6a service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:06.660412 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 739/1449] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:08.814051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbb55a-67c3-491d-8240-f47eba8cc3be None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:08.814665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbb55a-67c3-491d-8240-f47eba8cc3be None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:08.814665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbb55a-67c3-491d-8240-f47eba8cc3be None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:08.816976 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 711/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:11:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:11:08.824237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85f19f-9ada-4d70-b3d3-6d8721c391dc None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:08.824647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85f19f-9ada-4d70-b3d3-6d8721c391dc None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:08.824857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85f19f-9ada-4d70-b3d3-6d8721c391dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:08.897008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-4c85f19f-9ada-4d70-b3d3-6d8721c391dc None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:08.898211 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-4c85f19f-9ada-4d70-b3d3-6d8721c391dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:08.920254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:09.012885 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 740/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:09.052994 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbb55a-67c3-491d-8240-f47eba8cc3be None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:09.054573 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-02dbb55a-67c3-491d-8240-f47eba8cc3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:09.167839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbb55a-67c3-491d-8240-f47eba8cc3be None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:09.188929 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:09.249386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db7ee66-ccdb-4d58-83d3-77ec60df0d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:09.250050 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7ee66-ccdb-4d58-83d3-77ec60df0d46 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:09.250332 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7ee66-ccdb-4d58-83d3-77ec60df0d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:09.250640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7ee66-ccdb-4d58-83d3-77ec60df0d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:09.252347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6db7ee66-ccdb-4d58-83d3-77ec60df0d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:09.378266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7ee66-ccdb-4d58-83d3-77ec60df0d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:09.380221 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db7ee66-ccdb-4d58-83d3-77ec60df0d46 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:09.402247 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 712/1452] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:11.446213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902321f-9496-4faf-bd3f-a54c83ab9d29 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:11.446822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902321f-9496-4faf-bd3f-a54c83ab9d29 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:11.446822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902321f-9496-4faf-bd3f-a54c83ab9d29 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:11.448096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 741/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:11:11.453642 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a109d-30f1-473d-be94-303ad3bf0bca None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:11.454087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a109d-30f1-473d-be94-303ad3bf0bca None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:11.454193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a109d-30f1-473d-be94-303ad3bf0bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:11.530673 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:11.533881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-676a109d-30f1-473d-be94-303ad3bf0bca None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:11.535877 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-676a109d-30f1-473d-be94-303ad3bf0bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:11.646703 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 713/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:11.688415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902321f-9496-4faf-bd3f-a54c83ab9d29 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:11.690906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6902321f-9496-4faf-bd3f-a54c83ab9d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:11.825621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902321f-9496-4faf-bd3f-a54c83ab9d29 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:11.877598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:11.902543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1fe2c-bf67-4ba6-8df3-c1c1f6bfbd80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:11.903195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1fe2c-bf67-4ba6-8df3-c1c1f6bfbd80 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:11.903479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1fe2c-bf67-4ba6-8df3-c1c1f6bfbd80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:11.903750 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1fe2c-bf67-4ba6-8df3-c1c1f6bfbd80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:11.905400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-16f1fe2c-bf67-4ba6-8df3-c1c1f6bfbd80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:12.030051 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1fe2c-bf67-4ba6-8df3-c1c1f6bfbd80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:12.031597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1fe2c-bf67-4ba6-8df3-c1c1f6bfbd80 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:12.053058 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 742/1455] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:14.158601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71de60-7bc5-4a32-ba34-1f99cd3df0a9 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:14.159094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71de60-7bc5-4a32-ba34-1f99cd3df0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:14.159094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71de60-7bc5-4a32-ba34-1f99cd3df0a9 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:14.160531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 714/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:11:14.166170 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a827d-2f5c-483b-a257-8d98c2729663 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:14.166701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a827d-2f5c-483b-a257-8d98c2729663 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:14.166798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a827d-2f5c-483b-a257-8d98c2729663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:14.239387 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-8c5a827d-2f5c-483b-a257-8d98c2729663 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:14.240727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8c5a827d-2f5c-483b-a257-8d98c2729663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:14.277112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:14.371611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 743/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:14.414149 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71de60-7bc5-4a32-ba34-1f99cd3df0a9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:14.416546 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dd71de60-7bc5-4a32-ba34-1f99cd3df0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:14.542782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71de60-7bc5-4a32-ba34-1f99cd3df0a9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:14.573684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:14.630904 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7d1e0-e567-4156-82e3-a4a6183572f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:14.631409 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7d1e0-e567-4156-82e3-a4a6183572f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:14.631694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7d1e0-e567-4156-82e3-a4a6183572f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:14.631971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7d1e0-e567-4156-82e3-a4a6183572f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:14.633634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dcf7d1e0-e567-4156-82e3-a4a6183572f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:14.751552 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7d1e0-e567-4156-82e3-a4a6183572f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:14.753015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7d1e0-e567-4156-82e3-a4a6183572f5 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:14.772266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 715/1458] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:16.836837 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f6c1d-15ea-4695-a3d9-532b175a97f8 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:16.837402 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f6c1d-15ea-4695-a3d9-532b175a97f8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:16.837402 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f6c1d-15ea-4695-a3d9-532b175a97f8 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:16.840013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 744/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:11:16.848609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4e815-88a2-4a3d-9a2e-5dc304b557ba None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:16.849626 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4e815-88a2-4a3d-9a2e-5dc304b557ba None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:16.849626 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4e815-88a2-4a3d-9a2e-5dc304b557ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:16.939622 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-74f4e815-88a2-4a3d-9a2e-5dc304b557ba None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:16.940969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-74f4e815-88a2-4a3d-9a2e-5dc304b557ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:16.952515 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:17.049913 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 716/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:17.090271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f6c1d-15ea-4695-a3d9-532b175a97f8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:17.092083 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-0c5f6c1d-15ea-4695-a3d9-532b175a97f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:17.205807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f6c1d-15ea-4695-a3d9-532b175a97f8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:17.263544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:17.282427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f494d00-6d6f-441c-8a31-6998f28823e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:17.283081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f494d00-6d6f-441c-8a31-6998f28823e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:17.283365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f494d00-6d6f-441c-8a31-6998f28823e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:17.283640 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f494d00-6d6f-441c-8a31-6998f28823e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:17.285309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3f494d00-6d6f-441c-8a31-6998f28823e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:17.415845 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f494d00-6d6f-441c-8a31-6998f28823e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:17.417292 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f494d00-6d6f-441c-8a31-6998f28823e8 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:17.437720 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 745/1461] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:19.488198 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd089b-5c94-4022-bda9-1de620cdbc22 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:19.489066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd089b-5c94-4022-bda9-1de620cdbc22 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:19.489066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd089b-5c94-4022-bda9-1de620cdbc22 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:19.491010 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 717/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:11:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:11:19.497722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925d25f-7544-456f-982e-34728d88778c None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:19.498154 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925d25f-7544-456f-982e-34728d88778c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:19.498251 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925d25f-7544-456f-982e-34728d88778c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:19.572572 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-1925d25f-7544-456f-982e-34728d88778c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:19.573799 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1925d25f-7544-456f-982e-34728d88778c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:19.616027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:19.698288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 746/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:19.739393 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd089b-5c94-4022-bda9-1de620cdbc22 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:19.740996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-adbd089b-5c94-4022-bda9-1de620cdbc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:19.853267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd089b-5c94-4022-bda9-1de620cdbc22 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:19.894986 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:19.934220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d682a-47d5-4c45-ae80-2dc824d680f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:19.935248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d682a-47d5-4c45-ae80-2dc824d680f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:19.935599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d682a-47d5-4c45-ae80-2dc824d680f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:19.935957 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d682a-47d5-4c45-ae80-2dc824d680f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:19.938733 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ab0d682a-47d5-4c45-ae80-2dc824d680f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:20.065620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d682a-47d5-4c45-ae80-2dc824d680f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:20.067819 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d682a-47d5-4c45-ae80-2dc824d680f8 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:20.087754 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 718/1464] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:22.102910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a233b-40cf-4a0a-971c-20dcf8e73f0e None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:22.103474 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a233b-40cf-4a0a-971c-20dcf8e73f0e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:22.107378 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a233b-40cf-4a0a-971c-20dcf8e73f0e None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:22.108826 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 747/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:11:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:11:22.118269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a49d74-9496-4dbb-8042-3dddd24246b4 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:22.119323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a49d74-9496-4dbb-8042-3dddd24246b4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:22.119323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a49d74-9496-4dbb-8042-3dddd24246b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:22.201382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-00a49d74-9496-4dbb-8042-3dddd24246b4 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:22.202627 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-00a49d74-9496-4dbb-8042-3dddd24246b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:22.220986 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:22.313181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 719/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:22.352421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a233b-40cf-4a0a-971c-20dcf8e73f0e None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:22.353968 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-190a233b-40cf-4a0a-971c-20dcf8e73f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:22.482956 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a233b-40cf-4a0a-971c-20dcf8e73f0e None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:22.556769 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:22.564411 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539a28a-1be7-41ad-9cd6-5117e238f5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:22.565003 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539a28a-1be7-41ad-9cd6-5117e238f5ba service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:22.565290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539a28a-1be7-41ad-9cd6-5117e238f5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:22.565570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539a28a-1be7-41ad-9cd6-5117e238f5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:22.567279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5539a28a-1be7-41ad-9cd6-5117e238f5ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:22.685633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539a28a-1be7-41ad-9cd6-5117e238f5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:22.687715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539a28a-1be7-41ad-9cd6-5117e238f5ba service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:22.716751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 748/1467] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:24.725471 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0839d-8ffe-4990-ae7a-97adf6f98bdb None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:24.726061 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0839d-8ffe-4990-ae7a-97adf6f98bdb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:24.726061 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0839d-8ffe-4990-ae7a-97adf6f98bdb None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:24.728331 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 720/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:11:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:11:24.736291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8944303-bcbb-41f5-bb98-e24f690f23b5 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:24.736762 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8944303-bcbb-41f5-bb98-e24f690f23b5 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:24.736868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8944303-bcbb-41f5-bb98-e24f690f23b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:24.803325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-a8944303-bcbb-41f5-bb98-e24f690f23b5 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:24.804525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a8944303-bcbb-41f5-bb98-e24f690f23b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:24.861197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:24.906820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 749/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:11:24.944934 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0839d-8ffe-4990-ae7a-97adf6f98bdb None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:24.947263 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-69a0839d-8ffe-4990-ae7a-97adf6f98bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:25.068656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0839d-8ffe-4990-ae7a-97adf6f98bdb None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:25.117319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:25.144949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622d48d-ee5a-4214-a222-5ef55a3d08ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:25.145601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622d48d-ee5a-4214-a222-5ef55a3d08ed service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:25.145898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622d48d-ee5a-4214-a222-5ef55a3d08ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:25.146169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622d48d-ee5a-4214-a222-5ef55a3d08ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:25.148206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b622d48d-ee5a-4214-a222-5ef55a3d08ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:25.268790 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622d48d-ee5a-4214-a222-5ef55a3d08ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:25.270256 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622d48d-ee5a-4214-a222-5ef55a3d08ed service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:25.290137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 721/1470] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:34.904826 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=22 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:35.287558 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=66 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:44.962381 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe783c-af0e-4036-8d27-0e9b21c0e88b None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:44.962902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe783c-af0e-4036-8d27-0e9b21c0e88b None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:44.963018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe783c-af0e-4036-8d27-0e9b21c0e88b None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:44.964379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 750/1471] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:11:44.969928 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e770c-c4b0-47cb-af82-39d2c5f7e415 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:44.970345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e770c-c4b0-47cb-af82-39d2c5f7e415 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:44.970518 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e770c-c4b0-47cb-af82-39d2c5f7e415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:45.040702 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-df7e770c-c4b0-47cb-af82-39d2c5f7e415 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:45.041935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-df7e770c-c4b0-47cb-af82-39d2c5f7e415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:45.151946 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 722/1472] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:45.199667 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43746b61-6b4b-4f54-9d17-6f30128fde93 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:45.199896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43746b61-6b4b-4f54-9d17-6f30128fde93 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:45.200190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43746b61-6b4b-4f54-9d17-6f30128fde93 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:45.201862 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 751/1473] 10.222.0.99 () {54 vars in 961 bytes} [Mon Jul 18 14:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:11:45.206859 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770c317-f2b1-4fb6-ac98-69e93775fd15 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:45.207125 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770c317-f2b1-4fb6-ac98-69e93775fd15 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:45.207495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770c317-f2b1-4fb6-ac98-69e93775fd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:45.285905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f770c317-f2b1-4fb6-ac98-69e93775fd15 None None] MFA Rules not processed for user `927543219de847b88b97fbe4f343d2be`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:45.287189 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f770c317-f2b1-4fb6-ac98-69e93775fd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:45.308651 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:45.370834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 723/1474] 10.222.0.99 () {58 vars in 1058 bytes} [Mon Jul 18 14:11:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:45.378916 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43746b61-6b4b-4f54-9d17-6f30128fde93 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:45.380469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-43746b61-6b4b-4f54-9d17-6f30128fde93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:45.490661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43746b61-6b4b-4f54-9d17-6f30128fde93 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:45.574043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c8108-3c24-4d5a-930b-378419f24fac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '927543219de847b88b97fbe4f343d2be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:45.574726 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c8108-3c24-4d5a-930b-378419f24fac service glance] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:45.575006 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c8108-3c24-4d5a-930b-378419f24fac service glance] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:45.575277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c8108-3c24-4d5a-930b-378419f24fac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:45.576930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-761c8108-3c24-4d5a-930b-378419f24fac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:45.636085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:45.693892 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c8108-3c24-4d5a-930b-378419f24fac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:45.695443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c8108-3c24-4d5a-930b-378419f24fac service glance] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:45.716741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 752/1475] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:11:47.848655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e90c14-172b-4b0b-baae-8ef42ec9b7b0 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:47.849689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e90c14-172b-4b0b-baae-8ef42ec9b7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:47.849689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e90c14-172b-4b0b-baae-8ef42ec9b7b0 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:47.852382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 724/1476] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:11:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:11:47.860965 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1060a-7c29-437a-b833-d2e2e57ad351 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:47.861752 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1060a-7c29-437a-b833-d2e2e57ad351 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:47.861923 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1060a-7c29-437a-b833-d2e2e57ad351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:47.938411 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-aab1060a-7c29-437a-b833-d2e2e57ad351 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:47.940267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-aab1060a-7c29-437a-b833-d2e2e57ad351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:48.056935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 753/1477] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:48.079916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e90c14-172b-4b0b-baae-8ef42ec9b7b0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:48.081443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d5e90c14-172b-4b0b-baae-8ef42ec9b7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:48.220393 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e90c14-172b-4b0b-baae-8ef42ec9b7b0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:48.275326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:48.323623 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e84d7e-bc3a-499b-ac25-e433f85778ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:48.324286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e84d7e-bc3a-499b-ac25-e433f85778ae admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:48.324568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e84d7e-bc3a-499b-ac25-e433f85778ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:48.324841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e84d7e-bc3a-499b-ac25-e433f85778ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:48.325587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e84d7e-bc3a-499b-ac25-e433f85778ae admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:48.327445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: WARNING py.warnings [None req-05e84d7e-bc3a-499b-ac25-e433f85778ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:11:48.327445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: warnings.warn(msg) Jul 18 14:11:48.327445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: Jul 18 14:11:48.328602 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e84d7e-bc3a-499b-ac25-e433f85778ae admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:48.349148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 725/1478] 10.222.0.99 () {56 vars in 1108 bytes} [Mon Jul 18 14:11:48 2022] GET /identity/v3/projects => generated 2553 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:11:50.399905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a08b5-748f-47e7-91f4-b311434bb8a8 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:50.400470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a08b5-748f-47e7-91f4-b311434bb8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:50.400470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a08b5-748f-47e7-91f4-b311434bb8a8 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:50.401863 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 754/1479] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:11:50.407865 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ce3b5-da48-4843-aeba-caf10b209bf3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:50.408537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ce3b5-da48-4843-aeba-caf10b209bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:50.408660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ce3b5-da48-4843-aeba-caf10b209bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:50.493867 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-bc0ce3b5-da48-4843-aeba-caf10b209bf3 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:50.495193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bc0ce3b5-da48-4843-aeba-caf10b209bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:50.621496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 726/1480] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:50.667177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a08b5-748f-47e7-91f4-b311434bb8a8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:50.668921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6a3a08b5-748f-47e7-91f4-b311434bb8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:50.682659 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:50.839882 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a08b5-748f-47e7-91f4-b311434bb8a8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:50.926698 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:50.970056 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9f52c-f77b-43ff-a556-319eb67c21e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:50.970908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9f52c-f77b-43ff-a556-319eb67c21e9 service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:50.971190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9f52c-f77b-43ff-a556-319eb67c21e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:50.971468 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9f52c-f77b-43ff-a556-319eb67c21e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:50.973136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f8d9f52c-f77b-43ff-a556-319eb67c21e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:51.075641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9f52c-f77b-43ff-a556-319eb67c21e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:51.077272 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9f52c-f77b-43ff-a556-319eb67c21e9 service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:51.096134 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 755/1481] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:53.320441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df234ca-df58-4346-b763-4793e472b706 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:53.321071 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df234ca-df58-4346-b763-4793e472b706 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:53.321071 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df234ca-df58-4346-b763-4793e472b706 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:53.323095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 727/1482] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:11:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:11:53.330850 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d94d86-370f-44c1-9a62-80463352f0ba None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:53.331288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d94d86-370f-44c1-9a62-80463352f0ba None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:53.331401 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d94d86-370f-44c1-9a62-80463352f0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:53.399981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-b0d94d86-370f-44c1-9a62-80463352f0ba None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:53.401900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b0d94d86-370f-44c1-9a62-80463352f0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:53.454220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:53.506615 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 756/1483] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:53.546331 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df234ca-df58-4346-b763-4793e472b706 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:53.549044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0df234ca-df58-4346-b763-4793e472b706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:53.583663 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:53.672326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df234ca-df58-4346-b763-4793e472b706 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:53.750173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a08835-e334-4ab2-a81f-fdece3815d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:53.750868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a08835-e334-4ab2-a81f-fdece3815d20 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:53.751152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a08835-e334-4ab2-a81f-fdece3815d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:53.751501 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a08835-e334-4ab2-a81f-fdece3815d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:53.753188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-18a08835-e334-4ab2-a81f-fdece3815d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:53.832105 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:53.882722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a08835-e334-4ab2-a81f-fdece3815d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:53.884171 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a08835-e334-4ab2-a81f-fdece3815d20 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:53.903739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 728/1484] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:55.970948 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de481d1-05a9-478b-8548-efdd0391ce08 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:55.971545 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de481d1-05a9-478b-8548-efdd0391ce08 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:55.971545 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de481d1-05a9-478b-8548-efdd0391ce08 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:55.972885 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 757/1485] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:11:55.978563 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d832fe5-5253-4375-af97-efee5b3cf9b2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:55.979017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d832fe5-5253-4375-af97-efee5b3cf9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:55.979122 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d832fe5-5253-4375-af97-efee5b3cf9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:56.047592 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7d832fe5-5253-4375-af97-efee5b3cf9b2 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:56.048726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7d832fe5-5253-4375-af97-efee5b3cf9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:56.152929 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 729/1486] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:11:56.197288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de481d1-05a9-478b-8548-efdd0391ce08 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:56.198879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1de481d1-05a9-478b-8548-efdd0391ce08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:56.324599 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de481d1-05a9-478b-8548-efdd0391ce08 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:56.401917 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:56.403759 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7dc19f-8b1b-4a60-9eb3-80f6da633728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:56.404405 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dc19f-8b1b-4a60-9eb3-80f6da633728 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:56.404659 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dc19f-8b1b-4a60-9eb3-80f6da633728 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:56.404980 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dc19f-8b1b-4a60-9eb3-80f6da633728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:56.407343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8e7dc19f-8b1b-4a60-9eb3-80f6da633728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:56.524263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dc19f-8b1b-4a60-9eb3-80f6da633728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:56.525697 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dc19f-8b1b-4a60-9eb3-80f6da633728 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:56.544732 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 758/1487] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:11:58.759249 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3687d-cc01-41cb-8115-1f4561f1abec None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:58.760173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3687d-cc01-41cb-8115-1f4561f1abec None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:58.760173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3687d-cc01-41cb-8115-1f4561f1abec None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:58.762415 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 730/1488] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:11:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:11:58.770550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ed40-d587-4876-a156-9ce6d9a1d10d None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:58.771083 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ed40-d587-4876-a156-9ce6d9a1d10d None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:58.771191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ed40-d587-4876-a156-9ce6d9a1d10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:58.840976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-fdf9ed40-d587-4876-a156-9ce6d9a1d10d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:11:58.842189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-fdf9ed40-d587-4876-a156-9ce6d9a1d10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:58.912133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:58.959177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 759/1489] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:11:59.003971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3687d-cc01-41cb-8115-1f4561f1abec None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:11:59.006149 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0cf3687d-cc01-41cb-8115-1f4561f1abec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:59.046914 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:59.118998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3687d-cc01-41cb-8115-1f4561f1abec None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:11:59.194796 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2726e-f810-4457-879c-2469828d525d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:11:59.195444 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2726e-f810-4457-879c-2469828d525d service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:11:59.195719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2726e-f810-4457-879c-2469828d525d service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:11:59.195992 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2726e-f810-4457-879c-2469828d525d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:11:59.197625 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1dd2726e-f810-4457-879c-2469828d525d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:11:59.302726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:59.333712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2726e-f810-4457-879c-2469828d525d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:11:59.335199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2726e-f810-4457-879c-2469828d525d service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:11:59.353656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 731/1490] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:12:01.599803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcaacb-21bc-4434-b5a8-f07f2c28951a None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:01.600359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcaacb-21bc-4434-b5a8-f07f2c28951a None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:01.600359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcaacb-21bc-4434-b5a8-f07f2c28951a None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:01.601641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 760/1491] 10.222.0.99 () {54 vars in 926 bytes} [Mon Jul 18 14:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:12:01.607170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2e3ea-ddc6-480b-8776-f4edc7c23189 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:01.607620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2e3ea-ddc6-480b-8776-f4edc7c23189 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:01.607724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2e3ea-ddc6-480b-8776-f4edc7c23189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:01.671585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f7c2e3ea-ddc6-480b-8776-f4edc7c23189 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:12:01.672780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f7c2e3ea-ddc6-480b-8776-f4edc7c23189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:12:01.776981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 732/1492] 10.222.0.99 () {58 vars in 1023 bytes} [Mon Jul 18 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:12:01.819429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcaacb-21bc-4434-b5a8-f07f2c28951a None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:12:01.821001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-35dcaacb-21bc-4434-b5a8-f07f2c28951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:12:01.946219 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcaacb-21bc-4434-b5a8-f07f2c28951a None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:12:02.035169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff055ed7-2f57-480b-9dc7-11befb151a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:12:02.035826 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff055ed7-2f57-480b-9dc7-11befb151a0e service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:12:02.036109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff055ed7-2f57-480b-9dc7-11befb151a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:12:02.036395 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff055ed7-2f57-480b-9dc7-11befb151a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:12:02.038205 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ff055ed7-2f57-480b-9dc7-11befb151a0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:12:02.048436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:02.155203 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff055ed7-2f57-480b-9dc7-11befb151a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:12:02.156653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff055ed7-2f57-480b-9dc7-11befb151a0e service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:12:02.181381 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 761/1493] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:12:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:12:11.775113 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=82 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:12.178371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=50 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:36.542661 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475af5f-982f-455b-b89c-f2b8b9af28a5 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:36.543261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475af5f-982f-455b-b89c-f2b8b9af28a5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:36.543261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475af5f-982f-455b-b89c-f2b8b9af28a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:36.623710 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0475af5f-982f-455b-b89c-f2b8b9af28a5 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:13:36.624926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0475af5f-982f-455b-b89c-f2b8b9af28a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:36.724297 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 733/1494] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:13:36.733364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389242b-a108-4138-bfb1-b3a11d3cbf14 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:36.734045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389242b-a108-4138-bfb1-b3a11d3cbf14 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:36.734442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389242b-a108-4138-bfb1-b3a11d3cbf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:36.813990 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-6389242b-a108-4138-bfb1-b3a11d3cbf14 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:13:36.815136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6389242b-a108-4138-bfb1-b3a11d3cbf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:36.922702 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 762/1495] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:13:36.927800 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475af5f-982f-455b-b89c-f2b8b9af28a5 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:36.929026 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0475af5f-982f-455b-b89c-f2b8b9af28a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:36.940695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475af5f-982f-455b-b89c-f2b8b9af28a5 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:37.005657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:37.039893 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a48064-9104-42dc-b7fc-607925b4c515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:37.040554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a48064-9104-42dc-b7fc-607925b4c515 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:37.040838 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a48064-9104-42dc-b7fc-607925b4c515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:37.041112 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a48064-9104-42dc-b7fc-607925b4c515 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:37.041841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a48064-9104-42dc-b7fc-607925b4c515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:13:37.042260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a48064-9104-42dc-b7fc-607925b4c515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:37.043244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: WARNING py.warnings [None req-69a48064-9104-42dc-b7fc-607925b4c515 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:13:37.043244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: warnings.warn(msg) Jul 18 14:13:37.043244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: Jul 18 14:13:37.044133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a48064-9104-42dc-b7fc-607925b4c515 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:37.055558 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 734/1496] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:13:37.063892 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389242b-a108-4138-bfb1-b3a11d3cbf14 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:37.074487 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389242b-a108-4138-bfb1-b3a11d3cbf14 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:37.137442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:37.178904 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af552955-3a35-406d-bdc7-14d184267119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:37.179760 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af552955-3a35-406d-bdc7-14d184267119 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:37.180130 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af552955-3a35-406d-bdc7-14d184267119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:37.180473 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af552955-3a35-406d-bdc7-14d184267119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:37.181536 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af552955-3a35-406d-bdc7-14d184267119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:37.184118 dv-cinder-797608-58-smb devstack@keystone.service[80436]: WARNING py.warnings [None req-af552955-3a35-406d-bdc7-14d184267119 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:13:37.184118 dv-cinder-797608-58-smb devstack@keystone.service[80436]: warnings.warn(msg) Jul 18 14:13:37.184118 dv-cinder-797608-58-smb devstack@keystone.service[80436]: Jul 18 14:13:37.185927 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af552955-3a35-406d-bdc7-14d184267119 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:37.246818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 763/1497] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:13:37 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:13:37.251388 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a48064-9104-42dc-b7fc-607925b4c515 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:37.252915 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-69a48064-9104-42dc-b7fc-607925b4c515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:37.287441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a48064-9104-42dc-b7fc-607925b4c515 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:37.382523 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30061817-b83c-48d9-ac72-6faa7c5859a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:37.383192 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30061817-b83c-48d9-ac72-6faa7c5859a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:37.383472 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30061817-b83c-48d9-ac72-6faa7c5859a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:37.383740 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30061817-b83c-48d9-ac72-6faa7c5859a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:37.384424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30061817-b83c-48d9-ac72-6faa7c5859a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:37.385449 dv-cinder-797608-58-smb devstack@keystone.service[80435]: WARNING py.warnings [None req-30061817-b83c-48d9-ac72-6faa7c5859a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:13:37.385449 dv-cinder-797608-58-smb devstack@keystone.service[80435]: warnings.warn(msg) Jul 18 14:13:37.385449 dv-cinder-797608-58-smb devstack@keystone.service[80435]: Jul 18 14:13:37.386674 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30061817-b83c-48d9-ac72-6faa7c5859a1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:37.436302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 735/1498] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:13:37 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:13:37.440702 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af552955-3a35-406d-bdc7-14d184267119 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:37.442232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-af552955-3a35-406d-bdc7-14d184267119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:37.509086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af552955-3a35-406d-bdc7-14d184267119 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:37.610493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:37.624373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4596ce-4383-43d3-9713-7909a97b769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:37.625059 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4596ce-4383-43d3-9713-7909a97b769d admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:37.625341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4596ce-4383-43d3-9713-7909a97b769d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:37.625616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4596ce-4383-43d3-9713-7909a97b769d admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:37.626359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4596ce-4383-43d3-9713-7909a97b769d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:37.627426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: WARNING py.warnings [None req-ab4596ce-4383-43d3-9713-7909a97b769d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:13:37.627426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: warnings.warn(msg) Jul 18 14:13:37.627426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: Jul 18 14:13:37.628327 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4596ce-4383-43d3-9713-7909a97b769d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:37.641790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 764/1499] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:13:37.646066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30061817-b83c-48d9-ac72-6faa7c5859a1 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:37.647655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-30061817-b83c-48d9-ac72-6faa7c5859a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:37.659287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30061817-b83c-48d9-ac72-6faa7c5859a1 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:37.693773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:37.772207 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa8515-90f9-4789-b6b1-45ea456a5475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:37.772882 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa8515-90f9-4789-b6b1-45ea456a5475 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:37.773320 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa8515-90f9-4789-b6b1-45ea456a5475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:37.773473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa8515-90f9-4789-b6b1-45ea456a5475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:37.774141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa8515-90f9-4789-b6b1-45ea456a5475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:37.775210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: WARNING py.warnings [None req-cfaa8515-90f9-4789-b6b1-45ea456a5475 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:13:37.775210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: warnings.warn(msg) Jul 18 14:13:37.775210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: Jul 18 14:13:37.776096 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa8515-90f9-4789-b6b1-45ea456a5475 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:37.789121 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 736/1500] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:13:37.793725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4596ce-4383-43d3-9713-7909a97b769d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:37.795437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ab4596ce-4383-43d3-9713-7909a97b769d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:37.830492 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4596ce-4383-43d3-9713-7909a97b769d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:37.930077 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1aa2a-8dbc-44c1-b60c-2f5087959e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:37.930972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1aa2a-8dbc-44c1-b60c-2f5087959e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:37.931262 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1aa2a-8dbc-44c1-b60c-2f5087959e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:37.931522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1aa2a-8dbc-44c1-b60c-2f5087959e49 admin admin] PATH_INFO: `/v3/projects/f05efabcb20f44ab84a2339d051424b7/users/142f1ffabebb43248d2e6ca3a5fa762a/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:37.955701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1aa2a-8dbc-44c1-b60c-2f5087959e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05efabcb20f44ab84a2339d051424b7, user_id=142f1ffabebb43248d2e6ca3a5fa762a, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:37.956741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: WARNING py.warnings [None req-59b1aa2a-8dbc-44c1-b60c-2f5087959e49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:13:37.956741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: warnings.warn(msg) Jul 18 14:13:37.956741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: Jul 18 14:13:37.958696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1aa2a-8dbc-44c1-b60c-2f5087959e49 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:37.987712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 765/1501] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:13:37 2022] PUT /identity/v3/projects/f05efabcb20f44ab84a2339d051424b7/users/142f1ffabebb43248d2e6ca3a5fa762a/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:13:38.000792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda659a4-a2b9-4ed4-b9b2-37336244ee53 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:38.001084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda659a4-a2b9-4ed4-b9b2-37336244ee53 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:38.001366 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda659a4-a2b9-4ed4-b9b2-37336244ee53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:38.060342 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-dda659a4-a2b9-4ed4-b9b2-37336244ee53 None None] MFA Rules not processed for user `142f1ffabebb43248d2e6ca3a5fa762a`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:13:38.061556 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dda659a4-a2b9-4ed4-b9b2-37336244ee53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:38.155672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 737/1502] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:13:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:13:38.174505 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88d288-9941-4d92-9754-f5bd2ce7546c None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:38.174765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88d288-9941-4d92-9754-f5bd2ce7546c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:38.175037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88d288-9941-4d92-9754-f5bd2ce7546c None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:38.176445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 766/1503] 10.222.0.99 () {54 vars in 964 bytes} [Mon Jul 18 14:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:13:38.181810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a9b05-295b-4482-9f04-d0bbf993e226 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:38.181984 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a9b05-295b-4482-9f04-d0bbf993e226 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:38.182298 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a9b05-295b-4482-9f04-d0bbf993e226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:38.213961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:38.265191 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-841a9b05-295b-4482-9f04-d0bbf993e226 None None] MFA Rules not processed for user `19eb97598f774389ad927867a7023fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:13:38.266429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-841a9b05-295b-4482-9f04-d0bbf993e226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:38.349867 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 738/1504] 10.222.0.99 () {58 vars in 1061 bytes} [Mon Jul 18 14:13:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:13:38.357955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88d288-9941-4d92-9754-f5bd2ce7546c None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:38.359518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-0d88d288-9941-4d92-9754-f5bd2ce7546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:38.414251 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:38.473106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88d288-9941-4d92-9754-f5bd2ce7546c None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:38.573884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d8d66-684b-4fdd-a584-251001331a30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:38.574578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d8d66-684b-4fdd-a584-251001331a30 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:38.574853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d8d66-684b-4fdd-a584-251001331a30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:38.575127 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d8d66-684b-4fdd-a584-251001331a30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:38.576796 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-142d8d66-684b-4fdd-a584-251001331a30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:38.693040 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d8d66-684b-4fdd-a584-251001331a30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:38.694516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d8d66-684b-4fdd-a584-251001331a30 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:38.698043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:38.714952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 767/1505] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:13:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:13:38.761714 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8ad4-0ce9-4c8b-be2f-99ae3811c7a9 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:38.762159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8ad4-0ce9-4c8b-be2f-99ae3811c7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:38.762267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff8ad4-0ce9-4c8b-be2f-99ae3811c7a9 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:38.763645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 739/1506] 10.222.0.99 () {52 vars in 829 bytes} [Mon Jul 18 14:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:13:38.767613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d8d66-684b-4fdd-a584-251001331a30 service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:38.768847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-142d8d66-684b-4fdd-a584-251001331a30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:38.887294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d8d66-684b-4fdd-a584-251001331a30 service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:38.982529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5887bc4-f682-43e6-914d-a54b313d5729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:38.983337 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5887bc4-f682-43e6-914d-a54b313d5729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:38.983625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5887bc4-f682-43e6-914d-a54b313d5729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:38.983901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5887bc4-f682-43e6-914d-a54b313d5729 admin admin] PATH_INFO: `/v3/users/142f1ffabebb43248d2e6ca3a5fa762a` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:39.001041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5887bc4-f682-43e6-914d-a54b313d5729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=142f1ffabebb43248d2e6ca3a5fa762a)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:39.002849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: WARNING py.warnings [None req-d5887bc4-f682-43e6-914d-a54b313d5729 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:13:39.002849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: warnings.warn(msg) Jul 18 14:13:39.002849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: Jul 18 14:13:39.004802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5887bc4-f682-43e6-914d-a54b313d5729 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:39.020428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:39.087608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-d5887bc4-f682-43e6-914d-a54b313d5729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142f1ffabebb43248d2e6ca3a5fa762a'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:13:39.098489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-d5887bc4-f682-43e6-914d-a54b313d5729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142f1ffabebb43248d2e6ca3a5fa762a'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:13:39.099032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-d5887bc4-f682-43e6-914d-a54b313d5729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142f1ffabebb43248d2e6ca3a5fa762a'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:13:39.117819 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-d5887bc4-f682-43e6-914d-a54b313d5729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142f1ffabebb43248d2e6ca3a5fa762a'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:13:39.131795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-d5887bc4-f682-43e6-914d-a54b313d5729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142f1ffabebb43248d2e6ca3a5fa762a'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:13:39.139264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 768/1507] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:13:38 2022] DELETE /identity/v3/users/142f1ffabebb43248d2e6ca3a5fa762a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:13:39.144702 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b347e76-ad7d-4645-83eb-b303673009da None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:39.144995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b347e76-ad7d-4645-83eb-b303673009da None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:39.145316 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b347e76-ad7d-4645-83eb-b303673009da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:39.202682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5b347e76-ad7d-4645-83eb-b303673009da None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:13:39.203900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5b347e76-ad7d-4645-83eb-b303673009da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:39.294774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:39.309336 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 740/1508] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:13:39.319838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5887bc4-f682-43e6-914d-a54b313d5729 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:39.321084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d5887bc4-f682-43e6-914d-a54b313d5729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:39.427808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5887bc4-f682-43e6-914d-a54b313d5729 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:39.484898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:39.506533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435567b-f431-45c2-9186-6d86a382cd60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:39.507194 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435567b-f431-45c2-9186-6d86a382cd60 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:39.507478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435567b-f431-45c2-9186-6d86a382cd60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:39.507755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435567b-f431-45c2-9186-6d86a382cd60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:39.509423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5435567b-f431-45c2-9186-6d86a382cd60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:39.642855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435567b-f431-45c2-9186-6d86a382cd60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:39.644420 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435567b-f431-45c2-9186-6d86a382cd60 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:39.663595 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 769/1509] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:13:40.048011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b347e76-ad7d-4645-83eb-b303673009da None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:13:40.049261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5b347e76-ad7d-4645-83eb-b303673009da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:13:40.063572 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b347e76-ad7d-4645-83eb-b303673009da None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:13:40.158350 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27beb539-85e9-4196-a0aa-3c68f4ad94e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:13:40.159277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beb539-85e9-4196-a0aa-3c68f4ad94e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:13:40.159556 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beb539-85e9-4196-a0aa-3c68f4ad94e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:13:40.159825 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beb539-85e9-4196-a0aa-3c68f4ad94e4 admin admin] PATH_INFO: `/v3/projects/f05efabcb20f44ab84a2339d051424b7` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:13:40.170204 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27beb539-85e9-4196-a0aa-3c68f4ad94e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f05efabcb20f44ab84a2339d051424b7)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:13:40.171282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: WARNING py.warnings [None req-27beb539-85e9-4196-a0aa-3c68f4ad94e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:13:40.171282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: warnings.warn(msg) Jul 18 14:13:40.171282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: Jul 18 14:13:40.172487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27beb539-85e9-4196-a0aa-3c68f4ad94e4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:13:40.235770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-27beb539-85e9-4196-a0aa-3c68f4ad94e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f05efabcb20f44ab84a2339d051424b7', 'request_id': 'req-27beb539-85e9-4196-a0aa-3c68f4ad94e4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:13:40.242015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-27beb539-85e9-4196-a0aa-3c68f4ad94e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f05efabcb20f44ab84a2339d051424b7', 'request_id': 'req-27beb539-85e9-4196-a0aa-3c68f4ad94e4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:13:40.256842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-27beb539-85e9-4196-a0aa-3c68f4ad94e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f05efabcb20f44ab84a2339d051424b7', 'request_id': 'req-27beb539-85e9-4196-a0aa-3c68f4ad94e4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:13:40.288856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-27beb539-85e9-4196-a0aa-3c68f4ad94e4 admin admin] The token cache is being invalidate because project f05efabcb20f44ab84a2339d051424b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:13:40.289138 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-27beb539-85e9-4196-a0aa-3c68f4ad94e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:13:40.289558 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-27beb539-85e9-4196-a0aa-3c68f4ad94e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:13:40.291070 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 741/1510] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:13:40 2022] DELETE /identity/v3/projects/f05efabcb20f44ab84a2339d051424b7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:13:49.660968 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=62 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:50.287038 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:31.485580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c7b3f-bb7a-4526-a031-3b317313e0de None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:31.486571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c7b3f-bb7a-4526-a031-3b317313e0de None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:31.486571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c7b3f-bb7a-4526-a031-3b317313e0de None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:31.488659 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 770/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:15:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:15:31.494659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efde1ac-d9eb-403a-a0f8-9ac525d84736 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:31.495401 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efde1ac-d9eb-403a-a0f8-9ac525d84736 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:31.495589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efde1ac-d9eb-403a-a0f8-9ac525d84736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:31.593019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9efde1ac-d9eb-403a-a0f8-9ac525d84736 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:15:31.594248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9efde1ac-d9eb-403a-a0f8-9ac525d84736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:31.717519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 742/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:15:31.885168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c7b3f-bb7a-4526-a031-3b317313e0de None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:15:31.888897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-fe4c7b3f-bb7a-4526-a031-3b317313e0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:32.030075 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c7b3f-bb7a-4526-a031-3b317313e0de None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:15:32.036158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1da6b0-5684-428d-a50f-c027fd7a37c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:15:32.036904 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1da6b0-5684-428d-a50f-c027fd7a37c3 service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:32.037276 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1da6b0-5684-428d-a50f-c027fd7a37c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:32.037643 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1da6b0-5684-428d-a50f-c027fd7a37c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:32.046248 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1da6b0-5684-428d-a50f-c027fd7a37c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:15:32.047864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1da6b0-5684-428d-a50f-c027fd7a37c3 service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:15:32.057281 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 771/1513] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:15:32.892216 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfcf8c-a00a-4c1d-8069-8681f8d76078 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:32.893148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfcf8c-a00a-4c1d-8069-8681f8d76078 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:32.893148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfcf8c-a00a-4c1d-8069-8681f8d76078 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:32.895179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 743/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:15:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:15:32.900127 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f2d5-fb73-4f65-a231-27d74189be7e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:32.900567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f2d5-fb73-4f65-a231-27d74189be7e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:32.900674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20f2d5-fb73-4f65-a231-27d74189be7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:32.919119 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-3b20f2d5-fb73-4f65-a231-27d74189be7e None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:15:32.920320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3b20f2d5-fb73-4f65-a231-27d74189be7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:32.928834 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 772/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:15:33.084752 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfcf8c-a00a-4c1d-8069-8681f8d76078 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:15:33.102968 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfcf8c-a00a-4c1d-8069-8681f8d76078 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:15:33.110145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b5ffe-3737-40dc-bec8-beee3cabd9e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:15:33.110809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b5ffe-3737-40dc-bec8-beee3cabd9e5 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:33.111096 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b5ffe-3737-40dc-bec8-beee3cabd9e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:33.111374 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b5ffe-3737-40dc-bec8-beee3cabd9e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:33.120214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b5ffe-3737-40dc-bec8-beee3cabd9e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:15:33.121816 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b5ffe-3737-40dc-bec8-beee3cabd9e5 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:15:33.132129 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 744/1516] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:15:33.362823 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa119754-7dbc-476f-9242-af9d8e07d7b7 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:33.363115 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa119754-7dbc-476f-9242-af9d8e07d7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:33.363432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa119754-7dbc-476f-9242-af9d8e07d7b7 None None] PATH_INFO: `/v3` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:33.364816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 773/1517] 10.222.0.102 () {54 vars in 926 bytes} [Mon Jul 18 14:15:33 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:15:33.371766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781d85e-80fd-4fec-99c3-4fcca6b4c89d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:33.372059 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781d85e-80fd-4fec-99c3-4fcca6b4c89d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:33.372334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781d85e-80fd-4fec-99c3-4fcca6b4c89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:33.434625 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3781d85e-80fd-4fec-99c3-4fcca6b4c89d None None] MFA Rules not processed for user `92b73e1a514148b19bb6a1d2a39e32cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:15:33.435764 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3781d85e-80fd-4fec-99c3-4fcca6b4c89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:33.453115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:33.531079 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 745/1518] 10.222.0.102 () {58 vars in 1016 bytes} [Mon Jul 18 14:15:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:15:42.914406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=56 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:42.940670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d59ed7-0171-4e3e-baa3-2f3ff2bb5fc0 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:42.940921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d59ed7-0171-4e3e-baa3-2f3ff2bb5fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:42.941211 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d59ed7-0171-4e3e-baa3-2f3ff2bb5fc0 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:42.942606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 774/1519] 10.222.0.99 () {54 vars in 961 bytes} [Mon Jul 18 14:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:15:42.948850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496fc16-9304-4374-b3ed-64d3fa5757d5 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:42.949336 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496fc16-9304-4374-b3ed-64d3fa5757d5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:42.949444 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496fc16-9304-4374-b3ed-64d3fa5757d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:42.971187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3496fc16-9304-4374-b3ed-64d3fa5757d5 None None] MFA Rules not processed for user `92b73e1a514148b19bb6a1d2a39e32cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:15:42.972466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3496fc16-9304-4374-b3ed-64d3fa5757d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:42.982452 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 746/1520] 10.222.0.99 () {58 vars in 1058 bytes} [Mon Jul 18 14:15:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:15:42.990336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d59ed7-0171-4e3e-baa3-2f3ff2bb5fc0 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:15:43.006326 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d59ed7-0171-4e3e-baa3-2f3ff2bb5fc0 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:15:43.012759 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829679b2-a6ea-49a8-a480-01de54381baf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92b73e1a514148b19bb6a1d2a39e32cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:15:43.013375 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829679b2-a6ea-49a8-a480-01de54381baf service placement] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:43.013659 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829679b2-a6ea-49a8-a480-01de54381baf service placement] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:43.013931 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829679b2-a6ea-49a8-a480-01de54381baf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:43.022970 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829679b2-a6ea-49a8-a480-01de54381baf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:15:43.024560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829679b2-a6ea-49a8-a480-01de54381baf service placement] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:15:43.034335 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 775/1521] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:15:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:15:44.335731 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb8f92-79f9-4bd6-abac-5e925b1f1c5c None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:44.336630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb8f92-79f9-4bd6-abac-5e925b1f1c5c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:44.336630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb8f92-79f9-4bd6-abac-5e925b1f1c5c None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:44.338907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 747/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:15:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:15:44.344832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43b1df-cb7b-4b86-a596-b7515517c34d None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:44.345575 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43b1df-cb7b-4b86-a596-b7515517c34d None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:44.345708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43b1df-cb7b-4b86-a596-b7515517c34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:44.372120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-4d43b1df-cb7b-4b86-a596-b7515517c34d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:15:44.373626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-4d43b1df-cb7b-4b86-a596-b7515517c34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:44.382099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 776/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:15:44.537803 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb8f92-79f9-4bd6-abac-5e925b1f1c5c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:15:44.555618 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb8f92-79f9-4bd6-abac-5e925b1f1c5c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:15:44.561727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62865419-4102-4ca3-ace4-49b714ab2ba7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:15:44.562381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865419-4102-4ca3-ace4-49b714ab2ba7 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:44.562696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865419-4102-4ca3-ace4-49b714ab2ba7 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:44.562939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865419-4102-4ca3-ace4-49b714ab2ba7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:44.572041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62865419-4102-4ca3-ace4-49b714ab2ba7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:15:44.573691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62865419-4102-4ca3-ace4-49b714ab2ba7 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:15:44.583539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 748/1524] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:15:45.406418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519118bb-3ba8-43b5-987f-d966d4a36ab2 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:45.407023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519118bb-3ba8-43b5-987f-d966d4a36ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:45.407023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519118bb-3ba8-43b5-987f-d966d4a36ab2 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:45.408286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 777/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 14:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:15:45.414281 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199585e2-fa8e-4bb2-8d4a-4a6e340e4657 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:45.415056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199585e2-fa8e-4bb2-8d4a-4a6e340e4657 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:45.415176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199585e2-fa8e-4bb2-8d4a-4a6e340e4657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:45.441623 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-199585e2-fa8e-4bb2-8d4a-4a6e340e4657 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:15:45.442892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-199585e2-fa8e-4bb2-8d4a-4a6e340e4657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:45.451809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 749/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 14:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:15:45.609590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519118bb-3ba8-43b5-987f-d966d4a36ab2 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:15:45.626915 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519118bb-3ba8-43b5-987f-d966d4a36ab2 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:15:45.634767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef729a-dbdb-4263-b123-3c8be252319e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:15:45.635408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef729a-dbdb-4263-b123-3c8be252319e service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:45.635691 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef729a-dbdb-4263-b123-3c8be252319e service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:45.635959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef729a-dbdb-4263-b123-3c8be252319e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:45.645879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef729a-dbdb-4263-b123-3c8be252319e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:15:45.647503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef729a-dbdb-4263-b123-3c8be252319e service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:15:45.657418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 778/1527] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:15:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:15:49.944823 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd530782-032c-49f5-b122-0053c04ebb11 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:49.945488 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd530782-032c-49f5-b122-0053c04ebb11 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:49.945488 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd530782-032c-49f5-b122-0053c04ebb11 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:49.947250 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 750/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:15:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:15:49.955840 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942b2ab-ef2a-49e0-954e-968f6b068166 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:49.956423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942b2ab-ef2a-49e0-954e-968f6b068166 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:49.956527 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942b2ab-ef2a-49e0-954e-968f6b068166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:49.981163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-1942b2ab-ef2a-49e0-954e-968f6b068166 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:15:49.982372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1942b2ab-ef2a-49e0-954e-968f6b068166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:49.991806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 779/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:15:50.034044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd530782-032c-49f5-b122-0053c04ebb11 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:15:50.037213 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bd530782-032c-49f5-b122-0053c04ebb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:50.138982 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd530782-032c-49f5-b122-0053c04ebb11 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:15:50.143632 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66254e10-7c4b-49fe-92f6-4b10c3600f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:15:50.144311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66254e10-7c4b-49fe-92f6-4b10c3600f28 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:50.144683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66254e10-7c4b-49fe-92f6-4b10c3600f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:50.144922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66254e10-7c4b-49fe-92f6-4b10c3600f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:50.155384 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66254e10-7c4b-49fe-92f6-4b10c3600f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:15:50.156883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66254e10-7c4b-49fe-92f6-4b10c3600f28 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:15:50.166900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 751/1530] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:15:52.166040 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c468dc7-eb77-4e2e-861e-99ec1afd7736 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:52.166632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c468dc7-eb77-4e2e-861e-99ec1afd7736 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:52.166632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c468dc7-eb77-4e2e-861e-99ec1afd7736 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:52.168098 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 780/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:15:52.174640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e28065-c4b2-4f30-97d2-dde3bb5794b6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:52.175402 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e28065-c4b2-4f30-97d2-dde3bb5794b6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:52.175582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e28065-c4b2-4f30-97d2-dde3bb5794b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:52.323035 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c7e28065-c4b2-4f30-97d2-dde3bb5794b6 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:15:52.324275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c7e28065-c4b2-4f30-97d2-dde3bb5794b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:52.333818 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 752/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:15:52.373748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c468dc7-eb77-4e2e-861e-99ec1afd7736 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:15:52.392709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c468dc7-eb77-4e2e-861e-99ec1afd7736 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:15:52.397641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed02851-0562-4525-b461-2aaa4d042f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:15:52.398452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed02851-0562-4525-b461-2aaa4d042f65 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:52.398707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed02851-0562-4525-b461-2aaa4d042f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:52.399012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed02851-0562-4525-b461-2aaa4d042f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:52.408898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed02851-0562-4525-b461-2aaa4d042f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:15:52.410341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed02851-0562-4525-b461-2aaa4d042f65 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:15:52.420443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 781/1533] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:15:55.884703 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d8ee7-bff8-450c-ac60-39d2b142e942 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:55.885288 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d8ee7-bff8-450c-ac60-39d2b142e942 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:55.885288 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d8ee7-bff8-450c-ac60-39d2b142e942 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:55.887500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 753/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:15:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:15:55.895895 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3d8e5-5a02-451e-bcdd-42841059c8d6 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:55.896888 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3d8e5-5a02-451e-bcdd-42841059c8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:55.897234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3d8e5-5a02-451e-bcdd-42841059c8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:55.920271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-75c3d8e5-5a02-451e-bcdd-42841059c8d6 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:15:55.921480 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-75c3d8e5-5a02-451e-bcdd-42841059c8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:55.929931 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 782/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:15:56.238628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d8ee7-bff8-450c-ac60-39d2b142e942 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:15:56.240441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3a5d8ee7-bff8-450c-ac60-39d2b142e942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:56.307680 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:15:56.326900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d8ee7-bff8-450c-ac60-39d2b142e942 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:15:56.332569 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e931c23-54f9-4d8a-808e-e603b990dba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:15:56.333232 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e931c23-54f9-4d8a-808e-e603b990dba5 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:56.333517 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e931c23-54f9-4d8a-808e-e603b990dba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:56.333795 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e931c23-54f9-4d8a-808e-e603b990dba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:56.344148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e931c23-54f9-4d8a-808e-e603b990dba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:15:56.345630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e931c23-54f9-4d8a-808e-e603b990dba5 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:15:56.355497 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 754/1536] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:15:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:15:58.381028 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65fffe-d445-4d71-bb25-669804adf8b1 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:58.381619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65fffe-d445-4d71-bb25-669804adf8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:58.381619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65fffe-d445-4d71-bb25-669804adf8b1 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:58.383014 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 783/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 14:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:15:58.388279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25858b18-e138-4379-81ad-54ba22f304ae None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:58.388732 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25858b18-e138-4379-81ad-54ba22f304ae None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:58.388836 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25858b18-e138-4379-81ad-54ba22f304ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:58.408641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-25858b18-e138-4379-81ad-54ba22f304ae None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:15:58.409597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-25858b18-e138-4379-81ad-54ba22f304ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:58.418902 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 755/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 14:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:15:58.727631 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65fffe-d445-4d71-bb25-669804adf8b1 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:15:58.729644 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ce65fffe-d445-4d71-bb25-669804adf8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:15:58.744210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65fffe-d445-4d71-bb25-669804adf8b1 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:15:58.748648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39cdf4-e85e-4cbf-af00-a7ccc484e85e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:15:58.749297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39cdf4-e85e-4cbf-af00-a7ccc484e85e service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:15:58.749575 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39cdf4-e85e-4cbf-af00-a7ccc484e85e service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:15:58.749866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39cdf4-e85e-4cbf-af00-a7ccc484e85e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:15:58.760788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39cdf4-e85e-4cbf-af00-a7ccc484e85e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:15:58.762213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39cdf4-e85e-4cbf-af00-a7ccc484e85e service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:15:58.772155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 784/1539] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:16:08.403211 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=11 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:16:08.768016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=33 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:39.333784 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c8221-a147-437e-b660-d0dc92d3c129 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.334983 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c8221-a147-437e-b660-d0dc92d3c129 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.335515 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c8221-a147-437e-b660-d0dc92d3c129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.363689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-562c8221-a147-437e-b660-d0dc92d3c129 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:39.366210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-562c8221-a147-437e-b660-d0dc92d3c129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:39.388031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 756/1540] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:39.398603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a23f36-fd65-470b-978b-f164c048cd11 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.399214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a23f36-fd65-470b-978b-f164c048cd11 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.399214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a23f36-fd65-470b-978b-f164c048cd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.430712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-14a23f36-fd65-470b-978b-f164c048cd11 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:39.432151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-14a23f36-fd65-470b-978b-f164c048cd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:39.447223 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 785/1541] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:39.452856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c8221-a147-437e-b660-d0dc92d3c129 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:39.468117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c8221-a147-437e-b660-d0dc92d3c129 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:39.476068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205aa81-6a0d-4dc1-856a-0fdc7f00c6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:39.477173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205aa81-6a0d-4dc1-856a-0fdc7f00c6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.477683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205aa81-6a0d-4dc1-856a-0fdc7f00c6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.478339 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205aa81-6a0d-4dc1-856a-0fdc7f00c6a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.479386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205aa81-6a0d-4dc1-856a-0fdc7f00c6a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:17:39.479978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205aa81-6a0d-4dc1-856a-0fdc7f00c6a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:39.483500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205aa81-6a0d-4dc1-856a-0fdc7f00c6a9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:39.503956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 757/1542] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:17:39.513409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a23f36-fd65-470b-978b-f164c048cd11 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:39.528722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a23f36-fd65-470b-978b-f164c048cd11 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:39.536738 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366e03a-c298-4e7f-ab4a-fede29e0f1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:39.537466 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366e03a-c298-4e7f-ab4a-fede29e0f1ad admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.537746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366e03a-c298-4e7f-ab4a-fede29e0f1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.538030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366e03a-c298-4e7f-ab4a-fede29e0f1ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.538808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366e03a-c298-4e7f-ab4a-fede29e0f1ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:39.540824 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366e03a-c298-4e7f-ab4a-fede29e0f1ad admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:39.600141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 786/1543] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:17:39 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:39.605333 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205aa81-6a0d-4dc1-856a-0fdc7f00c6a9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:39.620432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205aa81-6a0d-4dc1-856a-0fdc7f00c6a9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:39.682957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cf66e-4e7d-494a-a1ae-714195fbcc79 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.683171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cf66e-4e7d-494a-a1ae-714195fbcc79 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.683425 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cf66e-4e7d-494a-a1ae-714195fbcc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.708006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04113e4e-24a9-41fb-8cca-c0cd56feadf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:39.709152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04113e4e-24a9-41fb-8cca-c0cd56feadf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.709679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04113e4e-24a9-41fb-8cca-c0cd56feadf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.710185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04113e4e-24a9-41fb-8cca-c0cd56feadf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.711168 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04113e4e-24a9-41fb-8cca-c0cd56feadf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:39.713404 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04113e4e-24a9-41fb-8cca-c0cd56feadf0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:39.714543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-f79cf66e-4e7d-494a-a1ae-714195fbcc79 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:39.718414 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f79cf66e-4e7d-494a-a1ae-714195fbcc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:39.729286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 787/1544] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:17:39.730688 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4000994-7b1b-40f9-9ce3-48fc41a8a148 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.730985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4000994-7b1b-40f9-9ce3-48fc41a8a148 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.731272 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4000994-7b1b-40f9-9ce3-48fc41a8a148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.749902 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 758/1545] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:17:39 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:17:39.751566 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60320f34-6efe-4bcf-b7ed-fe26c749093b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.751882 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60320f34-6efe-4bcf-b7ed-fe26c749093b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.752164 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60320f34-6efe-4bcf-b7ed-fe26c749093b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.765741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-d4000994-7b1b-40f9-9ce3-48fc41a8a148 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:39.771832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d4000994-7b1b-40f9-9ce3-48fc41a8a148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:39.789140 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-60320f34-6efe-4bcf-b7ed-fe26c749093b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:39.793091 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-60320f34-6efe-4bcf-b7ed-fe26c749093b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:39.797101 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 788/1546] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:39.804058 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b14d1-0e68-493f-93ea-84c77b55deba None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.804549 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b14d1-0e68-493f-93ea-84c77b55deba None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.804923 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b14d1-0e68-493f-93ea-84c77b55deba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.823966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 759/1547] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:39.825888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0f6a9-ff4b-4e94-8422-90adf3dd2604 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.826313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0f6a9-ff4b-4e94-8422-90adf3dd2604 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.826750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0f6a9-ff4b-4e94-8422-90adf3dd2604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.851088 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-160b14d1-0e68-493f-93ea-84c77b55deba None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:39.852894 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-160b14d1-0e68-493f-93ea-84c77b55deba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:39.858503 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-60f0f6a9-ff4b-4e94-8422-90adf3dd2604 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:39.859859 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-60f0f6a9-ff4b-4e94-8422-90adf3dd2604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:39.864486 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 789/1548] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:39.865515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b14d1-0e68-493f-93ea-84c77b55deba None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:39.869713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 760/1549] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:39.871784 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fa329-83c4-420b-b982-c6ade0d7f843 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.872077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fa329-83c4-420b-b982-c6ade0d7f843 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.872359 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fa329-83c4-420b-b982-c6ade0d7f843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.881344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b14d1-0e68-493f-93ea-84c77b55deba None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:39.887436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af401986-a9c3-4c24-8834-58aa4d818214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:39.888703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af401986-a9c3-4c24-8834-58aa4d818214 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.890002 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af401986-a9c3-4c24-8834-58aa4d818214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.890310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af401986-a9c3-4c24-8834-58aa4d818214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.891135 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af401986-a9c3-4c24-8834-58aa4d818214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:39.892725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af401986-a9c3-4c24-8834-58aa4d818214 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:39.902748 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8c0fa329-83c4-420b-b982-c6ade0d7f843 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:39.906665 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 790/1550] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:39.906810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8c0fa329-83c4-420b-b982-c6ade0d7f843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:39.906933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525c81a-1e9e-4f64-a0cc-7c5dc702acec None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.906933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525c81a-1e9e-4f64-a0cc-7c5dc702acec None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.906933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525c81a-1e9e-4f64-a0cc-7c5dc702acec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.914711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 761/1551] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:39.916142 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e779c-7336-450f-8f8e-1ba2f096d43c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.916448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e779c-7336-450f-8f8e-1ba2f096d43c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.916730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e779c-7336-450f-8f8e-1ba2f096d43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.925442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-1525c81a-1e9e-4f64-a0cc-7c5dc702acec None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:39.930489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1525c81a-1e9e-4f64-a0cc-7c5dc702acec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:39.936017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-be8e779c-7336-450f-8f8e-1ba2f096d43c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:39.937185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-be8e779c-7336-450f-8f8e-1ba2f096d43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:39.939621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 791/1552] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:39.941202 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525c81a-1e9e-4f64-a0cc-7c5dc702acec None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:39.947634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 762/1553] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:39.948933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93845f8f-2e86-4c6f-aa1f-d652801988cd None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.949216 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93845f8f-2e86-4c6f-aa1f-d652801988cd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.949487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93845f8f-2e86-4c6f-aa1f-d652801988cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.950983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525c81a-1e9e-4f64-a0cc-7c5dc702acec None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:39.955968 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75123e69-230f-4614-88bc-80e76c9544a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:39.956656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75123e69-230f-4614-88bc-80e76c9544a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.956939 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75123e69-230f-4614-88bc-80e76c9544a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.957220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75123e69-230f-4614-88bc-80e76c9544a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.958000 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75123e69-230f-4614-88bc-80e76c9544a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:17:39.958293 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75123e69-230f-4614-88bc-80e76c9544a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:39.959379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: WARNING py.warnings [None req-75123e69-230f-4614-88bc-80e76c9544a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:17:39.959379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: warnings.warn(msg) Jul 18 14:17:39.959379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: Jul 18 14:17:39.960265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75123e69-230f-4614-88bc-80e76c9544a7 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:39.968565 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-93845f8f-2e86-4c6f-aa1f-d652801988cd None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:39.969767 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-93845f8f-2e86-4c6f-aa1f-d652801988cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:39.980013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 792/1554] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:17:39.980013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be79e0-b8a8-4503-977e-aabac4e32e71 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.980013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be79e0-b8a8-4503-977e-aabac4e32e71 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.980013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be79e0-b8a8-4503-977e-aabac4e32e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.980492 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 763/1555] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:39.980492 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93845f8f-2e86-4c6f-aa1f-d652801988cd None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:39.988155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93845f8f-2e86-4c6f-aa1f-d652801988cd None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:39.993574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a2a01-152c-47a4-8375-b4f6b1e57600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:39.994252 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a2a01-152c-47a4-8375-b4f6b1e57600 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:39.994564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a2a01-152c-47a4-8375-b4f6b1e57600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:39.994843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a2a01-152c-47a4-8375-b4f6b1e57600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:39.995471 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-a0be79e0-b8a8-4503-977e-aabac4e32e71 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:39.995607 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a2a01-152c-47a4-8375-b4f6b1e57600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:39.996698 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a0be79e0-b8a8-4503-977e-aabac4e32e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:39.997211 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a2a01-152c-47a4-8375-b4f6b1e57600 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.005437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 793/1556] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:40.006237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be79e0-b8a8-4503-977e-aabac4e32e71 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.008857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 764/1557] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:40.010434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea2457-d625-49b6-9fc1-f3f687f1163c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.010887 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea2457-d625-49b6-9fc1-f3f687f1163c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.011361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea2457-d625-49b6-9fc1-f3f687f1163c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.019966 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be79e0-b8a8-4503-977e-aabac4e32e71 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.024929 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca047b-4d0d-4c36-b60b-43fed0d49c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.025614 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca047b-4d0d-4c36-b60b-43fed0d49c71 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.025898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca047b-4d0d-4c36-b60b-43fed0d49c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.026175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca047b-4d0d-4c36-b60b-43fed0d49c71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.026969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca047b-4d0d-4c36-b60b-43fed0d49c71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:17:40.027277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca047b-4d0d-4c36-b60b-43fed0d49c71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.028973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca047b-4d0d-4c36-b60b-43fed0d49c71 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.030201 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a9ea2457-d625-49b6-9fc1-f3f687f1163c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:40.031436 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a9ea2457-d625-49b6-9fc1-f3f687f1163c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:40.039247 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 765/1558] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:40.040050 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea2457-d625-49b6-9fc1-f3f687f1163c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.048861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 794/1559] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:17:40.048861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85702b4-74c6-4d18-bc56-a0bcfd60e7a6 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.048861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85702b4-74c6-4d18-bc56-a0bcfd60e7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.048861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85702b4-74c6-4d18-bc56-a0bcfd60e7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.054772 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea2457-d625-49b6-9fc1-f3f687f1163c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.060239 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab177397-6f03-4b9f-814e-03635e5946c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.060950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab177397-6f03-4b9f-814e-03635e5946c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.061235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab177397-6f03-4b9f-814e-03635e5946c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.061509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab177397-6f03-4b9f-814e-03635e5946c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.062261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab177397-6f03-4b9f-814e-03635e5946c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:17:40.062599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab177397-6f03-4b9f-814e-03635e5946c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.063133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-d85702b4-74c6-4d18-bc56-a0bcfd60e7a6 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:40.064249 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab177397-6f03-4b9f-814e-03635e5946c0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.064368 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d85702b4-74c6-4d18-bc56-a0bcfd60e7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:40.072472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 795/1560] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:40.073295 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85702b4-74c6-4d18-bc56-a0bcfd60e7a6 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.080188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 766/1561] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:17:40.081237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab177397-6f03-4b9f-814e-03635e5946c0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.085078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85702b4-74c6-4d18-bc56-a0bcfd60e7a6 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.090642 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9fc1a-3ccb-4dd8-8689-09c51af7aa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.090789 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab177397-6f03-4b9f-814e-03635e5946c0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.091360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9fc1a-3ccb-4dd8-8689-09c51af7aa65 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.091584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9fc1a-3ccb-4dd8-8689-09c51af7aa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.091867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9fc1a-3ccb-4dd8-8689-09c51af7aa65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.092606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9fc1a-3ccb-4dd8-8689-09c51af7aa65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.094580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9fc1a-3ccb-4dd8-8689-09c51af7aa65 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.096342 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776d401-b59a-414f-a074-4f6eda398d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.097026 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776d401-b59a-414f-a074-4f6eda398d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.097311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776d401-b59a-414f-a074-4f6eda398d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.097590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776d401-b59a-414f-a074-4f6eda398d0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.098403 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776d401-b59a-414f-a074-4f6eda398d0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:17:40.098718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776d401-b59a-414f-a074-4f6eda398d0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.100365 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776d401-b59a-414f-a074-4f6eda398d0d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.114030 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 767/1562] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:17:40.115179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776d401-b59a-414f-a074-4f6eda398d0d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.122268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 796/1563] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:40.123976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95206c-8b14-4b7f-ad23-b363c013fcfc None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.124256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95206c-8b14-4b7f-ad23-b363c013fcfc None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.124526 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95206c-8b14-4b7f-ad23-b363c013fcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.131401 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776d401-b59a-414f-a074-4f6eda398d0d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.142589 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-7a95206c-8b14-4b7f-ad23-b363c013fcfc None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:40.143783 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-7a95206c-8b14-4b7f-ad23-b363c013fcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:40.185378 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:40.195363 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46512349-b44a-4c6a-8a21-2a821d12d713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.196197 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46512349-b44a-4c6a-8a21-2a821d12d713 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.196488 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46512349-b44a-4c6a-8a21-2a821d12d713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.196771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46512349-b44a-4c6a-8a21-2a821d12d713 admin admin] PATH_INFO: `/v3/projects/1ea5fdc68dcb47d8853e08663614946a/users/c24af3f2cbf247f79bfe03523582bce4/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.211489 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46512349-b44a-4c6a-8a21-2a821d12d713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea5fdc68dcb47d8853e08663614946a, user_id=c24af3f2cbf247f79bfe03523582bce4, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.212358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 797/1564] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:40.212582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: WARNING py.warnings [None req-46512349-b44a-4c6a-8a21-2a821d12d713 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:17:40.212582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: warnings.warn(msg) Jul 18 14:17:40.212582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: Jul 18 14:17:40.212951 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95206c-8b14-4b7f-ad23-b363c013fcfc None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.214926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46512349-b44a-4c6a-8a21-2a821d12d713 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.223412 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95206c-8b14-4b7f-ad23-b363c013fcfc None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.229836 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 768/1565] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:40 2022] PUT /identity/v3/projects/1ea5fdc68dcb47d8853e08663614946a/users/c24af3f2cbf247f79bfe03523582bce4/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:40.231160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971de0b8-6d94-475b-823e-57200b6d715a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.231446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971de0b8-6d94-475b-823e-57200b6d715a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.231721 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971de0b8-6d94-475b-823e-57200b6d715a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.250784 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:40.251055 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-971de0b8-6d94-475b-823e-57200b6d715a None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:40.252019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-971de0b8-6d94-475b-823e-57200b6d715a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:40.291556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7767dde-6f52-4e69-b6b5-1d9b38dfe2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.292244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7767dde-6f52-4e69-b6b5-1d9b38dfe2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.292522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7767dde-6f52-4e69-b6b5-1d9b38dfe2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.292793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7767dde-6f52-4e69-b6b5-1d9b38dfe2f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.293557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7767dde-6f52-4e69-b6b5-1d9b38dfe2f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.295565 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7767dde-6f52-4e69-b6b5-1d9b38dfe2f6 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.314169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 769/1566] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:40.315332 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971de0b8-6d94-475b-823e-57200b6d715a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.325129 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971de0b8-6d94-475b-823e-57200b6d715a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.328127 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 798/1567] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:40.329009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7767dde-6f52-4e69-b6b5-1d9b38dfe2f6 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.333664 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8111d-ba2f-442a-998d-3383fba032ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.334509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8111d-ba2f-442a-998d-3383fba032ed admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.335261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8111d-ba2f-442a-998d-3383fba032ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.335261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8111d-ba2f-442a-998d-3383fba032ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.335942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8111d-ba2f-442a-998d-3383fba032ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:17:40.336248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8111d-ba2f-442a-998d-3383fba032ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.337909 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8111d-ba2f-442a-998d-3383fba032ed admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.357775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 770/1568] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:17:40.357775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8111d-ba2f-442a-998d-3383fba032ed admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.363759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8111d-ba2f-442a-998d-3383fba032ed admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.398298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7767dde-6f52-4e69-b6b5-1d9b38dfe2f6 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.403055 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b57c9-a918-4ebd-8cb3-e63d1b1e5e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.403712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b57c9-a918-4ebd-8cb3-e63d1b1e5e36 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.403993 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b57c9-a918-4ebd-8cb3-e63d1b1e5e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.404252 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b57c9-a918-4ebd-8cb3-e63d1b1e5e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.405003 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b57c9-a918-4ebd-8cb3-e63d1b1e5e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.406996 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b57c9-a918-4ebd-8cb3-e63d1b1e5e36 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.422182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83812041-62dc-4d16-a6c5-5b9670458153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.423060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83812041-62dc-4d16-a6c5-5b9670458153 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.423427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83812041-62dc-4d16-a6c5-5b9670458153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.423749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83812041-62dc-4d16-a6c5-5b9670458153 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.425162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83812041-62dc-4d16-a6c5-5b9670458153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.427165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: WARNING py.warnings [None req-83812041-62dc-4d16-a6c5-5b9670458153 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:17:40.427165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: warnings.warn(msg) Jul 18 14:17:40.427165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: Jul 18 14:17:40.429137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83812041-62dc-4d16-a6c5-5b9670458153 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.436580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 799/1569] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:40.437492 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b57c9-a918-4ebd-8cb3-e63d1b1e5e36 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.458659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 771/1570] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:40.459507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83812041-62dc-4d16-a6c5-5b9670458153 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.511337 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:40.512131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b57c9-a918-4ebd-8cb3-e63d1b1e5e36 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.525961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83812041-62dc-4d16-a6c5-5b9670458153 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.531846 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a7a8e-5dbf-46ba-a672-ee08eb846532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.532590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a7a8e-5dbf-46ba-a672-ee08eb846532 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.533180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a7a8e-5dbf-46ba-a672-ee08eb846532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.533460 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a7a8e-5dbf-46ba-a672-ee08eb846532 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.534254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a7a8e-5dbf-46ba-a672-ee08eb846532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:17:40.534609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a7a8e-5dbf-46ba-a672-ee08eb846532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.536278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a7a8e-5dbf-46ba-a672-ee08eb846532 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.549969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 772/1571] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:17:40.551270 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe799fc-fe98-453e-b4c3-955864824a5b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.551560 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe799fc-fe98-453e-b4c3-955864824a5b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.551841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe799fc-fe98-453e-b4c3-955864824a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.555023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:40.572648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4445f-5de9-4fb5-84d6-97263b9b522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.573325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4445f-5de9-4fb5-84d6-97263b9b522a admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.573763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4445f-5de9-4fb5-84d6-97263b9b522a admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.574042 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4445f-5de9-4fb5-84d6-97263b9b522a admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.574780 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4445f-5de9-4fb5-84d6-97263b9b522a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.575943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: WARNING py.warnings [None req-02c4445f-5de9-4fb5-84d6-97263b9b522a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:17:40.575943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: warnings.warn(msg) Jul 18 14:17:40.575943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: Jul 18 14:17:40.577213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4445f-5de9-4fb5-84d6-97263b9b522a admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.578542 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9fe799fc-fe98-453e-b4c3-955864824a5b None None] MFA Rules not processed for user `c24af3f2cbf247f79bfe03523582bce4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:40.579770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9fe799fc-fe98-453e-b4c3-955864824a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:40.598496 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 800/1572] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:40.599437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4445f-5de9-4fb5-84d6-97263b9b522a admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.609760 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4445f-5de9-4fb5-84d6-97263b9b522a admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.614432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd239abb-6ef4-436a-9eae-ff110d75d349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.615095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd239abb-6ef4-436a-9eae-ff110d75d349 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.615383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd239abb-6ef4-436a-9eae-ff110d75d349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.615663 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd239abb-6ef4-436a-9eae-ff110d75d349 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.616406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd239abb-6ef4-436a-9eae-ff110d75d349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:17:40.616722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd239abb-6ef4-436a-9eae-ff110d75d349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.618361 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd239abb-6ef4-436a-9eae-ff110d75d349 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.631126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 801/1573] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:17:40.631912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd239abb-6ef4-436a-9eae-ff110d75d349 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.644018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd239abb-6ef4-436a-9eae-ff110d75d349 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.648661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f2e2c-c633-43a7-8274-f06c18f11156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.649288 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 773/1574] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:40.649416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2e2c-c633-43a7-8274-f06c18f11156 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.650134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe799fc-fe98-453e-b4c3-955864824a5b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.653274 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2e2c-c633-43a7-8274-f06c18f11156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.653573 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2e2c-c633-43a7-8274-f06c18f11156 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.654310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f2e2c-c633-43a7-8274-f06c18f11156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.656321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f2e2c-c633-43a7-8274-f06c18f11156 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.660728 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe799fc-fe98-453e-b4c3-955864824a5b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.665306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14c66c-940d-475a-8a73-368e52667b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.665952 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14c66c-940d-475a-8a73-368e52667b62 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.666254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14c66c-940d-475a-8a73-368e52667b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.666731 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14c66c-940d-475a-8a73-368e52667b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.667374 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14c66c-940d-475a-8a73-368e52667b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.669583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14c66c-940d-475a-8a73-368e52667b62 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.681279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 802/1575] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/users => generated 285 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:40.681279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f2e2c-c633-43a7-8274-f06c18f11156 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.689193 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f2e2c-c633-43a7-8274-f06c18f11156 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.693788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e2f4b-7cfe-41a8-b375-f326d545c4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.694509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e2f4b-7cfe-41a8-b375-f326d545c4fa admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.694795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e2f4b-7cfe-41a8-b375-f326d545c4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.695148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e2f4b-7cfe-41a8-b375-f326d545c4fa admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.695863 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e2f4b-7cfe-41a8-b375-f326d545c4fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.699989 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 774/1576] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:40.699989 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14c66c-940d-475a-8a73-368e52667b62 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.700215 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e2f4b-7cfe-41a8-b375-f326d545c4fa admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.725004 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 803/1577] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:40.725004 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e2f4b-7cfe-41a8-b375-f326d545c4fa admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.734013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e2f4b-7cfe-41a8-b375-f326d545c4fa admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.768318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14c66c-940d-475a-8a73-368e52667b62 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.772941 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ce696-6679-4d27-bf3c-a28ffd9c9aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.773625 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ce696-6679-4d27-bf3c-a28ffd9c9aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.773909 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ce696-6679-4d27-bf3c-a28ffd9c9aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.774186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ce696-6679-4d27-bf3c-a28ffd9c9aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.774970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ce696-6679-4d27-bf3c-a28ffd9c9aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.776917 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ce696-6679-4d27-bf3c-a28ffd9c9aa6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.794506 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b719ed4-e8a2-4efd-8f34-34f47bfe20fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.795194 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719ed4-e8a2-4efd-8f34-34f47bfe20fb admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.795503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719ed4-e8a2-4efd-8f34-34f47bfe20fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.795802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719ed4-e8a2-4efd-8f34-34f47bfe20fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.796498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b719ed4-e8a2-4efd-8f34-34f47bfe20fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.798500 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b719ed4-e8a2-4efd-8f34-34f47bfe20fb admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.799228 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 775/1578] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:40.800078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ce696-6679-4d27-bf3c-a28ffd9c9aa6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.809682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ce696-6679-4d27-bf3c-a28ffd9c9aa6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.814650 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e23fac-a1dc-4ed6-a84b-f0fc828dfdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.815321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e23fac-a1dc-4ed6-a84b-f0fc828dfdfb admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.815603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e23fac-a1dc-4ed6-a84b-f0fc828dfdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.815884 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e23fac-a1dc-4ed6-a84b-f0fc828dfdfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.816641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e23fac-a1dc-4ed6-a84b-f0fc828dfdfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.818354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e23fac-a1dc-4ed6-a84b-f0fc828dfdfb admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.832435 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 776/1579] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:40.832435 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e23fac-a1dc-4ed6-a84b-f0fc828dfdfb admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.832714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 804/1580] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:40.832714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b719ed4-e8a2-4efd-8f34-34f47bfe20fb admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.840569 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e23fac-a1dc-4ed6-a84b-f0fc828dfdfb admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.867218 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:40.897396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b719ed4-e8a2-4efd-8f34-34f47bfe20fb admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.897660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88045956-705e-4984-b62d-c07d7ba71f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.898230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88045956-705e-4984-b62d-c07d7ba71f6a admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.898540 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88045956-705e-4984-b62d-c07d7ba71f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.898813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88045956-705e-4984-b62d-c07d7ba71f6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.899493 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88045956-705e-4984-b62d-c07d7ba71f6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.901441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88045956-705e-4984-b62d-c07d7ba71f6a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.902248 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a2f43-e824-4de2-92c1-1442d55e16fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.902940 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a2f43-e824-4de2-92c1-1442d55e16fa admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.903226 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a2f43-e824-4de2-92c1-1442d55e16fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.903503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a2f43-e824-4de2-92c1-1442d55e16fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.904204 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a2f43-e824-4de2-92c1-1442d55e16fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.906561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a2f43-e824-4de2-92c1-1442d55e16fa admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:40.921309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:40.928197 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 777/1581] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:40.929001 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88045956-705e-4984-b62d-c07d7ba71f6a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.936362 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 805/1582] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:40.937319 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a2f43-e824-4de2-92c1-1442d55e16fa admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:40.991762 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88045956-705e-4984-b62d-c07d7ba71f6a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:40.996437 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cde8fa-72ae-4d7b-95e8-dc6ebb3c9084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:40.997101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cde8fa-72ae-4d7b-95e8-dc6ebb3c9084 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:40.997389 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cde8fa-72ae-4d7b-95e8-dc6ebb3c9084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:40.997655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cde8fa-72ae-4d7b-95e8-dc6ebb3c9084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:40.998922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cde8fa-72ae-4d7b-95e8-dc6ebb3c9084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:40.999845 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a2f43-e824-4de2-92c1-1442d55e16fa admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.000559 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cde8fa-72ae-4d7b-95e8-dc6ebb3c9084 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.004606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b0900-1885-4253-800d-75a747781f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.005287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b0900-1885-4253-800d-75a747781f2f admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.005562 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b0900-1885-4253-800d-75a747781f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.005839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b0900-1885-4253-800d-75a747781f2f admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.006572 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b0900-1885-4253-800d-75a747781f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.008497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b0900-1885-4253-800d-75a747781f2f admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.014571 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 778/1583] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:41.014571 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cde8fa-72ae-4d7b-95e8-dc6ebb3c9084 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.024811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cde8fa-72ae-4d7b-95e8-dc6ebb3c9084 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.029961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73cf2d-b11f-489e-9494-38b3405f07d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.030669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73cf2d-b11f-489e-9494-38b3405f07d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.030942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73cf2d-b11f-489e-9494-38b3405f07d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.031209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73cf2d-b11f-489e-9494-38b3405f07d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.034840 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 806/1584] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:17:40 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:41.034999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73cf2d-b11f-489e-9494-38b3405f07d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.035100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b0900-1885-4253-800d-75a747781f2f admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.035214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73cf2d-b11f-489e-9494-38b3405f07d3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.042578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b0900-1885-4253-800d-75a747781f2f admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.044513 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 779/1585] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:41.045393 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73cf2d-b11f-489e-9494-38b3405f07d3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.049576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce65bc-1f6d-4e52-a726-7fa30567902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.050359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce65bc-1f6d-4e52-a726-7fa30567902b admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.050613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce65bc-1f6d-4e52-a726-7fa30567902b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.050888 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce65bc-1f6d-4e52-a726-7fa30567902b admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.051633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce65bc-1f6d-4e52-a726-7fa30567902b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.053275 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce65bc-1f6d-4e52-a726-7fa30567902b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.055236 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73cf2d-b11f-489e-9494-38b3405f07d3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.059843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076f986-b5df-44a4-981b-c799a3cee3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.060510 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076f986-b5df-44a4-981b-c799a3cee3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.060790 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076f986-b5df-44a4-981b-c799a3cee3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.061102 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076f986-b5df-44a4-981b-c799a3cee3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.061870 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076f986-b5df-44a4-981b-c799a3cee3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.063520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076f986-b5df-44a4-981b-c799a3cee3c1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.067274 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 807/1586] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:41.067274 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce65bc-1f6d-4e52-a726-7fa30567902b admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.074533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce65bc-1f6d-4e52-a726-7fa30567902b admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.080345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 780/1587] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:41.080345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076f986-b5df-44a4-981b-c799a3cee3c1 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.082557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76432bd-b505-432b-a534-88331aa18088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.083324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76432bd-b505-432b-a534-88331aa18088 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.083690 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76432bd-b505-432b-a534-88331aa18088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.083965 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76432bd-b505-432b-a534-88331aa18088 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.084693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76432bd-b505-432b-a534-88331aa18088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.086653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76432bd-b505-432b-a534-88331aa18088 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.089397 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076f986-b5df-44a4-981b-c799a3cee3c1 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.094113 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8247283-3517-4164-bf58-064360a0bda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.094783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8247283-3517-4164-bf58-064360a0bda2 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.095050 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8247283-3517-4164-bf58-064360a0bda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.095323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8247283-3517-4164-bf58-064360a0bda2 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.095995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8247283-3517-4164-bf58-064360a0bda2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.097953 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8247283-3517-4164-bf58-064360a0bda2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.110893 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 808/1588] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:17:41 2022] POST /identity/v3/users => generated 290 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:41.111785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76432bd-b505-432b-a534-88331aa18088 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.122251 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 781/1589] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:17:41 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:41.122251 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8247283-3517-4164-bf58-064360a0bda2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.127461 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76432bd-b505-432b-a534-88331aa18088 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.132816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4608-4e1c-4101-b14d-920775bb94a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.132992 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8247283-3517-4164-bf58-064360a0bda2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.133763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4608-4e1c-4101-b14d-920775bb94a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.134048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4608-4e1c-4101-b14d-920775bb94a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.134338 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4608-4e1c-4101-b14d-920775bb94a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.135105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d4608-4e1c-4101-b14d-920775bb94a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.137084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d4608-4e1c-4101-b14d-920775bb94a5 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.137853 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292a484-7792-4853-9632-bfd54c663c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.138537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292a484-7792-4853-9632-bfd54c663c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.138850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292a484-7792-4853-9632-bfd54c663c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.139132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292a484-7792-4853-9632-bfd54c663c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.139916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292a484-7792-4853-9632-bfd54c663c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.141527 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292a484-7792-4853-9632-bfd54c663c53 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.153030 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 782/1590] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:41.153030 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292a484-7792-4853-9632-bfd54c663c53 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.164427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 809/1591] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:17:41 2022] POST /identity/v3/users => generated 297 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:41.164427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4608-4e1c-4101-b14d-920775bb94a5 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.167380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292a484-7792-4853-9632-bfd54c663c53 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.172377 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4608-4e1c-4101-b14d-920775bb94a5 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.173500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48ce0e-7654-4e3b-afaa-cc2a96d9a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.174211 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48ce0e-7654-4e3b-afaa-cc2a96d9a163 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.174543 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48ce0e-7654-4e3b-afaa-cc2a96d9a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.174829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48ce0e-7654-4e3b-afaa-cc2a96d9a163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.175563 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48ce0e-7654-4e3b-afaa-cc2a96d9a163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.177426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c88072-d0c8-449f-a11b-27184afd7012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.177554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48ce0e-7654-4e3b-afaa-cc2a96d9a163 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.178076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c88072-d0c8-449f-a11b-27184afd7012 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.178413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c88072-d0c8-449f-a11b-27184afd7012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.178683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c88072-d0c8-449f-a11b-27184afd7012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.179601 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c88072-d0c8-449f-a11b-27184afd7012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.181559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c88072-d0c8-449f-a11b-27184afd7012 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.188918 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 783/1592] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:41.189841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48ce0e-7654-4e3b-afaa-cc2a96d9a163 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.192377 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 810/1593] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:41.193161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c88072-d0c8-449f-a11b-27184afd7012 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.201497 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48ce0e-7654-4e3b-afaa-cc2a96d9a163 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.202843 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c88072-d0c8-449f-a11b-27184afd7012 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.206165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c177f-d397-4a1f-93dd-babe70509db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.206873 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c177f-d397-4a1f-93dd-babe70509db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.207147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c177f-d397-4a1f-93dd-babe70509db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.207418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c177f-d397-4a1f-93dd-babe70509db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.208169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c177f-d397-4a1f-93dd-babe70509db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.209267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108542f2-acf0-4914-a678-da8694bc6e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.209780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c177f-d397-4a1f-93dd-babe70509db3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.210196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108542f2-acf0-4914-a678-da8694bc6e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.210502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108542f2-acf0-4914-a678-da8694bc6e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.210776 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108542f2-acf0-4914-a678-da8694bc6e98 admin admin] PATH_INFO: `/v3/projects/b617d0b73acd4fc685c96da2f19312a5/users/c8a38997f7094d019157ab969487da12/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.220120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 784/1594] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:41.220985 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c177f-d397-4a1f-93dd-babe70509db3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.226608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108542f2-acf0-4914-a678-da8694bc6e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b617d0b73acd4fc685c96da2f19312a5, user_id=c8a38997f7094d019157ab969487da12, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.229512 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108542f2-acf0-4914-a678-da8694bc6e98 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.231939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c177f-d397-4a1f-93dd-babe70509db3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.237352 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f8d6b-0941-45bd-bc8d-07c362ec5b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.238028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f8d6b-0941-45bd-bc8d-07c362ec5b27 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.238306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f8d6b-0941-45bd-bc8d-07c362ec5b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.238626 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f8d6b-0941-45bd-bc8d-07c362ec5b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.239553 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f8d6b-0941-45bd-bc8d-07c362ec5b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.241263 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f8d6b-0941-45bd-bc8d-07c362ec5b27 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.244226 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 811/1595] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:41 2022] PUT /identity/v3/projects/b617d0b73acd4fc685c96da2f19312a5/users/c8a38997f7094d019157ab969487da12/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:41.248715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108542f2-acf0-4914-a678-da8694bc6e98 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.254912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 785/1596] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:41.254912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f8d6b-0941-45bd-bc8d-07c362ec5b27 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.262344 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f8d6b-0941-45bd-bc8d-07c362ec5b27 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.288846 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:41.318539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108542f2-acf0-4914-a678-da8694bc6e98 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.322579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb778ee-8e40-4315-85ad-e5320307bb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.323331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1541c37-cc2d-46f0-8ca5-30a506dbba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.323472 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb778ee-8e40-4315-85ad-e5320307bb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.323752 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb778ee-8e40-4315-85ad-e5320307bb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.324006 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1541c37-cc2d-46f0-8ca5-30a506dbba43 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.324115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb778ee-8e40-4315-85ad-e5320307bb15 admin admin] PATH_INFO: `/v3/projects/8410988607bb411b896913e7bf9f0bfd/users/2941a9d547ce469691cee5eb3adc6bfa/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.324292 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1541c37-cc2d-46f0-8ca5-30a506dbba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.324568 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1541c37-cc2d-46f0-8ca5-30a506dbba43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.325307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1541c37-cc2d-46f0-8ca5-30a506dbba43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.327060 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1541c37-cc2d-46f0-8ca5-30a506dbba43 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.329210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:INSERT=11,keystone:SELECT=89 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:41.342254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 812/1597] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:41.343492 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1541c37-cc2d-46f0-8ca5-30a506dbba43 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.343755 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb778ee-8e40-4315-85ad-e5320307bb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8410988607bb411b896913e7bf9f0bfd, user_id=2941a9d547ce469691cee5eb3adc6bfa, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.347197 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb778ee-8e40-4315-85ad-e5320307bb15 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.353669 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1541c37-cc2d-46f0-8ca5-30a506dbba43 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.358514 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16c95f-2a87-41db-9310-1523ac23bfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.359183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16c95f-2a87-41db-9310-1523ac23bfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.359484 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16c95f-2a87-41db-9310-1523ac23bfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.359885 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16c95f-2a87-41db-9310-1523ac23bfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.360653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16c95f-2a87-41db-9310-1523ac23bfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.361281 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 786/1598] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:41 2022] PUT /identity/v3/projects/8410988607bb411b896913e7bf9f0bfd/users/2941a9d547ce469691cee5eb3adc6bfa/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:41.362275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb778ee-8e40-4315-85ad-e5320307bb15 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.367457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16c95f-2a87-41db-9310-1523ac23bfe5 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.379804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 813/1599] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:41.380803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16c95f-2a87-41db-9310-1523ac23bfe5 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.390657 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16c95f-2a87-41db-9310-1523ac23bfe5 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.424744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb778ee-8e40-4315-85ad-e5320307bb15 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.429776 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e9912-3b27-46aa-95c9-534edd9b6311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.430549 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e9912-3b27-46aa-95c9-534edd9b6311 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.430807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e9912-3b27-46aa-95c9-534edd9b6311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.431086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e9912-3b27-46aa-95c9-534edd9b6311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.431840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e9912-3b27-46aa-95c9-534edd9b6311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.433447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e9912-3b27-46aa-95c9-534edd9b6311 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.443837 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 787/1600] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:41.444683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e9912-3b27-46aa-95c9-534edd9b6311 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.446240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ee4d4-d7fa-49d1-955a-e367781341f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.447366 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ee4d4-d7fa-49d1-955a-e367781341f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.447654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ee4d4-d7fa-49d1-955a-e367781341f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.447923 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ee4d4-d7fa-49d1-955a-e367781341f7 admin admin] PATH_INFO: `/v3/projects/09b949fc3a4443e89d37de3256adb793/users/896e2214f4794e90a5f0416e016d0dde/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.454261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e9912-3b27-46aa-95c9-534edd9b6311 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.458719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63844a3f-9274-45db-8c42-0254cfb8a217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.459602 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63844a3f-9274-45db-8c42-0254cfb8a217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.459881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63844a3f-9274-45db-8c42-0254cfb8a217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.460155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63844a3f-9274-45db-8c42-0254cfb8a217 admin admin] PATH_INFO: `/v3/projects/bd29857661d648b0aabab2537e07ddfc/users/309284b7310e4a9381a9e9d2d2673ec5/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.462974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ee4d4-d7fa-49d1-955a-e367781341f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b949fc3a4443e89d37de3256adb793, user_id=896e2214f4794e90a5f0416e016d0dde, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.465646 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ee4d4-d7fa-49d1-955a-e367781341f7 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.475536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63844a3f-9274-45db-8c42-0254cfb8a217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd29857661d648b0aabab2537e07ddfc, user_id=309284b7310e4a9381a9e9d2d2673ec5, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.478176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63844a3f-9274-45db-8c42-0254cfb8a217 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.480681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 814/1601] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:41 2022] PUT /identity/v3/projects/09b949fc3a4443e89d37de3256adb793/users/896e2214f4794e90a5f0416e016d0dde/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:41.487093 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee07a6-55da-4372-807c-b02f1ba8f18c None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.487093 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee07a6-55da-4372-807c-b02f1ba8f18c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.487093 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee07a6-55da-4372-807c-b02f1ba8f18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.493688 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 788/1602] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:41 2022] PUT /identity/v3/projects/bd29857661d648b0aabab2537e07ddfc/users/309284b7310e4a9381a9e9d2d2673ec5/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:41.494586 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63844a3f-9274-45db-8c42-0254cfb8a217 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.503107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-1aee07a6-55da-4372-807c-b02f1ba8f18c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:41.504352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1aee07a6-55da-4372-807c-b02f1ba8f18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:41.560052 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63844a3f-9274-45db-8c42-0254cfb8a217 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.565050 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446597f0-ae17-4af4-a2fc-a02744117118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.565763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446597f0-ae17-4af4-a2fc-a02744117118 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.566043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446597f0-ae17-4af4-a2fc-a02744117118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.566317 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446597f0-ae17-4af4-a2fc-a02744117118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.567076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446597f0-ae17-4af4-a2fc-a02744117118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.568935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446597f0-ae17-4af4-a2fc-a02744117118 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.571392 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 815/1603] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:41.571944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee07a6-55da-4372-807c-b02f1ba8f18c None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.581639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 789/1604] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:41.582092 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee07a6-55da-4372-807c-b02f1ba8f18c None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.583317 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed071a-3f7e-4bd1-adc6-b957961323f6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.583779 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed071a-3f7e-4bd1-adc6-b957961323f6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.584265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed071a-3f7e-4bd1-adc6-b957961323f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.587201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a64b7c-0ab9-4c7f-b3c8-86d86c181238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.587870 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a64b7c-0ab9-4c7f-b3c8-86d86c181238 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.588152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a64b7c-0ab9-4c7f-b3c8-86d86c181238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.588437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a64b7c-0ab9-4c7f-b3c8-86d86c181238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.589186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a64b7c-0ab9-4c7f-b3c8-86d86c181238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.590917 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a64b7c-0ab9-4c7f-b3c8-86d86c181238 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.604747 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 816/1605] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:41.604747 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a64b7c-0ab9-4c7f-b3c8-86d86c181238 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.611056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3fed071a-3f7e-4bd1-adc6-b957961323f6 None None] MFA Rules not processed for user `2941a9d547ce469691cee5eb3adc6bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:41.612214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a64b7c-0ab9-4c7f-b3c8-86d86c181238 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.612343 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3fed071a-3f7e-4bd1-adc6-b957961323f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:41.616857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60603c35-8716-4efc-8bb5-a07d6cef2b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.617395 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:41.617770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60603c35-8716-4efc-8bb5-a07d6cef2b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.618334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60603c35-8716-4efc-8bb5-a07d6cef2b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.618334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60603c35-8716-4efc-8bb5-a07d6cef2b03 admin admin] PATH_INFO: `/v3/projects/8f7152613ffd4c2682a6ea4caced0dd1/users/87e104452b2f425ea63ca3862371f363/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.634974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60603c35-8716-4efc-8bb5-a07d6cef2b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7152613ffd4c2682a6ea4caced0dd1, user_id=87e104452b2f425ea63ca3862371f363, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.637674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60603c35-8716-4efc-8bb5-a07d6cef2b03 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.653216 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 817/1606] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:41 2022] PUT /identity/v3/projects/8f7152613ffd4c2682a6ea4caced0dd1/users/87e104452b2f425ea63ca3862371f363/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:41.654618 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60603c35-8716-4efc-8bb5-a07d6cef2b03 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.680575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 790/1607] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:41.681945 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088f6df-4519-40e8-865f-21e4c477681d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.682237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088f6df-4519-40e8-865f-21e4c477681d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.682547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088f6df-4519-40e8-865f-21e4c477681d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.699462 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:41.699638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e088f6df-4519-40e8-865f-21e4c477681d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:41.700777 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e088f6df-4519-40e8-865f-21e4c477681d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:41.724548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60603c35-8716-4efc-8bb5-a07d6cef2b03 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.730081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff6c93-dfeb-4c22-9148-908f604aba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.731023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff6c93-dfeb-4c22-9148-908f604aba24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.731304 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff6c93-dfeb-4c22-9148-908f604aba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.731584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff6c93-dfeb-4c22-9148-908f604aba24 admin admin] PATH_INFO: `/v3/projects/e54fbc9cf2cc4131bc6239d082a8f991/users/a19eb1f3c9e74f3c92755186a7a44ba8/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.747386 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff6c93-dfeb-4c22-9148-908f604aba24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54fbc9cf2cc4131bc6239d082a8f991, user_id=a19eb1f3c9e74f3c92755186a7a44ba8, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.750905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff6c93-dfeb-4c22-9148-908f604aba24 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.762233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 791/1608] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:41.764758 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 818/1609] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:41 2022] PUT /identity/v3/projects/e54fbc9cf2cc4131bc6239d082a8f991/users/a19eb1f3c9e74f3c92755186a7a44ba8/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:41.765576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff6c93-dfeb-4c22-9148-908f604aba24 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.769631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c20ac-8a6a-4323-93bc-6ec17dade3fb None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.769939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c20ac-8a6a-4323-93bc-6ec17dade3fb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.770349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c20ac-8a6a-4323-93bc-6ec17dade3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.788768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7e8c20ac-8a6a-4323-93bc-6ec17dade3fb None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:41.790005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7e8c20ac-8a6a-4323-93bc-6ec17dade3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:41.823374 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff6c93-dfeb-4c22-9148-908f604aba24 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.827224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d30cc-aef8-4d60-831f-a252d138e163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.827890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d30cc-aef8-4d60-831f-a252d138e163 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.828543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d30cc-aef8-4d60-831f-a252d138e163 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.828543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d30cc-aef8-4d60-831f-a252d138e163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.849694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 792/1610] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:41.853233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c20ac-8a6a-4323-93bc-6ec17dade3fb None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.863990 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c20ac-8a6a-4323-93bc-6ec17dade3fb None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.869315 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907b7c6-4915-41ce-bcc6-d8575bf409d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.870268 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907b7c6-4915-41ce-bcc6-d8575bf409d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.870587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907b7c6-4915-41ce-bcc6-d8575bf409d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.870862 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907b7c6-4915-41ce-bcc6-d8575bf409d1 admin admin] PATH_INFO: `/v3/projects/405181eb72ae40faaa08de93cd366941/users/c205c6af37ca4cbb88cd35e7229a9776/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.886989 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907b7c6-4915-41ce-bcc6-d8575bf409d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=405181eb72ae40faaa08de93cd366941, user_id=c205c6af37ca4cbb88cd35e7229a9776, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.889753 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907b7c6-4915-41ce-bcc6-d8575bf409d1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.893714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d30cc-aef8-4d60-831f-a252d138e163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.895416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d30cc-aef8-4d60-831f-a252d138e163 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.903397 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 793/1611] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:41 2022] PUT /identity/v3/projects/405181eb72ae40faaa08de93cd366941/users/c205c6af37ca4cbb88cd35e7229a9776/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:41.904217 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907b7c6-4915-41ce-bcc6-d8575bf409d1 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.906207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 819/1612] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:41.906943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d30cc-aef8-4d60-831f-a252d138e163 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:41.916368 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d30cc-aef8-4d60-831f-a252d138e163 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.934936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:41.975896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907b7c6-4915-41ce-bcc6-d8575bf409d1 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:41.980443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272175e-d0fc-47d6-ae2f-acbbf775ae3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.980897 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d4225-9761-408b-bc13-5e53994c2c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:41.981286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272175e-d0fc-47d6-ae2f-acbbf775ae3d admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.981625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272175e-d0fc-47d6-ae2f-acbbf775ae3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.982176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d4225-9761-408b-bc13-5e53994c2c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:41.982312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4272175e-d0fc-47d6-ae2f-acbbf775ae3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.982434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d4225-9761-408b-bc13-5e53994c2c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:41.982848 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d4225-9761-408b-bc13-5e53994c2c1d admin admin] PATH_INFO: `/v3/projects/49a23e94c5854818b9c28fe45e01b886/users/bb96450a1f17486a98b413a72879c991/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:41.983053 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272175e-d0fc-47d6-ae2f-acbbf775ae3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:41.984512 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4272175e-d0fc-47d6-ae2f-acbbf775ae3d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:41.997851 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 820/1613] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:41.998990 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272175e-d0fc-47d6-ae2f-acbbf775ae3d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:42.000644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d4225-9761-408b-bc13-5e53994c2c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a23e94c5854818b9c28fe45e01b886, user_id=bb96450a1f17486a98b413a72879c991, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:42.004599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d4225-9761-408b-bc13-5e53994c2c1d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:42.007317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:42.012150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4272175e-d0fc-47d6-ae2f-acbbf775ae3d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:42.021316 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 794/1614] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:41 2022] PUT /identity/v3/projects/49a23e94c5854818b9c28fe45e01b886/users/bb96450a1f17486a98b413a72879c991/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:42.022566 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19bc13-533a-4c1b-a48b-4c76f7bb0012 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:42.022904 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19bc13-533a-4c1b-a48b-4c76f7bb0012 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:42.023235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19bc13-533a-4c1b-a48b-4c76f7bb0012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:42.040633 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ed19bc13-533a-4c1b-a48b-4c76f7bb0012 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:42.041851 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ed19bc13-533a-4c1b-a48b-4c76f7bb0012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:42.087294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3367-b7b9-4445-b926-cbb7018950e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:42.088507 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3367-b7b9-4445-b926-cbb7018950e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:42.089072 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3367-b7b9-4445-b926-cbb7018950e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:42.089416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3367-b7b9-4445-b926-cbb7018950e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:42.090213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db3367-b7b9-4445-b926-cbb7018950e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:42.092249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db3367-b7b9-4445-b926-cbb7018950e5 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:42.113431 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 795/1615] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:42.113431 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19bc13-533a-4c1b-a48b-4c76f7bb0012 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:42.113431 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ed19bc13-533a-4c1b-a48b-4c76f7bb0012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:42.141761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 821/1616] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:17:41 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:42.142810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3367-b7b9-4445-b926-cbb7018950e5 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:42.196520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19bc13-533a-4c1b-a48b-4c76f7bb0012 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:42.217336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3367-b7b9-4445-b926-cbb7018950e5 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:42.221844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae7792-41c8-4f15-bf80-86b0cfb15004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:42.222761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae7792-41c8-4f15-bf80-86b0cfb15004 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:42.223377 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae7792-41c8-4f15-bf80-86b0cfb15004 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:42.223817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae7792-41c8-4f15-bf80-86b0cfb15004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:42.257362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcf2d9-19d3-4114-9a49-e3f324f87561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:42.258542 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf2d9-19d3-4114-9a49-e3f324f87561 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:42.258831 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf2d9-19d3-4114-9a49-e3f324f87561 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:42.259101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf2d9-19d3-4114-9a49-e3f324f87561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:42.280520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:42.331588 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae7792-41c8-4f15-bf80-86b0cfb15004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:42.333943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae7792-41c8-4f15-bf80-86b0cfb15004 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:42.337856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcf2d9-19d3-4114-9a49-e3f324f87561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:42.339811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcf2d9-19d3-4114-9a49-e3f324f87561 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:42.347869 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 822/1617] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:42.350246 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cb0a3-59fa-47fd-b081-5b5cab5887fb None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:42.350570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cb0a3-59fa-47fd-b081-5b5cab5887fb None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:42.350996 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cb0a3-59fa-47fd-b081-5b5cab5887fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:42.353584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 796/1618] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:42.354676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcf2d9-19d3-4114-9a49-e3f324f87561 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:42.367359 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcf2d9-19d3-4114-9a49-e3f324f87561 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:42.372790 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abb989-8159-4ee9-b64a-4fe8da8a69e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:42.374416 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abb989-8159-4ee9-b64a-4fe8da8a69e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:42.374995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abb989-8159-4ee9-b64a-4fe8da8a69e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:42.375674 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abb989-8159-4ee9-b64a-4fe8da8a69e1 admin admin] PATH_INFO: `/v3/projects/8f7152613ffd4c2682a6ea4caced0dd1/users/87e104452b2f425ea63ca3862371f363/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:42.379001 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abb989-8159-4ee9-b64a-4fe8da8a69e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7152613ffd4c2682a6ea4caced0dd1, user_id=87e104452b2f425ea63ca3862371f363, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:42.379606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-035cb0a3-59fa-47fd-b081-5b5cab5887fb None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:42.380833 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-035cb0a3-59fa-47fd-b081-5b5cab5887fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:42.381967 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abb989-8159-4ee9-b64a-4fe8da8a69e1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:42.393496 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 823/1619] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:42.395026 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa0eda-0859-4bae-88f9-838b3b888d07 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:42.395315 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa0eda-0859-4bae-88f9-838b3b888d07 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:42.395586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa0eda-0859-4bae-88f9-838b3b888d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:42.401745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 797/1620] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:42 2022] PUT /identity/v3/projects/8f7152613ffd4c2682a6ea4caced0dd1/users/87e104452b2f425ea63ca3862371f363/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:42.404351 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abb989-8159-4ee9-b64a-4fe8da8a69e1 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:42.430084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-2aaa0eda-0859-4bae-88f9-838b3b888d07 None None] MFA Rules not processed for user `bb96450a1f17486a98b413a72879c991`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:42.431345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2aaa0eda-0859-4bae-88f9-838b3b888d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:42.461444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:42.514987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abb989-8159-4ee9-b64a-4fe8da8a69e1 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:42.520122 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1ebf0-e517-4708-8df3-8b16cebd6c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:42.520999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1ebf0-e517-4708-8df3-8b16cebd6c12 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:42.521382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1ebf0-e517-4708-8df3-8b16cebd6c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:42.521933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1ebf0-e517-4708-8df3-8b16cebd6c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:42.528814 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 824/1621] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:42.530035 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa0eda-0859-4bae-88f9-838b3b888d07 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:42.636080 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa0eda-0859-4bae-88f9-838b3b888d07 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:42.642138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86636df-5074-4b1c-89ce-9886d7011405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:42.643364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86636df-5074-4b1c-89ce-9886d7011405 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:42.643364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86636df-5074-4b1c-89ce-9886d7011405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:42.643658 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86636df-5074-4b1c-89ce-9886d7011405 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:42.644352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86636df-5074-4b1c-89ce-9886d7011405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:42.647398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86636df-5074-4b1c-89ce-9886d7011405 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:42.664507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1ebf0-e517-4708-8df3-8b16cebd6c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:42.667301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1ebf0-e517-4708-8df3-8b16cebd6c12 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:42.672419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 825/1622] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:17:42 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:42.673436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86636df-5074-4b1c-89ce-9886d7011405 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:42.685589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 798/1623] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:42.687760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2faf0-128e-460e-afe0-c4505324b274 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:42.688064 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2faf0-128e-460e-afe0-c4505324b274 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:42.688363 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2faf0-128e-460e-afe0-c4505324b274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:42.703234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86636df-5074-4b1c-89ce-9886d7011405 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:42.708416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd027b-a458-4f96-9d83-a1cd7eb0c18e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:42.709096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd027b-a458-4f96-9d83-a1cd7eb0c18e service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:42.709377 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd027b-a458-4f96-9d83-a1cd7eb0c18e service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:42.710221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd027b-a458-4f96-9d83-a1cd7eb0c18e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:42.725708 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d3e2faf0-128e-460e-afe0-c4505324b274 None None] MFA Rules not processed for user `87e104452b2f425ea63ca3862371f363`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:42.726483 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd027b-a458-4f96-9d83-a1cd7eb0c18e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:42.727752 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d3e2faf0-128e-460e-afe0-c4505324b274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:42.728683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd027b-a458-4f96-9d83-a1cd7eb0c18e service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:42.747372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 826/1624] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:42.749935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059f34f-586b-42c0-90de-089aeac89780 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:42.750959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059f34f-586b-42c0-90de-089aeac89780 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:42.751291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059f34f-586b-42c0-90de-089aeac89780 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:42.753670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 827/1625] 10.222.0.99 () {54 vars in 962 bytes} [Mon Jul 18 14:17:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:17:42.754911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059f34f-586b-42c0-90de-089aeac89780 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:42.773699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059f34f-586b-42c0-90de-089aeac89780 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:42.783943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73e134-01b9-4370-801b-2b7e45bef171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:42.784816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73e134-01b9-4370-801b-2b7e45bef171 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:42.785549 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73e134-01b9-4370-801b-2b7e45bef171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:42.786405 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73e134-01b9-4370-801b-2b7e45bef171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:42.787546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73e134-01b9-4370-801b-2b7e45bef171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:42.791218 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73e134-01b9-4370-801b-2b7e45bef171 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:42.793979 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:42.816813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 828/1626] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:42.819578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8425a8-c928-4368-b485-b8e1bc1672e3 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:42.820178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8425a8-c928-4368-b485-b8e1bc1672e3 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:42.820567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8425a8-c928-4368-b485-b8e1bc1672e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:42.841706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 799/1627] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:42.842875 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2faf0-128e-460e-afe0-c4505324b274 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:42.862123 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2faf0-128e-460e-afe0-c4505324b274 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:42.867117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e45a1f-d701-47a1-bf03-6c9644eceffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:42.868444 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e45a1f-d701-47a1-bf03-6c9644eceffe admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:42.869384 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e45a1f-d701-47a1-bf03-6c9644eceffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:42.869818 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e45a1f-d701-47a1-bf03-6c9644eceffe admin admin] PATH_INFO: `/v3/projects/276c5446bc334b9397d645ed492144c1/users/cddeeb59bb5a4ca19b12d7f22a24da02/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:42.893672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e45a1f-d701-47a1-bf03-6c9644eceffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=276c5446bc334b9397d645ed492144c1, user_id=cddeeb59bb5a4ca19b12d7f22a24da02, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:42.896626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-7b8425a8-c928-4368-b485-b8e1bc1672e3 None None] MFA Rules not processed for user `b1b66b55e0374152828913910c4002f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:42.897078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e45a1f-d701-47a1-bf03-6c9644eceffe admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:42.898215 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-7b8425a8-c928-4368-b485-b8e1bc1672e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:42.922521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 800/1628] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:42 2022] PUT /identity/v3/projects/276c5446bc334b9397d645ed492144c1/users/cddeeb59bb5a4ca19b12d7f22a24da02/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:42.928084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e45a1f-d701-47a1-bf03-6c9644eceffe admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:43.049138 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e45a1f-d701-47a1-bf03-6c9644eceffe admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:43.057603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32e90b-4336-42e3-9030-0b115ba814b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:43.060083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32e90b-4336-42e3-9030-0b115ba814b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:43.060713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 829/1629] 10.222.0.99 () {58 vars in 1059 bytes} [Mon Jul 18 14:17:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:43.061193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32e90b-4336-42e3-9030-0b115ba814b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:43.063019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32e90b-4336-42e3-9030-0b115ba814b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:43.064388 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8425a8-c928-4368-b485-b8e1bc1672e3 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:43.104433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8425a8-c928-4368-b485-b8e1bc1672e3 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:43.110046 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:43.196246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32e90b-4336-42e3-9030-0b115ba814b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:43.197343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0328416-8859-4db9-bf57-fb01500fa140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:43.197972 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32e90b-4336-42e3-9030-0b115ba814b7 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:43.198196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0328416-8859-4db9-bf57-fb01500fa140 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:43.198612 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0328416-8859-4db9-bf57-fb01500fa140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:43.198973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0328416-8859-4db9-bf57-fb01500fa140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:43.200664 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0328416-8859-4db9-bf57-fb01500fa140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:43.203795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0328416-8859-4db9-bf57-fb01500fa140 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:43.212907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 801/1630] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:43.214576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32e90b-4336-42e3-9030-0b115ba814b7 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:43.222679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 830/1631] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:43.223886 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0328416-8859-4db9-bf57-fb01500fa140 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:43.237355 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0328416-8859-4db9-bf57-fb01500fa140 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:43.245169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fd30b-ae15-4010-acb5-f1667346a3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:43.247376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fd30b-ae15-4010-acb5-f1667346a3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:43.248398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fd30b-ae15-4010-acb5-f1667346a3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:43.249050 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fd30b-ae15-4010-acb5-f1667346a3ca admin admin] PATH_INFO: `/v3/projects/276c5446bc334b9397d645ed492144c1/users/cddeeb59bb5a4ca19b12d7f22a24da02/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:43.251914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fd30b-ae15-4010-acb5-f1667346a3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=276c5446bc334b9397d645ed492144c1, user_id=cddeeb59bb5a4ca19b12d7f22a24da02, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:43.255711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fd30b-ae15-4010-acb5-f1667346a3ca admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:43.281880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 831/1632] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:43 2022] PUT /identity/v3/projects/276c5446bc334b9397d645ed492144c1/users/cddeeb59bb5a4ca19b12d7f22a24da02/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:43.283902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a82f9-d34c-4b87-8ad0-23255784b22c None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:43.284210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a82f9-d34c-4b87-8ad0-23255784b22c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:43.284490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a82f9-d34c-4b87-8ad0-23255784b22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:43.297898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:43.322212 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32e90b-4336-42e3-9030-0b115ba814b7 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:43.335409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-8f9a82f9-d34c-4b87-8ad0-23255784b22c None None] MFA Rules not processed for user `cddeeb59bb5a4ca19b12d7f22a24da02`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:43.336830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8f9a82f9-d34c-4b87-8ad0-23255784b22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:43.467904 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 832/1633] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:43.469837 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a82f9-d34c-4b87-8ad0-23255784b22c None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:43.476290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64a6bd-b158-473c-93e6-b24d446d1bf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:43.476966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64a6bd-b158-473c-93e6-b24d446d1bf8 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:43.477248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64a6bd-b158-473c-93e6-b24d446d1bf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:43.477541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64a6bd-b158-473c-93e6-b24d446d1bf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:43.537126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a82f9-d34c-4b87-8ad0-23255784b22c None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:43.542189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801400f6-9700-4369-8369-a14f2eb763b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:43.543293 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801400f6-9700-4369-8369-a14f2eb763b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:43.543729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801400f6-9700-4369-8369-a14f2eb763b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:43.544199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801400f6-9700-4369-8369-a14f2eb763b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:43.549147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64a6bd-b158-473c-93e6-b24d446d1bf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:43.551048 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64a6bd-b158-473c-93e6-b24d446d1bf8 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:43.562794 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 802/1634] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:43.563907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64a6bd-b158-473c-93e6-b24d446d1bf8 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:43.574984 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64a6bd-b158-473c-93e6-b24d446d1bf8 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:43.580369 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d7eba-39e5-4853-9bf0-83c575c61eff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:43.581527 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d7eba-39e5-4853-9bf0-83c575c61eff service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:43.581817 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d7eba-39e5-4853-9bf0-83c575c61eff service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:43.582180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d7eba-39e5-4853-9bf0-83c575c61eff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:43.586490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:43.595901 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d7eba-39e5-4853-9bf0-83c575c61eff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:43.598019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d7eba-39e5-4853-9bf0-83c575c61eff service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:43.627753 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 803/1635] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:43.628893 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801400f6-9700-4369-8369-a14f2eb763b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:43.632118 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801400f6-9700-4369-8369-a14f2eb763b5 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:43.656502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 833/1636] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:43.747715 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d7eba-39e5-4853-9bf0-83c575c61eff service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:43.760569 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d7eba-39e5-4853-9bf0-83c575c61eff service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:43.765157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de524ddc-5da3-4a59-abaa-28f8af63dc59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:43.765869 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de524ddc-5da3-4a59-abaa-28f8af63dc59 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:43.766148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de524ddc-5da3-4a59-abaa-28f8af63dc59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:43.766502 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de524ddc-5da3-4a59-abaa-28f8af63dc59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:43.912373 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de524ddc-5da3-4a59-abaa-28f8af63dc59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:43.919801 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de524ddc-5da3-4a59-abaa-28f8af63dc59 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:43.956348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 804/1637] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:44.049650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1684600-34c9-4480-a87c-0fc04dd737b5 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:44.050154 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1684600-34c9-4480-a87c-0fc04dd737b5 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:44.050472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1684600-34c9-4480-a87c-0fc04dd737b5 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:44.058271 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba02c5-ecd6-4e13-8f01-3dfc56592e71 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:44.058757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba02c5-ecd6-4e13-8f01-3dfc56592e71 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:44.059080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba02c5-ecd6-4e13-8f01-3dfc56592e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:44.063045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 834/1638] 10.222.0.99 () {54 vars in 912 bytes} [Mon Jul 18 14:17:44 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:17:44.100118 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3fba02c5-ecd6-4e13-8f01-3dfc56592e71 None None] MFA Rules not processed for user `b1b66b55e0374152828913910c4002f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:44.114293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3fba02c5-ecd6-4e13-8f01-3dfc56592e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:44.149532 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 805/1639] 10.222.0.99 () {58 vars in 1009 bytes} [Mon Jul 18 14:17:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:17:44.210325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1684600-34c9-4480-a87c-0fc04dd737b5 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:44.231134 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1684600-34c9-4480-a87c-0fc04dd737b5 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:44.237790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afb62f-6942-4315-9170-f650cee96bc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:44.238538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afb62f-6942-4315-9170-f650cee96bc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:44.238828 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afb62f-6942-4315-9170-f650cee96bc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:44.239109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afb62f-6942-4315-9170-f650cee96bc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:44.266819 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afb62f-6942-4315-9170-f650cee96bc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:44.269850 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afb62f-6942-4315-9170-f650cee96bc9 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:44.319606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 835/1640] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:17:44.667154 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae8ea5-2a0f-4478-ae0d-eaacfb1dd19d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:44.668611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae8ea5-2a0f-4478-ae0d-eaacfb1dd19d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:44.669185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae8ea5-2a0f-4478-ae0d-eaacfb1dd19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:44.736801 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-39ae8ea5-2a0f-4478-ae0d-eaacfb1dd19d None None] MFA Rules not processed for user `309284b7310e4a9381a9e9d2d2673ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:44.742050 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-39ae8ea5-2a0f-4478-ae0d-eaacfb1dd19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:44.754132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:44.844742 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 806/1641] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:44.850330 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afb62f-6942-4315-9170-f650cee96bc9 service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:44.992451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afb62f-6942-4315-9170-f650cee96bc9 service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:44.997650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10246b-387d-43ed-aeb8-7559fa0ef63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:45.001853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10246b-387d-43ed-aeb8-7559fa0ef63f admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:45.001853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10246b-387d-43ed-aeb8-7559fa0ef63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:45.001853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10246b-387d-43ed-aeb8-7559fa0ef63f admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:45.001853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10246b-387d-43ed-aeb8-7559fa0ef63f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:45.003248 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10246b-387d-43ed-aeb8-7559fa0ef63f admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:45.052685 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae8ea5-2a0f-4478-ae0d-eaacfb1dd19d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:45.059027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 836/1642] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:17:44 2022] POST /identity/v3/projects => generated 405 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:45.065020 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae8ea5-2a0f-4478-ae0d-eaacfb1dd19d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:45.156954 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f4cbe-9122-4c9c-a8f2-19b254122ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:45.158045 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f4cbe-9122-4c9c-a8f2-19b254122ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:45.158730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f4cbe-9122-4c9c-a8f2-19b254122ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:45.159229 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f4cbe-9122-4c9c-a8f2-19b254122ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:45.160762 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f4cbe-9122-4c9c-a8f2-19b254122ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:45.163921 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f4cbe-9122-4c9c-a8f2-19b254122ef5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:45.198033 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 807/1643] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:17:45 2022] POST /identity/v3/users => generated 309 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:45.205444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10246b-387d-43ed-aeb8-7559fa0ef63f admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:45.233593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10246b-387d-43ed-aeb8-7559fa0ef63f admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:45.250479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35e981-3b79-4d37-81ab-ee82a5e04144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:45.254830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35e981-3b79-4d37-81ab-ee82a5e04144 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:45.255355 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35e981-3b79-4d37-81ab-ee82a5e04144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:45.255905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35e981-3b79-4d37-81ab-ee82a5e04144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:45.256991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35e981-3b79-4d37-81ab-ee82a5e04144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:45.271754 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35e981-3b79-4d37-81ab-ee82a5e04144 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:45.306898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f4cbe-9122-4c9c-a8f2-19b254122ef5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:45.311175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 837/1644] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:45.331175 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f4cbe-9122-4c9c-a8f2-19b254122ef5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:45.356298 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f96d6-f51e-425f-8887-af277e978177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:45.357347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f96d6-f51e-425f-8887-af277e978177 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:45.359734 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f96d6-f51e-425f-8887-af277e978177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:45.360186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f96d6-f51e-425f-8887-af277e978177 admin admin] PATH_INFO: `/v3/projects/c66a9abb33b042dbbbd4035f71fed90f/users/2bc13c2b20464142a1c5ee0558d9e719/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:45.403479 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f96d6-f51e-425f-8887-af277e978177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66a9abb33b042dbbbd4035f71fed90f, user_id=2bc13c2b20464142a1c5ee0558d9e719, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:45.410616 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f96d6-f51e-425f-8887-af277e978177 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:45.447501 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 808/1645] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:45 2022] PUT /identity/v3/projects/c66a9abb33b042dbbbd4035f71fed90f/users/2bc13c2b20464142a1c5ee0558d9e719/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:45.451486 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35e981-3b79-4d37-81ab-ee82a5e04144 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:45.464083 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35e981-3b79-4d37-81ab-ee82a5e04144 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:45.594818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f074733-291b-4cbc-aceb-5d5214752edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:45.595529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074733-291b-4cbc-aceb-5d5214752edd admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:45.595815 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074733-291b-4cbc-aceb-5d5214752edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:45.596093 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074733-291b-4cbc-aceb-5d5214752edd admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:45.596853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f074733-291b-4cbc-aceb-5d5214752edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:45.598547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f074733-291b-4cbc-aceb-5d5214752edd admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:45.626687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 838/1646] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:45.628453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f96d6-f51e-425f-8887-af277e978177 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:45.649103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f96d6-f51e-425f-8887-af277e978177 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:45.671914 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333cfab-726a-45f0-8449-c927b0647cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:45.676035 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333cfab-726a-45f0-8449-c927b0647cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:45.679167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333cfab-726a-45f0-8449-c927b0647cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:45.681988 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333cfab-726a-45f0-8449-c927b0647cfa admin admin] PATH_INFO: `/v3/projects/c66a9abb33b042dbbbd4035f71fed90f/users/2bc13c2b20464142a1c5ee0558d9e719/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:45.691986 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333cfab-726a-45f0-8449-c927b0647cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66a9abb33b042dbbbd4035f71fed90f, user_id=2bc13c2b20464142a1c5ee0558d9e719, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:45.699583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333cfab-726a-45f0-8449-c927b0647cfa admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:45.735465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 809/1647] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:45 2022] PUT /identity/v3/projects/c66a9abb33b042dbbbd4035f71fed90f/users/2bc13c2b20464142a1c5ee0558d9e719/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:45.942163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960c536-59a2-4886-b2db-3747197b7231 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:45.942726 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960c536-59a2-4886-b2db-3747197b7231 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:45.942816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960c536-59a2-4886-b2db-3747197b7231 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:45.945282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 839/1648] 10.222.0.99 () {54 vars in 962 bytes} [Mon Jul 18 14:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:17:45.953144 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b32b6-25be-4af1-85e0-510687809d93 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:45.953583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b32b6-25be-4af1-85e0-510687809d93 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:45.953872 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b32b6-25be-4af1-85e0-510687809d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:45.995235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5f4b32b6-25be-4af1-85e0-510687809d93 None None] MFA Rules not processed for user `b1b66b55e0374152828913910c4002f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:45.996508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5f4b32b6-25be-4af1-85e0-510687809d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:46.140339 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:46.179212 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 810/1649] 10.222.0.99 () {58 vars in 1059 bytes} [Mon Jul 18 14:17:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:46.180823 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc0c04-0da5-4b8a-a55a-00dc0dc42d62 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:46.181181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc0c04-0da5-4b8a-a55a-00dc0dc42d62 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:46.181470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc0c04-0da5-4b8a-a55a-00dc0dc42d62 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:46.184002 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 840/1650] 10.222.0.99 () {54 vars in 912 bytes} [Mon Jul 18 14:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:17:46.192429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87066939-1847-4f98-90a0-06f7355a253f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:46.192954 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87066939-1847-4f98-90a0-06f7355a253f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:46.193387 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87066939-1847-4f98-90a0-06f7355a253f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:46.249821 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-87066939-1847-4f98-90a0-06f7355a253f None None] MFA Rules not processed for user `b1b66b55e0374152828913910c4002f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:46.251406 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-87066939-1847-4f98-90a0-06f7355a253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:46.282510 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 811/1651] 10.222.0.99 () {58 vars in 1009 bytes} [Mon Jul 18 14:17:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:46.289014 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc0c04-0da5-4b8a-a55a-00dc0dc42d62 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:46.362255 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:46.433477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc0c04-0da5-4b8a-a55a-00dc0dc42d62 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:46.448151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b02c0-e01d-4e1f-8987-ed65e3f98c4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:46.459421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b02c0-e01d-4e1f-8987-ed65e3f98c4d service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:46.459421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b02c0-e01d-4e1f-8987-ed65e3f98c4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:46.459421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b02c0-e01d-4e1f-8987-ed65e3f98c4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:46.485392 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b02c0-e01d-4e1f-8987-ed65e3f98c4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:46.487306 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b02c0-e01d-4e1f-8987-ed65e3f98c4d service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:46.522826 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 841/1652] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:48.887427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086a0fb-53cc-4f63-8289-1c58dc67088b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:48.888021 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086a0fb-53cc-4f63-8289-1c58dc67088b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:48.888021 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086a0fb-53cc-4f63-8289-1c58dc67088b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:48.947475 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e086a0fb-53cc-4f63-8289-1c58dc67088b None None] MFA Rules not processed for user `2bc13c2b20464142a1c5ee0558d9e719`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:48.950165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e086a0fb-53cc-4f63-8289-1c58dc67088b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:49.112088 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 812/1653] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:51.728085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b02c0-e01d-4e1f-8987-ed65e3f98c4d service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:51.970525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b02c0-e01d-4e1f-8987-ed65e3f98c4d service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:52.004110 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58841884-cd0b-44ff-9ba0-450ccace8e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:52.007933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58841884-cd0b-44ff-9ba0-450ccace8e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:52.008249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58841884-cd0b-44ff-9ba0-450ccace8e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:52.010120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58841884-cd0b-44ff-9ba0-450ccace8e89 admin admin] PATH_INFO: `/v3/users/bb96450a1f17486a98b413a72879c991` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:52.014651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58841884-cd0b-44ff-9ba0-450ccace8e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb96450a1f17486a98b413a72879c991)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:52.020736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58841884-cd0b-44ff-9ba0-450ccace8e89 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:52.179944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-58841884-cd0b-44ff-9ba0-450ccace8e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb96450a1f17486a98b413a72879c991'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:52.207724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-58841884-cd0b-44ff-9ba0-450ccace8e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb96450a1f17486a98b413a72879c991'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:52.208696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-58841884-cd0b-44ff-9ba0-450ccace8e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb96450a1f17486a98b413a72879c991'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:52.249494 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-58841884-cd0b-44ff-9ba0-450ccace8e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb96450a1f17486a98b413a72879c991'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:52.264757 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-58841884-cd0b-44ff-9ba0-450ccace8e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb96450a1f17486a98b413a72879c991'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:52.279410 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 842/1654] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:17:51 2022] DELETE /identity/v3/users/bb96450a1f17486a98b413a72879c991 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:52.281029 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb36b34-9408-4afe-b86d-87cc30d3ca29 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:52.282114 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb36b34-9408-4afe-b86d-87cc30d3ca29 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:52.282591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb36b34-9408-4afe-b86d-87cc30d3ca29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:52.343870 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-dfb36b34-9408-4afe-b86d-87cc30d3ca29 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:52.345362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dfb36b34-9408-4afe-b86d-87cc30d3ca29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:52.521400 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 813/1655] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:52.567804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58841884-cd0b-44ff-9ba0-450ccace8e89 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:52.572765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-58841884-cd0b-44ff-9ba0-450ccace8e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:52.775428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232aea1-dd51-4961-846e-9b81346a8ab8 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:52.775643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232aea1-dd51-4961-846e-9b81346a8ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:52.776005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232aea1-dd51-4961-846e-9b81346a8ab8 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:52.777494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 814/1656] 10.222.0.99 () {54 vars in 921 bytes} [Mon Jul 18 14:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:17:52.794791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7cbd6-3d5b-4ce4-961c-b44a0fa6d13e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:52.795097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7cbd6-3d5b-4ce4-961c-b44a0fa6d13e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:52.795504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7cbd6-3d5b-4ce4-961c-b44a0fa6d13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:52.815887 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:52.827121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58841884-cd0b-44ff-9ba0-450ccace8e89 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:52.836707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c114a-88ba-4d6e-a01e-bf7238c41aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:52.837550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c114a-88ba-4d6e-a01e-bf7238c41aec service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:52.837900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c114a-88ba-4d6e-a01e-bf7238c41aec service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:52.838315 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c114a-88ba-4d6e-a01e-bf7238c41aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:52.847491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1dc7cbd6-3d5b-4ce4-961c-b44a0fa6d13e None None] MFA Rules not processed for user `92b73e1a514148b19bb6a1d2a39e32cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:52.848771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1dc7cbd6-3d5b-4ce4-961c-b44a0fa6d13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:52.867947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c114a-88ba-4d6e-a01e-bf7238c41aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:52.873231 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c114a-88ba-4d6e-a01e-bf7238c41aec service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:52.907691 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 843/1657] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:52.984675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 815/1658] 10.222.0.99 () {58 vars in 1018 bytes} [Mon Jul 18 14:17:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:17:53.020576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183681b-bbd7-4afa-a224-514ed57a2fc0 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:53.020865 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183681b-bbd7-4afa-a224-514ed57a2fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:53.021147 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183681b-bbd7-4afa-a224-514ed57a2fc0 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:53.022679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 844/1659] 10.222.0.99 () {54 vars in 961 bytes} [Mon Jul 18 14:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:17:53.030334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abb31a-9157-47fe-88b2-75950d78d6f7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:53.030793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abb31a-9157-47fe-88b2-75950d78d6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:53.031029 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abb31a-9157-47fe-88b2-75950d78d6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:53.054690 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:53.111850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-09abb31a-9157-47fe-88b2-75950d78d6f7 None None] MFA Rules not processed for user `92b73e1a514148b19bb6a1d2a39e32cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:53.113093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-09abb31a-9157-47fe-88b2-75950d78d6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:53.150403 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 816/1660] 10.222.0.99 () {58 vars in 1058 bytes} [Mon Jul 18 14:17:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:53.158509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183681b-bbd7-4afa-a224-514ed57a2fc0 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:53.222004 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183681b-bbd7-4afa-a224-514ed57a2fc0 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:53.233808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469aa2c-fe3b-4880-a0b8-b93ab6f10a19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92b73e1a514148b19bb6a1d2a39e32cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:53.236006 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469aa2c-fe3b-4880-a0b8-b93ab6f10a19 service placement] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:53.236543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469aa2c-fe3b-4880-a0b8-b93ab6f10a19 service placement] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:53.237027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469aa2c-fe3b-4880-a0b8-b93ab6f10a19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:53.251286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469aa2c-fe3b-4880-a0b8-b93ab6f10a19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:53.253131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469aa2c-fe3b-4880-a0b8-b93ab6f10a19 service placement] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:53.274944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 845/1661] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:53.636524 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abb31a-9157-47fe-88b2-75950d78d6f7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:53.637973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-09abb31a-9157-47fe-88b2-75950d78d6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:53.653991 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abb31a-9157-47fe-88b2-75950d78d6f7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:53.663228 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde49ae-5779-4f56-8173-74aef17e92ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:53.664844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde49ae-5779-4f56-8173-74aef17e92ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:53.665271 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde49ae-5779-4f56-8173-74aef17e92ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:53.665833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde49ae-5779-4f56-8173-74aef17e92ea admin admin] PATH_INFO: `/v3/users/c24af3f2cbf247f79bfe03523582bce4` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:53.669126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde49ae-5779-4f56-8173-74aef17e92ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24af3f2cbf247f79bfe03523582bce4)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:53.670429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: WARNING py.warnings [None req-9dde49ae-5779-4f56-8173-74aef17e92ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:17:53.670429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: warnings.warn(msg) Jul 18 14:17:53.670429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: Jul 18 14:17:53.675171 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde49ae-5779-4f56-8173-74aef17e92ea admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:53.827534 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9dde49ae-5779-4f56-8173-74aef17e92ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24af3f2cbf247f79bfe03523582bce4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:53.843713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9dde49ae-5779-4f56-8173-74aef17e92ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24af3f2cbf247f79bfe03523582bce4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:53.844698 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9dde49ae-5779-4f56-8173-74aef17e92ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24af3f2cbf247f79bfe03523582bce4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:53.888312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9dde49ae-5779-4f56-8173-74aef17e92ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24af3f2cbf247f79bfe03523582bce4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:53.920672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9dde49ae-5779-4f56-8173-74aef17e92ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24af3f2cbf247f79bfe03523582bce4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:53.935513 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 817/1662] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:17:53 2022] DELETE /identity/v3/users/c24af3f2cbf247f79bfe03523582bce4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:53.941832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee3cbe-9a05-4ea5-be29-5189be3e13a6 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:53.942835 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee3cbe-9a05-4ea5-be29-5189be3e13a6 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:53.943827 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee3cbe-9a05-4ea5-be29-5189be3e13a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:54.032849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-8fee3cbe-9a05-4ea5-be29-5189be3e13a6 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:54.035687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8fee3cbe-9a05-4ea5-be29-5189be3e13a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:54.177087 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 846/1663] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:17:54.233368 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde49ae-5779-4f56-8173-74aef17e92ea admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:54.235750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9dde49ae-5779-4f56-8173-74aef17e92ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:54.368936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde49ae-5779-4f56-8173-74aef17e92ea admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:54.375850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd4ad0-4876-45ce-9f27-0aa5e69ff18a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:54.376848 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd4ad0-4876-45ce-9f27-0aa5e69ff18a service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:54.377272 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd4ad0-4876-45ce-9f27-0aa5e69ff18a service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:54.377678 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd4ad0-4876-45ce-9f27-0aa5e69ff18a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:54.391800 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd4ad0-4876-45ce-9f27-0aa5e69ff18a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:54.395531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd4ad0-4876-45ce-9f27-0aa5e69ff18a service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:54.420054 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 818/1664] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:54.621345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee3cbe-9a05-4ea5-be29-5189be3e13a6 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:54.628818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8fee3cbe-9a05-4ea5-be29-5189be3e13a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:54.652409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee3cbe-9a05-4ea5-be29-5189be3e13a6 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:54.667736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c6a73-2dc2-414a-9c6c-107fbacb0a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:54.668839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c6a73-2dc2-414a-9c6c-107fbacb0a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:54.669842 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c6a73-2dc2-414a-9c6c-107fbacb0a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:54.670279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c6a73-2dc2-414a-9c6c-107fbacb0a9e admin admin] PATH_INFO: `/v3/users/309284b7310e4a9381a9e9d2d2673ec5` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:54.671960 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c6a73-2dc2-414a-9c6c-107fbacb0a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=309284b7310e4a9381a9e9d2d2673ec5)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:54.674199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c6a73-2dc2-414a-9c6c-107fbacb0a9e admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:54.774330 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-d78c6a73-2dc2-414a-9c6c-107fbacb0a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '309284b7310e4a9381a9e9d2d2673ec5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:54.796856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-d78c6a73-2dc2-414a-9c6c-107fbacb0a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '309284b7310e4a9381a9e9d2d2673ec5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:54.797798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-d78c6a73-2dc2-414a-9c6c-107fbacb0a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '309284b7310e4a9381a9e9d2d2673ec5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:54.821874 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-d78c6a73-2dc2-414a-9c6c-107fbacb0a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '309284b7310e4a9381a9e9d2d2673ec5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:54.842976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-d78c6a73-2dc2-414a-9c6c-107fbacb0a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '309284b7310e4a9381a9e9d2d2673ec5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:54.856588 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 847/1665] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:17:54 2022] DELETE /identity/v3/users/309284b7310e4a9381a9e9d2d2673ec5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:55.311711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8684909-c1f4-4520-8927-143171b11d50 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:55.312208 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8684909-c1f4-4520-8927-143171b11d50 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:55.312669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8684909-c1f4-4520-8927-143171b11d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:55.370043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a8684909-c1f4-4520-8927-143171b11d50 None None] MFA Rules not processed for user `c8a38997f7094d019157ab969487da12`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:55.370043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a8684909-c1f4-4520-8927-143171b11d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:55.523375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 819/1666] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:55.532616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51439-0e0e-4f51-945b-f59638880876 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:55.533117 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51439-0e0e-4f51-945b-f59638880876 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:55.533200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d51439-0e0e-4f51-945b-f59638880876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:55.565727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-14d51439-0e0e-4f51-945b-f59638880876 None None] MFA Rules not processed for user `c8a38997f7094d019157ab969487da12`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:55.568548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-14d51439-0e0e-4f51-945b-f59638880876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:55.590555 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 848/1667] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:55.604394 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8684909-c1f4-4520-8927-143171b11d50 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:55.605741 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a8684909-c1f4-4520-8927-143171b11d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:55.620659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:55.644046 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d51439-0e0e-4f51-945b-f59638880876 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:55.645575 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-14d51439-0e0e-4f51-945b-f59638880876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:55.827968 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:55.877622 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d51439-0e0e-4f51-945b-f59638880876 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:55.893773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:55.896169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:55.896456 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:55.896777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516 admin admin] PATH_INFO: `/v3/projects/49a23e94c5854818b9c28fe45e01b886` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:55.899178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49a23e94c5854818b9c28fe45e01b886)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:55.900778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: WARNING py.warnings [None req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:17:55.900778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: warnings.warn(msg) Jul 18 14:17:55.900778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: Jul 18 14:17:55.904521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8684909-c1f4-4520-8927-143171b11d50 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:55.905906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:55.922354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af3d9a-e417-4adb-a977-59a274ec2cc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:55.923119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af3d9a-e417-4adb-a977-59a274ec2cc5 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:55.923409 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af3d9a-e417-4adb-a977-59a274ec2cc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:55.923681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af3d9a-e417-4adb-a977-59a274ec2cc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:55.940625 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af3d9a-e417-4adb-a977-59a274ec2cc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:55.950215 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af3d9a-e417-4adb-a977-59a274ec2cc5 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:55.969368 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 820/1668] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:17:56.080832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49a23e94c5854818b9c28fe45e01b886', 'request_id': 'req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:56.104965 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49a23e94c5854818b9c28fe45e01b886', 'request_id': 'req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:56.162963 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49a23e94c5854818b9c28fe45e01b886', 'request_id': 'req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:56.210482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516 admin admin] The token cache is being invalidate because project 49a23e94c5854818b9c28fe45e01b886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:17:56.211223 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:56.213972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:56.220955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 849/1669] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:17:55 2022] DELETE /identity/v3/projects/49a23e94c5854818b9c28fe45e01b886 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:17:56.228196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aa631-42e9-42d5-b783-0f28dd70e763 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:56.228489 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aa631-42e9-42d5-b783-0f28dd70e763 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:56.228775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aa631-42e9-42d5-b783-0f28dd70e763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:56.268726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-037aa631-42e9-42d5-b783-0f28dd70e763 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:56.270012 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-037aa631-42e9-42d5-b783-0f28dd70e763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:56.384786 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:56.386703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:56.430382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 821/1670] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:56.432008 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674158-5ed6-4a69-bdcc-b0df5361d2c2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:56.432330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674158-5ed6-4a69-bdcc-b0df5361d2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:56.432626 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674158-5ed6-4a69-bdcc-b0df5361d2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:56.485482 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-85674158-5ed6-4a69-bdcc-b0df5361d2c2 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:56.486809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-85674158-5ed6-4a69-bdcc-b0df5361d2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:56.504665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 822/1671] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:56.509484 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85674158-5ed6-4a69-bdcc-b0df5361d2c2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:56.531350 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e2126-1f20-4fb1-bbc1-08dbc8ef2516 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:56.536167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85674158-5ed6-4a69-bdcc-b0df5361d2c2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:56.546472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d8dc5-f190-49ac-a162-2696c59340ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:56.547699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d8dc5-f190-49ac-a162-2696c59340ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:56.548212 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d8dc5-f190-49ac-a162-2696c59340ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:56.548323 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d8dc5-f190-49ac-a162-2696c59340ce admin admin] PATH_INFO: `/v3/projects/bd29857661d648b0aabab2537e07ddfc` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:56.550677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d8dc5-f190-49ac-a162-2696c59340ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd29857661d648b0aabab2537e07ddfc)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:56.553003 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d8dc5-f190-49ac-a162-2696c59340ce admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:56.553802 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b06ba8-55c4-4865-821b-f47432ea6814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:56.555027 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b06ba8-55c4-4865-821b-f47432ea6814 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:56.555638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b06ba8-55c4-4865-821b-f47432ea6814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:56.556935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b06ba8-55c4-4865-821b-f47432ea6814 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:56.558502 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b06ba8-55c4-4865-821b-f47432ea6814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:17:56.562427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b06ba8-55c4-4865-821b-f47432ea6814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:56.571031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b06ba8-55c4-4865-821b-f47432ea6814 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:56.606563 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 823/1672] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:17:56.607485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b06ba8-55c4-4865-821b-f47432ea6814 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:56.615669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b7b06ba8-55c4-4865-821b-f47432ea6814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:56.655355 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b06ba8-55c4-4865-821b-f47432ea6814 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:56.668859 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de123fae-7284-430c-af24-604a2359da33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:56.669824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de123fae-7284-430c-af24-604a2359da33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:56.671153 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de123fae-7284-430c-af24-604a2359da33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:56.671153 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de123fae-7284-430c-af24-604a2359da33 admin admin] PATH_INFO: `/v3/projects/1ea5fdc68dcb47d8853e08663614946a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:56.672694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de123fae-7284-430c-af24-604a2359da33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea5fdc68dcb47d8853e08663614946a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:56.682247 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de123fae-7284-430c-af24-604a2359da33 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:56.721404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c11d8dc5-f190-49ac-a162-2696c59340ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd29857661d648b0aabab2537e07ddfc', 'request_id': 'req-c11d8dc5-f190-49ac-a162-2696c59340ce'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:56.741265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c11d8dc5-f190-49ac-a162-2696c59340ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd29857661d648b0aabab2537e07ddfc', 'request_id': 'req-c11d8dc5-f190-49ac-a162-2696c59340ce'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:56.757114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c11d8dc5-f190-49ac-a162-2696c59340ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd29857661d648b0aabab2537e07ddfc', 'request_id': 'req-c11d8dc5-f190-49ac-a162-2696c59340ce'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:56.787576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c11d8dc5-f190-49ac-a162-2696c59340ce admin admin] The token cache is being invalidate because project bd29857661d648b0aabab2537e07ddfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:17:56.787884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c11d8dc5-f190-49ac-a162-2696c59340ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:56.789513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c11d8dc5-f190-49ac-a162-2696c59340ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:56.793043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 850/1673] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:17:56 2022] DELETE /identity/v3/projects/bd29857661d648b0aabab2537e07ddfc => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:17:56.794365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d8dc5-f190-49ac-a162-2696c59340ce admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:56.799552 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-de123fae-7284-430c-af24-604a2359da33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea5fdc68dcb47d8853e08663614946a', 'request_id': 'req-de123fae-7284-430c-af24-604a2359da33'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:56.800476 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c11d8dc5-f190-49ac-a162-2696c59340ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:56.817348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-de123fae-7284-430c-af24-604a2359da33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea5fdc68dcb47d8853e08663614946a', 'request_id': 'req-de123fae-7284-430c-af24-604a2359da33'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:56.819812 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:56.836076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-de123fae-7284-430c-af24-604a2359da33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea5fdc68dcb47d8853e08663614946a', 'request_id': 'req-de123fae-7284-430c-af24-604a2359da33'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:56.838093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:56.865166 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-de123fae-7284-430c-af24-604a2359da33 admin admin] The token cache is being invalidate because project 1ea5fdc68dcb47d8853e08663614946a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:17:56.865466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-de123fae-7284-430c-af24-604a2359da33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:56.866750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-de123fae-7284-430c-af24-604a2359da33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:56.870981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 824/1674] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:17:56 2022] DELETE /identity/v3/projects/1ea5fdc68dcb47d8853e08663614946a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:56.872537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de123fae-7284-430c-af24-604a2359da33 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:56.877091 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-de123fae-7284-430c-af24-604a2359da33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:56.998556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d8dc5-f190-49ac-a162-2696c59340ce admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:57.125797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de123fae-7284-430c-af24-604a2359da33 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:57.150293 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7bfd7-5fe9-415f-b535-65afa1507de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:57.151054 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7bfd7-5fe9-415f-b535-65afa1507de3 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:57.151343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7bfd7-5fe9-415f-b535-65afa1507de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:57.151608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7bfd7-5fe9-415f-b535-65afa1507de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:57.152363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7bfd7-5fe9-415f-b535-65afa1507de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:57.153824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392da3c-40a1-4a92-b617-c8321a3d9a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:57.154289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7bfd7-5fe9-415f-b535-65afa1507de3 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:57.156020 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392da3c-40a1-4a92-b617-c8321a3d9a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:57.156321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392da3c-40a1-4a92-b617-c8321a3d9a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:57.156607 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392da3c-40a1-4a92-b617-c8321a3d9a4a admin admin] PATH_INFO: `/v3/users/2bc13c2b20464142a1c5ee0558d9e719` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:57.163360 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392da3c-40a1-4a92-b617-c8321a3d9a4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc13c2b20464142a1c5ee0558d9e719)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:57.173814 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392da3c-40a1-4a92-b617-c8321a3d9a4a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:57.226879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 851/1675] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:17:56 2022] POST /identity/v3/projects => generated 363 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:57.231248 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7bfd7-5fe9-415f-b535-65afa1507de3 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:57.233124 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d1e7bfd7-5fe9-415f-b535-65afa1507de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:57.339565 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4392da3c-40a1-4a92-b617-c8321a3d9a4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc13c2b20464142a1c5ee0558d9e719'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:57.368026 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4392da3c-40a1-4a92-b617-c8321a3d9a4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc13c2b20464142a1c5ee0558d9e719'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:57.369843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4392da3c-40a1-4a92-b617-c8321a3d9a4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc13c2b20464142a1c5ee0558d9e719'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:57.400817 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4392da3c-40a1-4a92-b617-c8321a3d9a4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc13c2b20464142a1c5ee0558d9e719'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:57.426453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4392da3c-40a1-4a92-b617-c8321a3d9a4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc13c2b20464142a1c5ee0558d9e719'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:57.440341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 825/1676] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:17:56 2022] DELETE /identity/v3/users/2bc13c2b20464142a1c5ee0558d9e719 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:57.450119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392da3c-40a1-4a92-b617-c8321a3d9a4a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:57.468750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4392da3c-40a1-4a92-b617-c8321a3d9a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:57.530718 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7bfd7-5fe9-415f-b535-65afa1507de3 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:57.640017 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:57.687576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392da3c-40a1-4a92-b617-c8321a3d9a4a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:57.711758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60099e-de2f-4c18-ae6b-eaca97a1fed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:57.712409 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60099e-de2f-4c18-ae6b-eaca97a1fed9 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:57.712687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60099e-de2f-4c18-ae6b-eaca97a1fed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:57.712975 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60099e-de2f-4c18-ae6b-eaca97a1fed9 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:57.713877 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60099e-de2f-4c18-ae6b-eaca97a1fed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:57.723744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f7528-1953-473d-b060-8f933ca8cef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:57.727290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60099e-de2f-4c18-ae6b-eaca97a1fed9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:57.728719 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f7528-1953-473d-b060-8f933ca8cef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:57.730950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f7528-1953-473d-b060-8f933ca8cef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:57.733441 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f7528-1953-473d-b060-8f933ca8cef5 admin admin] PATH_INFO: `/v3/users/87e104452b2f425ea63ca3862371f363` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:57.738881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f7528-1953-473d-b060-8f933ca8cef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e104452b2f425ea63ca3862371f363)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:57.744753 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f7528-1953-473d-b060-8f933ca8cef5 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:57.786683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:INSERT=5,keystone:DELETE=11,keystone:SELECT=84 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:57.807737 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 826/1677] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:17:57 2022] POST /identity/v3/users => generated 282 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:57.810232 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed29251-2c48-4a95-aca9-d43ca92aed7c None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:57.810560 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed29251-2c48-4a95-aca9-d43ca92aed7c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:57.813825 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed29251-2c48-4a95-aca9-d43ca92aed7c None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:57.817880 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 827/1678] 10.222.0.99 () {54 vars in 912 bytes} [Mon Jul 18 14:17:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:17:57.818475 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed29251-2c48-4a95-aca9-d43ca92aed7c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:57.851945 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed29251-2c48-4a95-aca9-d43ca92aed7c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:57.889152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afdda8-e458-435a-b8f8-87973dcbd87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:57.891097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afdda8-e458-435a-b8f8-87973dcbd87b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:57.894284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afdda8-e458-435a-b8f8-87973dcbd87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:57.896314 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afdda8-e458-435a-b8f8-87973dcbd87b admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:57.901869 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3e6f7528-1953-473d-b060-8f933ca8cef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e104452b2f425ea63ca3862371f363'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:57.916857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afdda8-e458-435a-b8f8-87973dcbd87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:57.921878 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3e6f7528-1953-473d-b060-8f933ca8cef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e104452b2f425ea63ca3862371f363'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:57.922696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3e6f7528-1953-473d-b060-8f933ca8cef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e104452b2f425ea63ca3862371f363'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:57.928449 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afdda8-e458-435a-b8f8-87973dcbd87b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:57.949114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3e6f7528-1953-473d-b060-8f933ca8cef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e104452b2f425ea63ca3862371f363'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:57.972783 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3e6f7528-1953-473d-b060-8f933ca8cef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e104452b2f425ea63ca3862371f363'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:57.993999 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 852/1679] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:17:57 2022] DELETE /identity/v3/users/87e104452b2f425ea63ca3862371f363 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:57.997579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353153d-a088-4c36-8c88-d4cedbf53b35 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:57.997579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353153d-a088-4c36-8c88-d4cedbf53b35 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:57.997579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353153d-a088-4c36-8c88-d4cedbf53b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:58.003427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 828/1680] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:58.017165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afdda8-e458-435a-b8f8-87973dcbd87b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:58.020581 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-70afdda8-e458-435a-b8f8-87973dcbd87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:58.059726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afdda8-e458-435a-b8f8-87973dcbd87b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:58.127591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-1353153d-a088-4c36-8c88-d4cedbf53b35 None None] MFA Rules not processed for user `abc51e98d0054609b6ce10723f70bf49`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:58.133778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1353153d-a088-4c36-8c88-d4cedbf53b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:58.265768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70023bad-d730-4f66-9517-1688f4834fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:58.266496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70023bad-d730-4f66-9517-1688f4834fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:58.266788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70023bad-d730-4f66-9517-1688f4834fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:58.267067 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70023bad-d730-4f66-9517-1688f4834fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:58.267832 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70023bad-d730-4f66-9517-1688f4834fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:58.269552 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70023bad-d730-4f66-9517-1688f4834fe7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:58.285058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 829/1681] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:58.286159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70023bad-d730-4f66-9517-1688f4834fe7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:58.317304 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70023bad-d730-4f66-9517-1688f4834fe7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:58.323295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50b4a3-df7b-42b3-95bd-bebafdd84d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:58.324465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50b4a3-df7b-42b3-95bd-bebafdd84d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:58.324911 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50b4a3-df7b-42b3-95bd-bebafdd84d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:58.325332 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50b4a3-df7b-42b3-95bd-bebafdd84d73 admin admin] PATH_INFO: `/v3/projects/3f9f3a029c804489bd28484e3423c47a/users/3a390155c2374b08888415473c4d654e/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:58.330841 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 853/1682] 10.222.0.99 () {58 vars in 1009 bytes} [Mon Jul 18 14:17:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:58.346066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50b4a3-df7b-42b3-95bd-bebafdd84d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9f3a029c804489bd28484e3423c47a, user_id=3a390155c2374b08888415473c4d654e, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:58.349274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50b4a3-df7b-42b3-95bd-bebafdd84d73 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:58.387273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 830/1683] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:58 2022] PUT /identity/v3/projects/3f9f3a029c804489bd28484e3423c47a/users/3a390155c2374b08888415473c4d654e/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:58.389134 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f058168-f507-4325-8b72-9e727126c053 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:58.389496 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f058168-f507-4325-8b72-9e727126c053 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:58.389838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f058168-f507-4325-8b72-9e727126c053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:58.410657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50b4a3-df7b-42b3-95bd-bebafdd84d73 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:58.412783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bd50b4a3-df7b-42b3-95bd-bebafdd84d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:58.458871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-4f058168-f507-4325-8b72-9e727126c053 None None] MFA Rules not processed for user `3a390155c2374b08888415473c4d654e`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:58.461342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-4f058168-f507-4325-8b72-9e727126c053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:58.582267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50b4a3-df7b-42b3-95bd-bebafdd84d73 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:58.592559 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75840ae-bc2d-4aab-90be-afcfced38d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:58.593428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75840ae-bc2d-4aab-90be-afcfced38d55 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:58.593762 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75840ae-bc2d-4aab-90be-afcfced38d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:58.593980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75840ae-bc2d-4aab-90be-afcfced38d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:58.613895 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:58.639077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75840ae-bc2d-4aab-90be-afcfced38d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:58.644803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 854/1684] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:58 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:58.645880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f058168-f507-4325-8b72-9e727126c053 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:58.647633 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75840ae-bc2d-4aab-90be-afcfced38d55 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:58.682786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 831/1685] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:17:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:17:58.789933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f058168-f507-4325-8b72-9e727126c053 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:58.795752 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90913059-4db0-489a-9618-5b656a801761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:58.796834 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90913059-4db0-489a-9618-5b656a801761 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:58.797328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90913059-4db0-489a-9618-5b656a801761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:58.798052 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90913059-4db0-489a-9618-5b656a801761 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:58.799045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90913059-4db0-489a-9618-5b656a801761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:58.801947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90913059-4db0-489a-9618-5b656a801761 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:58.874741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 855/1686] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:17:58 2022] POST /identity/v3/projects => generated 363 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:58.879413 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75840ae-bc2d-4aab-90be-afcfced38d55 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:58.895611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75840ae-bc2d-4aab-90be-afcfced38d55 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:59.033607 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9abe87-c69e-41c7-bd78-f0acace0c1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:59.034329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9abe87-c69e-41c7-bd78-f0acace0c1df admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:59.034638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9abe87-c69e-41c7-bd78-f0acace0c1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:59.034909 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9abe87-c69e-41c7-bd78-f0acace0c1df admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:59.035642 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9abe87-c69e-41c7-bd78-f0acace0c1df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:59.041821 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9abe87-c69e-41c7-bd78-f0acace0c1df admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:59.074887 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:59.102661 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 832/1687] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:17:58 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:17:59.103731 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90913059-4db0-489a-9618-5b656a801761 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:59.126948 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90913059-4db0-489a-9618-5b656a801761 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:59.152986 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e36980-bb1e-4951-8303-14ea4551e792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:59.153883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e36980-bb1e-4951-8303-14ea4551e792 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:59.154166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e36980-bb1e-4951-8303-14ea4551e792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:59.154645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e36980-bb1e-4951-8303-14ea4551e792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:59.155389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e36980-bb1e-4951-8303-14ea4551e792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:59.157103 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e36980-bb1e-4951-8303-14ea4551e792 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:59.184311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 856/1688] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:17:59.189667 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9abe87-c69e-41c7-bd78-f0acace0c1df admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:59.205514 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9abe87-c69e-41c7-bd78-f0acace0c1df admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:59.219356 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e36980-bb1e-4951-8303-14ea4551e792 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:59.222139 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-69e36980-bb1e-4951-8303-14ea4551e792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:59.225766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139f4c4-39c5-475b-850e-154db08fa19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:59.226750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f4c4-39c5-475b-850e-154db08fa19a admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:59.227031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f4c4-39c5-475b-850e-154db08fa19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:59.227682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f4c4-39c5-475b-850e-154db08fa19a admin admin] PATH_INFO: `/v3/projects/fa5343b66057450f91ea21b3b8bd5ee0/users/63b4bf591fe444c98addaf473b95ba9c/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:59.260493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e36980-bb1e-4951-8303-14ea4551e792 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:59.269429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a34152-ed7a-4230-85ac-932a758a51ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:59.270352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a34152-ed7a-4230-85ac-932a758a51ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:59.270653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a34152-ed7a-4230-85ac-932a758a51ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:59.270923 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a34152-ed7a-4230-85ac-932a758a51ed admin admin] PATH_INFO: `/v3/projects/8f7152613ffd4c2682a6ea4caced0dd1` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:59.285316 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a34152-ed7a-4230-85ac-932a758a51ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7152613ffd4c2682a6ea4caced0dd1)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:59.288219 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a34152-ed7a-4230-85ac-932a758a51ed admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:59.290599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139f4c4-39c5-475b-850e-154db08fa19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5343b66057450f91ea21b3b8bd5ee0, user_id=63b4bf591fe444c98addaf473b95ba9c, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:59.293512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139f4c4-39c5-475b-850e-154db08fa19a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:59.333544 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 833/1689] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:59 2022] PUT /identity/v3/projects/fa5343b66057450f91ea21b3b8bd5ee0/users/63b4bf591fe444c98addaf473b95ba9c/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:59.338116 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139f4c4-39c5-475b-850e-154db08fa19a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:59.435442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c1a34152-ed7a-4230-85ac-932a758a51ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7152613ffd4c2682a6ea4caced0dd1', 'request_id': 'req-c1a34152-ed7a-4230-85ac-932a758a51ed'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:59.451388 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c1a34152-ed7a-4230-85ac-932a758a51ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7152613ffd4c2682a6ea4caced0dd1', 'request_id': 'req-c1a34152-ed7a-4230-85ac-932a758a51ed'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:59.459032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c1a34152-ed7a-4230-85ac-932a758a51ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7152613ffd4c2682a6ea4caced0dd1', 'request_id': 'req-c1a34152-ed7a-4230-85ac-932a758a51ed'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:59.491879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c1a34152-ed7a-4230-85ac-932a758a51ed admin admin] The token cache is being invalidate because project 8f7152613ffd4c2682a6ea4caced0dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:17:59.492170 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c1a34152-ed7a-4230-85ac-932a758a51ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:59.496115 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c1a34152-ed7a-4230-85ac-932a758a51ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:17:59.498588 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 857/1690] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:17:59 2022] DELETE /identity/v3/projects/8f7152613ffd4c2682a6ea4caced0dd1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:17:59.503551 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c5ba2-505e-4955-8ca8-f3c53d35025e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:59.503845 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c5ba2-505e-4955-8ca8-f3c53d35025e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:59.504128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c5ba2-505e-4955-8ca8-f3c53d35025e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:59.543592 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-721c5ba2-505e-4955-8ca8-f3c53d35025e None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:59.545370 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-721c5ba2-505e-4955-8ca8-f3c53d35025e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:59.573520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139f4c4-39c5-475b-850e-154db08fa19a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:59.646528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:59.700009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 858/1691] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:59.702694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dcaab-b2d2-46fe-8073-0d5a6a8a562d None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:59.702694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dcaab-b2d2-46fe-8073-0d5a6a8a562d None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:59.702694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dcaab-b2d2-46fe-8073-0d5a6a8a562d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:59.729741 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbabbf-c74f-4c52-9330-de4e3f04a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:59.732896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbabbf-c74f-4c52-9330-de4e3f04a2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:59.733610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbabbf-c74f-4c52-9330-de4e3f04a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:59.733922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbabbf-c74f-4c52-9330-de4e3f04a2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:59.734937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbabbf-c74f-4c52-9330-de4e3f04a2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:59.740896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbabbf-c74f-4c52-9330-de4e3f04a2f8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:59.742580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-ce8dcaab-b2d2-46fe-8073-0d5a6a8a562d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:59.743845 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ce8dcaab-b2d2-46fe-8073-0d5a6a8a562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:59.767242 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 859/1692] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:17:59.768591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 834/1693] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:17:59.771929 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dcaab-b2d2-46fe-8073-0d5a6a8a562d None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:59.773087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbabbf-c74f-4c52-9330-de4e3f04a2f8 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:59.776294 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2bbbabbf-c74f-4c52-9330-de4e3f04a2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:17:59.791977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dcaab-b2d2-46fe-8073-0d5a6a8a562d None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:59.801419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbabbf-c74f-4c52-9330-de4e3f04a2f8 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:59.806761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9e6dc-17ea-4aac-8e11-5150d9ab29cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:59.807714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9e6dc-17ea-4aac-8e11-5150d9ab29cd admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:59.808135 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9e6dc-17ea-4aac-8e11-5150d9ab29cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:59.808609 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9e6dc-17ea-4aac-8e11-5150d9ab29cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:59.809353 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9e6dc-17ea-4aac-8e11-5150d9ab29cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:17:59.809674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9e6dc-17ea-4aac-8e11-5150d9ab29cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:59.811490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9e6dc-17ea-4aac-8e11-5150d9ab29cd admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:59.813716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cef579-e52e-4c11-839c-a96bd0a0c21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:17:59.816143 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cef579-e52e-4c11-839c-a96bd0a0c21a admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:59.817497 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cef579-e52e-4c11-839c-a96bd0a0c21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:59.818888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cef579-e52e-4c11-839c-a96bd0a0c21a admin admin] PATH_INFO: `/v3/projects/fa5343b66057450f91ea21b3b8bd5ee0/users/63b4bf591fe444c98addaf473b95ba9c/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:59.843888 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 860/1694] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:17:59.844263 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cef579-e52e-4c11-839c-a96bd0a0c21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5343b66057450f91ea21b3b8bd5ee0, user_id=63b4bf591fe444c98addaf473b95ba9c, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:17:59.845679 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9e6dc-17ea-4aac-8e11-5150d9ab29cd admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:17:59.850255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cef579-e52e-4c11-839c-a96bd0a0c21a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:17:59.875530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9e6dc-17ea-4aac-8e11-5150d9ab29cd admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:17:59.894786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 835/1695] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:17:59 2022] PUT /identity/v3/projects/fa5343b66057450f91ea21b3b8bd5ee0/users/63b4bf591fe444c98addaf473b95ba9c/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:17:59.907290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cdaf7-ff7b-4303-ba76-b9610982f6dd None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:17:59.907290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cdaf7-ff7b-4303-ba76-b9610982f6dd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:17:59.907290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cdaf7-ff7b-4303-ba76-b9610982f6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:17:59.993781 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-954cdaf7-ff7b-4303-ba76-b9610982f6dd None None] MFA Rules not processed for user `a19eb1f3c9e74f3c92755186a7a44ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:17:59.997574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-954cdaf7-ff7b-4303-ba76-b9610982f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:00.086032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96f58a-cdba-47d2-ac74-e355e0bfc147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:00.086927 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96f58a-cdba-47d2-ac74-e355e0bfc147 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:00.087482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96f58a-cdba-47d2-ac74-e355e0bfc147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:00.087855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96f58a-cdba-47d2-ac74-e355e0bfc147 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:00.088771 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96f58a-cdba-47d2-ac74-e355e0bfc147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:00.094777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96f58a-cdba-47d2-ac74-e355e0bfc147 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:00.157339 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:00.196853 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 836/1696] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:17:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:00.198539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ac971-d4cc-4c1a-acba-96ed2fd9352d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:00.198993 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ac971-d4cc-4c1a-acba-96ed2fd9352d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:00.199370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ac971-d4cc-4c1a-acba-96ed2fd9352d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:00.264075 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2f1ac971-d4cc-4c1a-acba-96ed2fd9352d None None] MFA Rules not processed for user `63b4bf591fe444c98addaf473b95ba9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:00.265664 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2f1ac971-d4cc-4c1a-acba-96ed2fd9352d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:00.272608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 861/1697] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:17:59 2022] POST /identity/v3/projects => generated 365 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:00.277289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96f58a-cdba-47d2-ac74-e355e0bfc147 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:00.306857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9e96f58a-cdba-47d2-ac74-e355e0bfc147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:00.489104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 837/1698] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:00 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:00.489104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ac971-d4cc-4c1a-acba-96ed2fd9352d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:00.494695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2f1ac971-d4cc-4c1a-acba-96ed2fd9352d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:00.563203 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96f58a-cdba-47d2-ac74-e355e0bfc147 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:00.598489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5384650-d0f5-4d51-83c9-82bcc69cd292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:00.599754 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5384650-d0f5-4d51-83c9-82bcc69cd292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:00.600040 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5384650-d0f5-4d51-83c9-82bcc69cd292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:00.600336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5384650-d0f5-4d51-83c9-82bcc69cd292 admin admin] PATH_INFO: `/v3/projects/c66a9abb33b042dbbbd4035f71fed90f` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:00.610509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5384650-d0f5-4d51-83c9-82bcc69cd292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c66a9abb33b042dbbbd4035f71fed90f)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:00.614983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5384650-d0f5-4d51-83c9-82bcc69cd292 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:00.731584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ac971-d4cc-4c1a-acba-96ed2fd9352d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:00.750152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-b5384650-d0f5-4d51-83c9-82bcc69cd292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c66a9abb33b042dbbbd4035f71fed90f', 'request_id': 'req-b5384650-d0f5-4d51-83c9-82bcc69cd292'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:00.754944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:00.764956 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-b5384650-d0f5-4d51-83c9-82bcc69cd292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c66a9abb33b042dbbbd4035f71fed90f', 'request_id': 'req-b5384650-d0f5-4d51-83c9-82bcc69cd292'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:00.779506 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-b5384650-d0f5-4d51-83c9-82bcc69cd292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c66a9abb33b042dbbbd4035f71fed90f', 'request_id': 'req-b5384650-d0f5-4d51-83c9-82bcc69cd292'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:00.813115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc646c-420f-4f95-86bf-5aab24926494 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92b73e1a514148b19bb6a1d2a39e32cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:00.814358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc646c-420f-4f95-86bf-5aab24926494 service placement] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:00.814358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc646c-420f-4f95-86bf-5aab24926494 service placement] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:00.814358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc646c-420f-4f95-86bf-5aab24926494 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:00.816468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d6bc646c-420f-4f95-86bf-5aab24926494 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:00.826858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-b5384650-d0f5-4d51-83c9-82bcc69cd292 admin admin] The token cache is being invalidate because project c66a9abb33b042dbbbd4035f71fed90f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:00.829503 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc646c-420f-4f95-86bf-5aab24926494 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:00.829751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-b5384650-d0f5-4d51-83c9-82bcc69cd292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:00.830867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-b5384650-d0f5-4d51-83c9-82bcc69cd292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:00.831813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc646c-420f-4f95-86bf-5aab24926494 service placement] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:00.833880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 862/1699] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:00 2022] DELETE /identity/v3/projects/c66a9abb33b042dbbbd4035f71fed90f => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:00.834994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5384650-d0f5-4d51-83c9-82bcc69cd292 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:00.839503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b5384650-d0f5-4d51-83c9-82bcc69cd292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:00.846546 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 838/1700] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:00.847554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc646c-420f-4f95-86bf-5aab24926494 service placement] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:00.858238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:00.957519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc646c-420f-4f95-86bf-5aab24926494 service placement] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:00.964312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097acacf-a436-4ba8-95fb-e58191ea1f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:00.965367 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097acacf-a436-4ba8-95fb-e58191ea1f60 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:00.965747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097acacf-a436-4ba8-95fb-e58191ea1f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:00.966124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097acacf-a436-4ba8-95fb-e58191ea1f60 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:00.968915 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097acacf-a436-4ba8-95fb-e58191ea1f60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:00.971236 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097acacf-a436-4ba8-95fb-e58191ea1f60 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:00.999572 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5384650-d0f5-4d51-83c9-82bcc69cd292 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:01.012379 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 839/1701] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:00 2022] POST /identity/v3/users => generated 283 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:01.015313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e365aa-c3c1-4426-960f-8485d24deb43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:01.016403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e365aa-c3c1-4426-960f-8485d24deb43 service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:01.016694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e365aa-c3c1-4426-960f-8485d24deb43 service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:01.016979 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e365aa-c3c1-4426-960f-8485d24deb43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:01.018018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b250cb1-1e1b-4f34-85a9-ca0def630acc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:01.018423 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b250cb1-1e1b-4f34-85a9-ca0def630acc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:01.018903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b250cb1-1e1b-4f34-85a9-ca0def630acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:01.023187 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c6e365aa-c3c1-4426-960f-8485d24deb43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:01.055773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1b250cb1-1e1b-4f34-85a9-ca0def630acc None None] MFA Rules not processed for user `c8a38997f7094d019157ab969487da12`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:01.058549 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1b250cb1-1e1b-4f34-85a9-ca0def630acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:01.162107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e365aa-c3c1-4426-960f-8485d24deb43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:01.163893 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e365aa-c3c1-4426-960f-8485d24deb43 service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:01.168466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 840/1702] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:01.170093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b250cb1-1e1b-4f34-85a9-ca0def630acc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:01.175469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1b250cb1-1e1b-4f34-85a9-ca0def630acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:01.204893 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 863/1703] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:01.218031 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366ea21-8179-40b9-8951-f183f3fec894 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:01.231474 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366ea21-8179-40b9-8951-f183f3fec894 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:01.231857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366ea21-8179-40b9-8951-f183f3fec894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:01.350418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-a366ea21-8179-40b9-8951-f183f3fec894 None None] MFA Rules not processed for user `896e2214f4794e90a5f0416e016d0dde`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:01.351688 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a366ea21-8179-40b9-8951-f183f3fec894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:01.400075 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b250cb1-1e1b-4f34-85a9-ca0def630acc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:01.452760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db91b7f-e2e7-4d95-8a39-cb8079def4e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:01.453481 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db91b7f-e2e7-4d95-8a39-cb8079def4e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:01.453799 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db91b7f-e2e7-4d95-8a39-cb8079def4e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:01.454059 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db91b7f-e2e7-4d95-8a39-cb8079def4e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:01.463380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9db91b7f-e2e7-4d95-8a39-cb8079def4e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:01.564561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 864/1704] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:01.566084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c50a-edc6-416a-bc19-115abe3cd252 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:01.566379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c50a-edc6-416a-bc19-115abe3cd252 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:01.566709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155c50a-edc6-416a-bc19-115abe3cd252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:01.607525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-8155c50a-edc6-416a-bc19-115abe3cd252 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:01.611725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8155c50a-edc6-416a-bc19-115abe3cd252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:01.632922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 865/1705] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:01.634154 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155c50a-edc6-416a-bc19-115abe3cd252 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:01.635775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8155c50a-edc6-416a-bc19-115abe3cd252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:01.650639 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:01.661712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155c50a-edc6-416a-bc19-115abe3cd252 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:01.678653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54e57f-33aa-4b38-a096-7ee78aa6a184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:01.680941 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54e57f-33aa-4b38-a096-7ee78aa6a184 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:01.683361 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54e57f-33aa-4b38-a096-7ee78aa6a184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:01.683681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54e57f-33aa-4b38-a096-7ee78aa6a184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:01.687749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54e57f-33aa-4b38-a096-7ee78aa6a184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:01.697408 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:01.698122 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54e57f-33aa-4b38-a096-7ee78aa6a184 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:01.734811 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 866/1706] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:01.736716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54e57f-33aa-4b38-a096-7ee78aa6a184 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:01.743589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db91b7f-e2e7-4d95-8a39-cb8079def4e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:01.749066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db91b7f-e2e7-4d95-8a39-cb8079def4e7 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:01.787522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54e57f-33aa-4b38-a096-7ee78aa6a184 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:01.790246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 841/1707] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:01 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:01.793098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ce7b9-2a62-40b3-844f-477ab98998c7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:01.794619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ce7b9-2a62-40b3-844f-477ab98998c7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:01.795109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ce7b9-2a62-40b3-844f-477ab98998c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:01.820821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f296e2-ef9f-4676-a4b8-53b7bff4da50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:01.825965 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f296e2-ef9f-4676-a4b8-53b7bff4da50 service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:01.827011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f296e2-ef9f-4676-a4b8-53b7bff4da50 service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:01.827458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f296e2-ef9f-4676-a4b8-53b7bff4da50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:01.852788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d79ce7b9-2a62-40b3-844f-477ab98998c7 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:01.854529 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d79ce7b9-2a62-40b3-844f-477ab98998c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:01.862044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f296e2-ef9f-4676-a4b8-53b7bff4da50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:01.865955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f296e2-ef9f-4676-a4b8-53b7bff4da50 service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:01.880926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 842/1708] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:01.881939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ce7b9-2a62-40b3-844f-477ab98998c7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:01.908170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ce7b9-2a62-40b3-844f-477ab98998c7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:01.924260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85940298-b32a-469d-b9e4-635d15f10519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:01.925126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85940298-b32a-469d-b9e4-635d15f10519 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:01.926160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85940298-b32a-469d-b9e4-635d15f10519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:01.926697 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85940298-b32a-469d-b9e4-635d15f10519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:01.928304 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85940298-b32a-469d-b9e4-635d15f10519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:01.938186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 867/1709] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:01.945508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85940298-b32a-469d-b9e4-635d15f10519 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:01.951846 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f296e2-ef9f-4676-a4b8-53b7bff4da50 service nova] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:01.991991 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 843/1710] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:01.997311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85940298-b32a-469d-b9e4-635d15f10519 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:02.035844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f296e2-ef9f-4676-a4b8-53b7bff4da50 service nova] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:02.040373 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85940298-b32a-469d-b9e4-635d15f10519 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:02.059831 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e04bdf-79da-45bc-a4c1-871c2ee1b644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:02.062235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e04bdf-79da-45bc-a4c1-871c2ee1b644 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:02.066900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e04bdf-79da-45bc-a4c1-871c2ee1b644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:02.067640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e04bdf-79da-45bc-a4c1-871c2ee1b644 admin admin] PATH_INFO: `/v3/projects/7f659e9f3f504ba1a54bc5bbf23fbc5d/users/be6bec974d4642c18ddcf8f0a9d92946/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:02.074768 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8371f-52ed-4a1d-94fd-2bed1e892fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:02.080101 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8371f-52ed-4a1d-94fd-2bed1e892fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:02.082126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8371f-52ed-4a1d-94fd-2bed1e892fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:02.084231 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8371f-52ed-4a1d-94fd-2bed1e892fcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:02.087214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8371f-52ed-4a1d-94fd-2bed1e892fcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:02.089220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8371f-52ed-4a1d-94fd-2bed1e892fcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:02.097277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf8371f-52ed-4a1d-94fd-2bed1e892fcf admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:02.143662 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 868/1711] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:02.144475 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e04bdf-79da-45bc-a4c1-871c2ee1b644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f659e9f3f504ba1a54bc5bbf23fbc5d, user_id=be6bec974d4642c18ddcf8f0a9d92946, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:02.146075 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8371f-52ed-4a1d-94fd-2bed1e892fcf admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:02.147392 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e04bdf-79da-45bc-a4c1-871c2ee1b644 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:02.173627 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8371f-52ed-4a1d-94fd-2bed1e892fcf admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:02.185282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 844/1712] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:01 2022] PUT /identity/v3/projects/7f659e9f3f504ba1a54bc5bbf23fbc5d/users/be6bec974d4642c18ddcf8f0a9d92946/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:02.186187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e04bdf-79da-45bc-a4c1-871c2ee1b644 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:02.318661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9637c3-e363-4e4d-b6ee-3b715a38f790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:02.319367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9637c3-e363-4e4d-b6ee-3b715a38f790 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:02.321474 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9637c3-e363-4e4d-b6ee-3b715a38f790 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:02.321716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9637c3-e363-4e4d-b6ee-3b715a38f790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:02.325984 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9c9637c3-e363-4e4d-b6ee-3b715a38f790 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:02.362081 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e04bdf-79da-45bc-a4c1-871c2ee1b644 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:02.373178 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b175c1-28a6-417f-b02c-f3b4960012a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:02.374104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b175c1-28a6-417f-b02c-f3b4960012a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:02.374463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b175c1-28a6-417f-b02c-f3b4960012a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:02.374785 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b175c1-28a6-417f-b02c-f3b4960012a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:02.376900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b175c1-28a6-417f-b02c-f3b4960012a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:02.385109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b175c1-28a6-417f-b02c-f3b4960012a6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:02.460216 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 845/1713] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:02 2022] POST /identity/v3/projects => generated 367 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:02.461628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e61a-ac29-4494-8a0a-cabbd7001e6f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:02.462015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e61a-ac29-4494-8a0a-cabbd7001e6f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:02.463888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e61a-ac29-4494-8a0a-cabbd7001e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:02.495040 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9637c3-e363-4e4d-b6ee-3b715a38f790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:02.500141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9637c3-e363-4e4d-b6ee-3b715a38f790 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:02.521311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 869/1714] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:02.524192 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abf61b-65b3-4522-8d60-17393c88fb07 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:02.524716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abf61b-65b3-4522-8d60-17393c88fb07 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:02.524999 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abf61b-65b3-4522-8d60-17393c88fb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:02.527351 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-70a6e61a-ac29-4494-8a0a-cabbd7001e6f None None] MFA Rules not processed for user `be6bec974d4642c18ddcf8f0a9d92946`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:02.529246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-70a6e61a-ac29-4494-8a0a-cabbd7001e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:02.591044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-04abf61b-65b3-4522-8d60-17393c88fb07 None None] MFA Rules not processed for user `c205c6af37ca4cbb88cd35e7229a9776`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:02.606756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-04abf61b-65b3-4522-8d60-17393c88fb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:02.746541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 846/1715] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:02.747516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6e61a-ac29-4494-8a0a-cabbd7001e6f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:02.862844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:02.874653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 870/1716] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:02.875855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abf61b-65b3-4522-8d60-17393c88fb07 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:02.915139 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:02.993261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6e61a-ac29-4494-8a0a-cabbd7001e6f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:03.022244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d14906-bd04-4a63-a096-34a17b174894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:03.023555 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d14906-bd04-4a63-a096-34a17b174894 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:03.023844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d14906-bd04-4a63-a096-34a17b174894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:03.030605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d14906-bd04-4a63-a096-34a17b174894 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:03.035674 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d14906-bd04-4a63-a096-34a17b174894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:03.052689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d14906-bd04-4a63-a096-34a17b174894 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:03.085659 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abf61b-65b3-4522-8d60-17393c88fb07 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:03.100979 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10ae45-2c78-4336-b197-9cf9e1a7e00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:03.101689 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10ae45-2c78-4336-b197-9cf9e1a7e00e admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:03.101974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10ae45-2c78-4336-b197-9cf9e1a7e00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:03.102247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10ae45-2c78-4336-b197-9cf9e1a7e00e admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:03.102990 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10ae45-2c78-4336-b197-9cf9e1a7e00e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:03.112464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10ae45-2c78-4336-b197-9cf9e1a7e00e admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:03.141137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 847/1717] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:02 2022] POST /identity/v3/users => generated 284 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:03.146486 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9a498-4890-47b1-b001-2e275d3e671e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:03.148570 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9a498-4890-47b1-b001-2e275d3e671e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:03.148866 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9a498-4890-47b1-b001-2e275d3e671e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:03.209896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 871/1718] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:02 2022] POST /identity/v3/projects => generated 365 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:03.211329 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10ae45-2c78-4336-b197-9cf9e1a7e00e admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:03.242083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7ef9a498-4890-47b1-b001-2e275d3e671e None None] MFA Rules not processed for user `c205c6af37ca4cbb88cd35e7229a9776`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:03.245703 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7ef9a498-4890-47b1-b001-2e275d3e671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:03.347756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10ae45-2c78-4336-b197-9cf9e1a7e00e admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:03.353265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23610197-43c6-4a93-9f34-0338fa8be99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:03.354433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610197-43c6-4a93-9f34-0338fa8be99d admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:03.354871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610197-43c6-4a93-9f34-0338fa8be99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:03.355317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23610197-43c6-4a93-9f34-0338fa8be99d admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:03.357177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23610197-43c6-4a93-9f34-0338fa8be99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:03.359589 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23610197-43c6-4a93-9f34-0338fa8be99d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:03.374572 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 872/1719] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:03.375952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23610197-43c6-4a93-9f34-0338fa8be99d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:03.415505 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23610197-43c6-4a93-9f34-0338fa8be99d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:03.433028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 848/1720] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:03.434474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfefe0a-f39e-4e0f-a0e8-f85ea357599a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:03.434773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfefe0a-f39e-4e0f-a0e8-f85ea357599a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:03.435054 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfefe0a-f39e-4e0f-a0e8-f85ea357599a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:03.443165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 849/1721] 10.222.0.99 () {54 vars in 912 bytes} [Mon Jul 18 14:18:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:18:03.446869 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfefe0a-f39e-4e0f-a0e8-f85ea357599a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:03.455425 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87366eab-08ac-46b7-bc54-a045cd89e819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:03.457583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87366eab-08ac-46b7-bc54-a045cd89e819 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:03.460486 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87366eab-08ac-46b7-bc54-a045cd89e819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:03.460924 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87366eab-08ac-46b7-bc54-a045cd89e819 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:03.461810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87366eab-08ac-46b7-bc54-a045cd89e819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:03.469564 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87366eab-08ac-46b7-bc54-a045cd89e819 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:03.484729 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfefe0a-f39e-4e0f-a0e8-f85ea357599a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:03.491533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099f3b9-5288-4367-bd0a-6c3b122bae8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:03.492395 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099f3b9-5288-4367-bd0a-6c3b122bae8e admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:03.492712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099f3b9-5288-4367-bd0a-6c3b122bae8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:03.493134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099f3b9-5288-4367-bd0a-6c3b122bae8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:03.494051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099f3b9-5288-4367-bd0a-6c3b122bae8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:03.498161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099f3b9-5288-4367-bd0a-6c3b122bae8e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:03.516718 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 873/1722] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:03 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:03.518947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a09756-84b5-4b70-82c9-049e7f164475 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:03.519756 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 850/1723] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:03.520272 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a09756-84b5-4b70-82c9-049e7f164475 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:03.521162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099f3b9-5288-4367-bd0a-6c3b122bae8e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:03.521666 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a09756-84b5-4b70-82c9-049e7f164475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:03.573598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-c2a09756-84b5-4b70-82c9-049e7f164475 None None] MFA Rules not processed for user `abc51e98d0054609b6ce10723f70bf49`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:03.578858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c2a09756-84b5-4b70-82c9-049e7f164475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:03.691971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099f3b9-5288-4367-bd0a-6c3b122bae8e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:03.715376 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e6302-ce2b-44c2-8068-607c306439e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:03.716082 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e6302-ce2b-44c2-8068-607c306439e3 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:03.716379 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e6302-ce2b-44c2-8068-607c306439e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:03.716664 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e6302-ce2b-44c2-8068-607c306439e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:03.732446 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 874/1724] 10.222.0.99 () {58 vars in 1009 bytes} [Mon Jul 18 14:18:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:03.734585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a09756-84b5-4b70-82c9-049e7f164475 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:03.752912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e6302-ce2b-44c2-8068-607c306439e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:03.754591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e6302-ce2b-44c2-8068-607c306439e3 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:03.772174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a09756-84b5-4b70-82c9-049e7f164475 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:03.779519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 851/1725] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:03.787954 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f6b8b-5338-479b-bcc8-b128e7c836bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:03.789115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e6302-ce2b-44c2-8068-607c306439e3 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:03.790289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f6b8b-5338-479b-bcc8-b128e7c836bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:03.791813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f6b8b-5338-479b-bcc8-b128e7c836bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:03.792394 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f6b8b-5338-479b-bcc8-b128e7c836bc admin admin] PATH_INFO: `/v3/projects/5e10daf9e81344dc9d7bf78374c231b4/users/e96c6b4e892644ab80385be19acf5635/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:03.842370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e6302-ce2b-44c2-8068-607c306439e3 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:03.847890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f6b8b-5338-479b-bcc8-b128e7c836bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e10daf9e81344dc9d7bf78374c231b4, user_id=e96c6b4e892644ab80385be19acf5635, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:03.853648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f6b8b-5338-479b-bcc8-b128e7c836bc admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:03.863767 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fbdcd-9e07-4937-b0b5-c2f14ac95273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:03.864060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fbdcd-9e07-4937-b0b5-c2f14ac95273 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:03.864252 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fbdcd-9e07-4937-b0b5-c2f14ac95273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:03.864542 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fbdcd-9e07-4937-b0b5-c2f14ac95273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:03.865295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fbdcd-9e07-4937-b0b5-c2f14ac95273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:03.867140 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fbdcd-9e07-4937-b0b5-c2f14ac95273 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:03.891359 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 852/1726] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:03.892160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fbdcd-9e07-4937-b0b5-c2f14ac95273 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:03.898864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:03.900958 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c77fbdcd-9e07-4937-b0b5-c2f14ac95273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:03.938269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fbdcd-9e07-4937-b0b5-c2f14ac95273 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:03.940246 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 875/1727] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:03 2022] PUT /identity/v3/projects/5e10daf9e81344dc9d7bf78374c231b4/users/e96c6b4e892644ab80385be19acf5635/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:03.941332 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f6b8b-5338-479b-bcc8-b128e7c836bc admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:04.018211 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:04.071076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f6b8b-5338-479b-bcc8-b128e7c836bc admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:04.076537 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6f427-4f63-4623-981d-f9c06153b941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:04.077728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6f427-4f63-4623-981d-f9c06153b941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:04.077844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6f427-4f63-4623-981d-f9c06153b941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:04.078130 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c6f427-4f63-4623-981d-f9c06153b941 admin admin] PATH_INFO: `/v3/projects/bc51e0927ead494c93be49b1a6ae3590/users/5fe61ad4b6ce4a36bb6afbe198949323/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:04.128623 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8d794-0015-48c6-8dbb-ceba7f0cc7ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:04.129321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8d794-0015-48c6-8dbb-ceba7f0cc7ac service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:04.129609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8d794-0015-48c6-8dbb-ceba7f0cc7ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:04.129895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8d794-0015-48c6-8dbb-ceba7f0cc7ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:04.147200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8d794-0015-48c6-8dbb-ceba7f0cc7ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:04.148690 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8d794-0015-48c6-8dbb-ceba7f0cc7ac service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:04.152332 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6f427-4f63-4623-981d-f9c06153b941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc51e0927ead494c93be49b1a6ae3590, user_id=5fe61ad4b6ce4a36bb6afbe198949323, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:04.155754 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c6f427-4f63-4623-981d-f9c06153b941 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:04.188218 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 853/1728] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:04.188639 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 876/1729] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:03 2022] PUT /identity/v3/projects/bc51e0927ead494c93be49b1a6ae3590/users/5fe61ad4b6ce4a36bb6afbe198949323/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:04.191148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cee60-8e6d-4d4a-84a7-f53cf9932814 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:04.191441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cee60-8e6d-4d4a-84a7-f53cf9932814 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:04.191726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cee60-8e6d-4d4a-84a7-f53cf9932814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:04.192985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6f427-4f63-4623-981d-f9c06153b941 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:04.259385 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-252cee60-8e6d-4d4a-84a7-f53cf9932814 None None] MFA Rules not processed for user `e96c6b4e892644ab80385be19acf5635`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:04.260641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-252cee60-8e6d-4d4a-84a7-f53cf9932814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:04.380867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c6f427-4f63-4623-981d-f9c06153b941 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:04.399516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e25c3-f597-4e8c-8ca9-d45005fa57f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:04.400436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e25c3-f597-4e8c-8ca9-d45005fa57f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:04.400866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e25c3-f597-4e8c-8ca9-d45005fa57f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:04.401839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e25c3-f597-4e8c-8ca9-d45005fa57f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:04.403067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e25c3-f597-4e8c-8ca9-d45005fa57f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:04.410012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e25c3-f597-4e8c-8ca9-d45005fa57f0 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:04.450660 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 877/1730] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:04.452017 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e25c3-f597-4e8c-8ca9-d45005fa57f0 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:04.468081 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 854/1731] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:04.472854 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252cee60-8e6d-4d4a-84a7-f53cf9932814 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:04.485711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e25c3-f597-4e8c-8ca9-d45005fa57f0 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:04.502879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81dac7c-8794-4dfe-855d-ea624fd2d189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:04.504439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dac7c-8794-4dfe-855d-ea624fd2d189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:04.504734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dac7c-8794-4dfe-855d-ea624fd2d189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:04.505020 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81dac7c-8794-4dfe-855d-ea624fd2d189 admin admin] PATH_INFO: `/v3/projects/bc51e0927ead494c93be49b1a6ae3590/users/5fe61ad4b6ce4a36bb6afbe198949323/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:04.510425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252cee60-8e6d-4d4a-84a7-f53cf9932814 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:04.510590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81dac7c-8794-4dfe-855d-ea624fd2d189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc51e0927ead494c93be49b1a6ae3590, user_id=5fe61ad4b6ce4a36bb6afbe198949323, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:04.523255 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81dac7c-8794-4dfe-855d-ea624fd2d189 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:04.524282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a5e83-5d0e-40a6-8e73-f799b546cb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:04.525214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a5e83-5d0e-40a6-8e73-f799b546cb6e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:04.525689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a5e83-5d0e-40a6-8e73-f799b546cb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:04.526605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a5e83-5d0e-40a6-8e73-f799b546cb6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:04.528394 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a5e83-5d0e-40a6-8e73-f799b546cb6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:04.535045 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a5e83-5d0e-40a6-8e73-f799b546cb6e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:04.573653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 878/1732] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:04 2022] PUT /identity/v3/projects/bc51e0927ead494c93be49b1a6ae3590/users/5fe61ad4b6ce4a36bb6afbe198949323/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:04.575524 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65859a-abae-4bbe-9372-4b2e1f9cd9f6 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:04.575754 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65859a-abae-4bbe-9372-4b2e1f9cd9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:04.576223 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65859a-abae-4bbe-9372-4b2e1f9cd9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:04.614299 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 855/1733] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:04 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:04.615483 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a5e83-5d0e-40a6-8e73-f799b546cb6e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:04.669151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-0c65859a-abae-4bbe-9372-4b2e1f9cd9f6 None None] MFA Rules not processed for user `5fe61ad4b6ce4a36bb6afbe198949323`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:04.673840 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-0c65859a-abae-4bbe-9372-4b2e1f9cd9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:04.898221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:04.906919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a5e83-5d0e-40a6-8e73-f799b546cb6e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:04.920867 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9fec7-0d2f-4710-8965-589c38b99cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:04.924265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9fec7-0d2f-4710-8965-589c38b99cfd admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:04.924731 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9fec7-0d2f-4710-8965-589c38b99cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:04.926179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9fec7-0d2f-4710-8965-589c38b99cfd admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:04.929066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9fec7-0d2f-4710-8965-589c38b99cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:04.935909 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9fec7-0d2f-4710-8965-589c38b99cfd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:04.947169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 879/1734] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:04.991141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 856/1735] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:04 2022] POST /identity/v3/users => generated 291 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:04.992354 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65859a-abae-4bbe-9372-4b2e1f9cd9f6 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:05.016264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65859a-abae-4bbe-9372-4b2e1f9cd9f6 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:05.034752 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3f6a2-dddb-46f7-a57f-f022a9d19f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:05.035704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3f6a2-dddb-46f7-a57f-f022a9d19f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:05.036465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3f6a2-dddb-46f7-a57f-f022a9d19f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:05.037423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3f6a2-dddb-46f7-a57f-f022a9d19f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:05.040008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3f6a2-dddb-46f7-a57f-f022a9d19f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:05.045472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3f6a2-dddb-46f7-a57f-f022a9d19f24 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:05.075973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9fec7-0d2f-4710-8965-589c38b99cfd admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:05.088010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 880/1736] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:05.096185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3f6a2-dddb-46f7-a57f-f022a9d19f24 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:05.152443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3f6a2-dddb-46f7-a57f-f022a9d19f24 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:05.163635 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:05.164037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf52225-37cb-4777-bb49-678334fbf890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:05.166730 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf52225-37cb-4777-bb49-678334fbf890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:05.167249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf52225-37cb-4777-bb49-678334fbf890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:05.168313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf52225-37cb-4777-bb49-678334fbf890 admin admin] PATH_INFO: `/v3/projects/52769612b5634c7bb208484f40a08df1/users/266c3ee708ac43809a5a5aeb25480141/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:05.213211 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf52225-37cb-4777-bb49-678334fbf890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52769612b5634c7bb208484f40a08df1, user_id=266c3ee708ac43809a5a5aeb25480141, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:05.220646 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf52225-37cb-4777-bb49-678334fbf890 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:05.265383 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9fec7-0d2f-4710-8965-589c38b99cfd admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:05.274883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 881/1737] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:05 2022] PUT /identity/v3/projects/52769612b5634c7bb208484f40a08df1/users/266c3ee708ac43809a5a5aeb25480141/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:05.276867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf52225-37cb-4777-bb49-678334fbf890 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:05.354677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd10ee-0166-4b99-8f85-f8568b8204e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:05.355406 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd10ee-0166-4b99-8f85-f8568b8204e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:05.355702 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd10ee-0166-4b99-8f85-f8568b8204e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:05.356942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd10ee-0166-4b99-8f85-f8568b8204e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:05.453982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf52225-37cb-4777-bb49-678334fbf890 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:05.477310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64d0fa-4e95-4d7f-a44d-d0fed53dd069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:05.478169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64d0fa-4e95-4d7f-a44d-d0fed53dd069 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:05.478494 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64d0fa-4e95-4d7f-a44d-d0fed53dd069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:05.478775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64d0fa-4e95-4d7f-a44d-d0fed53dd069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:05.479546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64d0fa-4e95-4d7f-a44d-d0fed53dd069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:05.481233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64d0fa-4e95-4d7f-a44d-d0fed53dd069 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:05.503017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd10ee-0166-4b99-8f85-f8568b8204e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:05.504534 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd10ee-0166-4b99-8f85-f8568b8204e6 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:05.520383 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 882/1738] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:05.522121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d871e-f0a4-41ad-b29d-07686041cfb6 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:05.522570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d871e-f0a4-41ad-b29d-07686041cfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:05.524751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d871e-f0a4-41ad-b29d-07686041cfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:05.529017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 857/1739] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:05.530163 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd10ee-0166-4b99-8f85-f8568b8204e6 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:05.557715 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd10ee-0166-4b99-8f85-f8568b8204e6 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:05.577327 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44ecb0-71fa-4a32-bcca-8f1919cecd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:05.579607 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44ecb0-71fa-4a32-bcca-8f1919cecd6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:05.580296 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44ecb0-71fa-4a32-bcca-8f1919cecd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:05.583546 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44ecb0-71fa-4a32-bcca-8f1919cecd6e admin admin] PATH_INFO: `/v3/projects/52769612b5634c7bb208484f40a08df1/users/266c3ee708ac43809a5a5aeb25480141/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:05.587287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44ecb0-71fa-4a32-bcca-8f1919cecd6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=52769612b5634c7bb208484f40a08df1, user_id=266c3ee708ac43809a5a5aeb25480141, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:05.605862 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44ecb0-71fa-4a32-bcca-8f1919cecd6e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:05.656462 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 858/1740] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:05 2022] PUT /identity/v3/projects/52769612b5634c7bb208484f40a08df1/users/266c3ee708ac43809a5a5aeb25480141/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:05.673637 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dbd1d-b902-423b-8feb-13241c06120a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:05.674066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dbd1d-b902-423b-8feb-13241c06120a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:05.674368 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dbd1d-b902-423b-8feb-13241c06120a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:05.682322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-2c5d871e-f0a4-41ad-b29d-07686041cfb6 None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:05.687750 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2c5d871e-f0a4-41ad-b29d-07686041cfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:05.746837 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-da9dbd1d-b902-423b-8feb-13241c06120a None None] MFA Rules not processed for user `266c3ee708ac43809a5a5aeb25480141`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:05.754513 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-da9dbd1d-b902-423b-8feb-13241c06120a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:05.871892 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 883/1741] 10.222.0.99 () {58 vars in 1009 bytes} [Mon Jul 18 14:18:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:05.873166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d871e-f0a4-41ad-b29d-07686041cfb6 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:05.958142 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:05.969502 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:06.003065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 859/1742] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:06.014170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dbd1d-b902-423b-8feb-13241c06120a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:06.015841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-da9dbd1d-b902-423b-8feb-13241c06120a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:06.064399 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d871e-f0a4-41ad-b29d-07686041cfb6 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:06.074342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92219afa-0489-4564-903d-87e1b48bfeee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:06.075082 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92219afa-0489-4564-903d-87e1b48bfeee service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:06.075363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92219afa-0489-4564-903d-87e1b48bfeee service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:06.075645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92219afa-0489-4564-903d-87e1b48bfeee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:06.172786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dbd1d-b902-423b-8feb-13241c06120a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:06.191206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a88f55-7d0a-4d12-b265-2ce15a8754ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:06.192179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a88f55-7d0a-4d12-b265-2ce15a8754ae service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:06.192458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a88f55-7d0a-4d12-b265-2ce15a8754ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:06.192829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a88f55-7d0a-4d12-b265-2ce15a8754ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:06.221681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92219afa-0489-4564-903d-87e1b48bfeee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:06.222504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a88f55-7d0a-4d12-b265-2ce15a8754ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:06.223810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92219afa-0489-4564-903d-87e1b48bfeee service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:06.224049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a88f55-7d0a-4d12-b265-2ce15a8754ae service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:06.243262 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 884/1743] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:06.244215 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92219afa-0489-4564-903d-87e1b48bfeee service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:06.248356 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-92219afa-0489-4564-903d-87e1b48bfeee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:06.256239 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 860/1744] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:06 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:06.508993 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92219afa-0489-4564-903d-87e1b48bfeee service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:06.550311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2f306-9bd3-4abf-b3bf-a883930bf976 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:06.551730 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2f306-9bd3-4abf-b3bf-a883930bf976 service swift] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:06.552373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2f306-9bd3-4abf-b3bf-a883930bf976 service swift] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:06.553387 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2f306-9bd3-4abf-b3bf-a883930bf976 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:06.593259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2f306-9bd3-4abf-b3bf-a883930bf976 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:06.598252 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2f306-9bd3-4abf-b3bf-a883930bf976 service swift] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:06.645631 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 885/1745] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:18:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:18:06.974455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a88f55-7d0a-4d12-b265-2ce15a8754ae service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:06.976352 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b7a88f55-7d0a-4d12-b265-2ce15a8754ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:07.186583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a88f55-7d0a-4d12-b265-2ce15a8754ae service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:07.200778 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda38c6-44d3-4ab0-bf46-30de283e1032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:07.204096 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda38c6-44d3-4ab0-bf46-30de283e1032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:07.204521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda38c6-44d3-4ab0-bf46-30de283e1032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:07.204896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda38c6-44d3-4ab0-bf46-30de283e1032 admin admin] PATH_INFO: `/v3/users/3a390155c2374b08888415473c4d654e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:07.214524 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda38c6-44d3-4ab0-bf46-30de283e1032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a390155c2374b08888415473c4d654e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:07.228087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda38c6-44d3-4ab0-bf46-30de283e1032 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:07.335975 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fdda38c6-44d3-4ab0-bf46-30de283e1032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a390155c2374b08888415473c4d654e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:07.350175 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fdda38c6-44d3-4ab0-bf46-30de283e1032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a390155c2374b08888415473c4d654e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:07.351248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fdda38c6-44d3-4ab0-bf46-30de283e1032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a390155c2374b08888415473c4d654e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:07.394052 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fdda38c6-44d3-4ab0-bf46-30de283e1032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a390155c2374b08888415473c4d654e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:07.418065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fdda38c6-44d3-4ab0-bf46-30de283e1032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a390155c2374b08888415473c4d654e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:07.453613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 861/1746] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:06 2022] DELETE /identity/v3/users/3a390155c2374b08888415473c4d654e => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:07.455626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7eff4-fdd2-43e6-ae36-40f68e351e83 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:07.456077 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7eff4-fdd2-43e6-ae36-40f68e351e83 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:07.456294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7eff4-fdd2-43e6-ae36-40f68e351e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:07.561573 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-8da7eff4-fdd2-43e6-ae36-40f68e351e83 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:07.564211 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8da7eff4-fdd2-43e6-ae36-40f68e351e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:07.713985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:07.780223 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 886/1747] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:08.593134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda38c6-44d3-4ab0-bf46-30de283e1032 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:08.594994 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fdda38c6-44d3-4ab0-bf46-30de283e1032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:08.718014 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:08.912404 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda38c6-44d3-4ab0-bf46-30de283e1032 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:08.939837 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f0533-40ff-4f19-bb36-b94beeb01af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:08.940521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f0533-40ff-4f19-bb36-b94beeb01af7 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:08.940808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f0533-40ff-4f19-bb36-b94beeb01af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:08.941085 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f0533-40ff-4f19-bb36-b94beeb01af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:08.989951 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f0533-40ff-4f19-bb36-b94beeb01af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:08.993583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f0533-40ff-4f19-bb36-b94beeb01af7 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:09.050085 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 862/1748] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:09.923176 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a41da3-9101-4069-bbcd-81eb0eb7b34a None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:09.923971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a41da3-9101-4069-bbcd-81eb0eb7b34a None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:09.924262 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a41da3-9101-4069-bbcd-81eb0eb7b34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:09.976312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-b2a41da3-9101-4069-bbcd-81eb0eb7b34a None None] MFA Rules not processed for user `a19eb1f3c9e74f3c92755186a7a44ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:09.978233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b2a41da3-9101-4069-bbcd-81eb0eb7b34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:10.294687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 887/1749] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:10.986335 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890ab77-915c-4c15-853a-5b5614c97552 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:10.986963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890ab77-915c-4c15-853a-5b5614c97552 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:10.987113 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890ab77-915c-4c15-853a-5b5614c97552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:11.047444 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d890ab77-915c-4c15-853a-5b5614c97552 None None] MFA Rules not processed for user `896e2214f4794e90a5f0416e016d0dde`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:11.056700 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d890ab77-915c-4c15-853a-5b5614c97552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:11.273737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1c991-a3fa-4a65-998f-a00676f87fb1 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:11.274364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1c991-a3fa-4a65-998f-a00676f87fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:11.274364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1c991-a3fa-4a65-998f-a00676f87fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:11.274798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 863/1750] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:11.343579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-6ac1c991-a3fa-4a65-998f-a00676f87fb1 None None] MFA Rules not processed for user `abc51e98d0054609b6ce10723f70bf49`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:11.360148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6ac1c991-a3fa-4a65-998f-a00676f87fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:11.395257 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 888/1751] 10.222.0.102 () {58 vars in 1016 bytes} [Mon Jul 18 14:18:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:11.454723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890ab77-915c-4c15-853a-5b5614c97552 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:11.487713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890ab77-915c-4c15-853a-5b5614c97552 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:11.555224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1c991-a3fa-4a65-998f-a00676f87fb1 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:11.555843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10c5cd-c7cb-4a7e-b724-f9076c4f8b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:11.556914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6ac1c991-a3fa-4a65-998f-a00676f87fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:11.558577 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10c5cd-c7cb-4a7e-b724-f9076c4f8b10 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:11.559426 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10c5cd-c7cb-4a7e-b724-f9076c4f8b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:11.561452 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10c5cd-c7cb-4a7e-b724-f9076c4f8b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:11.579546 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10c5cd-c7cb-4a7e-b724-f9076c4f8b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:11.581016 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10c5cd-c7cb-4a7e-b724-f9076c4f8b10 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:11.592042 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1c991-a3fa-4a65-998f-a00676f87fb1 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:11.608976 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 864/1752] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:11.620647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e260788-6f44-4c3d-bc86-4b314b3fbe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:11.621583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e260788-6f44-4c3d-bc86-4b314b3fbe04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:11.621862 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e260788-6f44-4c3d-bc86-4b314b3fbe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:11.622137 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e260788-6f44-4c3d-bc86-4b314b3fbe04 admin admin] PATH_INFO: `/v3/projects/3f9f3a029c804489bd28484e3423c47a` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:11.624598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e260788-6f44-4c3d-bc86-4b314b3fbe04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f9f3a029c804489bd28484e3423c47a)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:11.632983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e260788-6f44-4c3d-bc86-4b314b3fbe04 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:11.779622 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7e260788-6f44-4c3d-bc86-4b314b3fbe04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9f3a029c804489bd28484e3423c47a', 'request_id': 'req-7e260788-6f44-4c3d-bc86-4b314b3fbe04'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:11.795707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7e260788-6f44-4c3d-bc86-4b314b3fbe04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9f3a029c804489bd28484e3423c47a', 'request_id': 'req-7e260788-6f44-4c3d-bc86-4b314b3fbe04'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:11.813161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7e260788-6f44-4c3d-bc86-4b314b3fbe04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9f3a029c804489bd28484e3423c47a', 'request_id': 'req-7e260788-6f44-4c3d-bc86-4b314b3fbe04'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:11.842868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7e260788-6f44-4c3d-bc86-4b314b3fbe04 admin admin] The token cache is being invalidate because project 3f9f3a029c804489bd28484e3423c47a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:11.843170 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7e260788-6f44-4c3d-bc86-4b314b3fbe04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:11.845422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7e260788-6f44-4c3d-bc86-4b314b3fbe04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:11.850190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 889/1753] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:11 2022] DELETE /identity/v3/projects/3f9f3a029c804489bd28484e3423c47a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:11.854777 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10c5cd-c7cb-4a7e-b724-f9076c4f8b10 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:11.922747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10c5cd-c7cb-4a7e-b724-f9076c4f8b10 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:12.178867 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1f70e-d16b-4b2f-bec3-d6155e2461df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:12.186968 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1f70e-d16b-4b2f-bec3-d6155e2461df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:12.186968 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1f70e-d16b-4b2f-bec3-d6155e2461df admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:12.186968 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1f70e-d16b-4b2f-bec3-d6155e2461df admin admin] PATH_INFO: `/v3/users/63b4bf591fe444c98addaf473b95ba9c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:12.191248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1f70e-d16b-4b2f-bec3-d6155e2461df admin admin] RBAC: Authorizing `identity:delete_user(user_id=63b4bf591fe444c98addaf473b95ba9c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:12.197279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1f70e-d16b-4b2f-bec3-d6155e2461df admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:12.284941 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e260788-6f44-4c3d-bc86-4b314b3fbe04 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:12.286760 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-7e260788-6f44-4c3d-bc86-4b314b3fbe04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:12.329729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e260788-6f44-4c3d-bc86-4b314b3fbe04 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:12.358161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b0ace-8f27-409e-9eb3-29f42718be33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:12.359114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0ace-8f27-409e-9eb3-29f42718be33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:12.359401 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0ace-8f27-409e-9eb3-29f42718be33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:12.367953 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b0ace-8f27-409e-9eb3-29f42718be33 admin admin] PATH_INFO: `/v3/users/e96c6b4e892644ab80385be19acf5635` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:12.371416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b0ace-8f27-409e-9eb3-29f42718be33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96c6b4e892644ab80385be19acf5635)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:12.379650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b0ace-8f27-409e-9eb3-29f42718be33 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:12.400769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ada1f70e-d16b-4b2f-bec3-d6155e2461df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63b4bf591fe444c98addaf473b95ba9c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:12.419463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ada1f70e-d16b-4b2f-bec3-d6155e2461df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63b4bf591fe444c98addaf473b95ba9c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:12.424630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ada1f70e-d16b-4b2f-bec3-d6155e2461df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63b4bf591fe444c98addaf473b95ba9c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:12.435383 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:12.457504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ada1f70e-d16b-4b2f-bec3-d6155e2461df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63b4bf591fe444c98addaf473b95ba9c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:12.482169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ada1f70e-d16b-4b2f-bec3-d6155e2461df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63b4bf591fe444c98addaf473b95ba9c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:12.511117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 865/1754] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:11 2022] DELETE /identity/v3/users/63b4bf591fe444c98addaf473b95ba9c => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:12.532987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c36b0ace-8f27-409e-9eb3-29f42718be33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96c6b4e892644ab80385be19acf5635'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:12.556366 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c36b0ace-8f27-409e-9eb3-29f42718be33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96c6b4e892644ab80385be19acf5635'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:12.557936 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c36b0ace-8f27-409e-9eb3-29f42718be33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96c6b4e892644ab80385be19acf5635'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:12.581853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:12.597171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c36b0ace-8f27-409e-9eb3-29f42718be33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96c6b4e892644ab80385be19acf5635'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:12.628720 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c36b0ace-8f27-409e-9eb3-29f42718be33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96c6b4e892644ab80385be19acf5635'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:12.647914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 890/1755] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:12 2022] DELETE /identity/v3/users/e96c6b4e892644ab80385be19acf5635 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:12.649448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13934fb-f112-441d-af94-ed54331e70ac None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:12.649778 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13934fb-f112-441d-af94-ed54331e70ac None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:12.650097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13934fb-f112-441d-af94-ed54331e70ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:12.685022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c13934fb-f112-441d-af94-ed54331e70ac None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:12.686424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c13934fb-f112-441d-af94-ed54331e70ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:12.934167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 866/1756] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:13.216785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b0ace-8f27-409e-9eb3-29f42718be33 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:13.220885 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c36b0ace-8f27-409e-9eb3-29f42718be33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:13.408370 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b0ace-8f27-409e-9eb3-29f42718be33 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:13.432291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8945fe-8918-45af-a668-14d2fa948997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:13.433409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8945fe-8918-45af-a668-14d2fa948997 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:13.435201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8945fe-8918-45af-a668-14d2fa948997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:13.436816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8945fe-8918-45af-a668-14d2fa948997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:13.481563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8945fe-8918-45af-a668-14d2fa948997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:13.483887 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8945fe-8918-45af-a668-14d2fa948997 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:13.511306 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 891/1757] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:15.574253 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13934fb-f112-441d-af94-ed54331e70ac None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:15.576117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c13934fb-f112-441d-af94-ed54331e70ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:15.607813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13934fb-f112-441d-af94-ed54331e70ac None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:15.613343 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83786db-25bc-4a3e-a613-865c7baad643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:15.614483 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83786db-25bc-4a3e-a613-865c7baad643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:15.614880 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83786db-25bc-4a3e-a613-865c7baad643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:15.615468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83786db-25bc-4a3e-a613-865c7baad643 admin admin] PATH_INFO: `/v3/projects/fa5343b66057450f91ea21b3b8bd5ee0` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:15.617233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83786db-25bc-4a3e-a613-865c7baad643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa5343b66057450f91ea21b3b8bd5ee0)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:15.639597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83786db-25bc-4a3e-a613-865c7baad643 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:15.800368 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a83786db-25bc-4a3e-a613-865c7baad643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa5343b66057450f91ea21b3b8bd5ee0', 'request_id': 'req-a83786db-25bc-4a3e-a613-865c7baad643'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:15.812461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a83786db-25bc-4a3e-a613-865c7baad643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa5343b66057450f91ea21b3b8bd5ee0', 'request_id': 'req-a83786db-25bc-4a3e-a613-865c7baad643'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:15.835414 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a83786db-25bc-4a3e-a613-865c7baad643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa5343b66057450f91ea21b3b8bd5ee0', 'request_id': 'req-a83786db-25bc-4a3e-a613-865c7baad643'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:15.876751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a83786db-25bc-4a3e-a613-865c7baad643 admin admin] The token cache is being invalidate because project fa5343b66057450f91ea21b3b8bd5ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:15.880514 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a83786db-25bc-4a3e-a613-865c7baad643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:15.892437 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a83786db-25bc-4a3e-a613-865c7baad643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:15.898804 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 867/1758] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:15 2022] DELETE /identity/v3/projects/fa5343b66057450f91ea21b3b8bd5ee0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:15.902067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad8919-6314-4c07-bc6e-1360792ba3fe None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:15.902931 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad8919-6314-4c07-bc6e-1360792ba3fe None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:15.903358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad8919-6314-4c07-bc6e-1360792ba3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:15.994657 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-61ad8919-6314-4c07-bc6e-1360792ba3fe None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:16.002650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-61ad8919-6314-4c07-bc6e-1360792ba3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:16.220148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58239039-0bdd-4006-8483-3d87c0400969 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:16.220459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58239039-0bdd-4006-8483-3d87c0400969 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:16.220824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58239039-0bdd-4006-8483-3d87c0400969 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:16.222266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 868/1759] 10.222.0.99 () {54 vars in 921 bytes} [Mon Jul 18 14:18:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 14:18:16.349777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 892/1760] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:16.357733 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe0dd3-fc2a-4eb1-9bfb-85f574a34e2d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:16.358353 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe0dd3-fc2a-4eb1-9bfb-85f574a34e2d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:16.358825 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe0dd3-fc2a-4eb1-9bfb-85f574a34e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:16.462491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3cbe0dd3-fc2a-4eb1-9bfb-85f574a34e2d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:16.468768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3cbe0dd3-fc2a-4eb1-9bfb-85f574a34e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:16.469320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84b78a-2f1a-4bd7-aaf2-954ea18b33d0 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:16.469755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84b78a-2f1a-4bd7-aaf2-954ea18b33d0 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:16.470487 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84b78a-2f1a-4bd7-aaf2-954ea18b33d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:16.523238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 869/1761] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:16.526328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe0dd3-fc2a-4eb1-9bfb-85f574a34e2d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:16.545058 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-cd84b78a-2f1a-4bd7-aaf2-954ea18b33d0 None None] MFA Rules not processed for user `b1b66b55e0374152828913910c4002f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:16.553611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-cd84b78a-2f1a-4bd7-aaf2-954ea18b33d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:16.573485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe0dd3-fc2a-4eb1-9bfb-85f574a34e2d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:16.589858 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03e925-c283-41f5-a64d-c01b29fb7ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:16.590939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03e925-c283-41f5-a64d-c01b29fb7ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:16.590939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03e925-c283-41f5-a64d-c01b29fb7ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:16.591247 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03e925-c283-41f5-a64d-c01b29fb7ad9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:16.597530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03e925-c283-41f5-a64d-c01b29fb7ad9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:16.598232 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03e925-c283-41f5-a64d-c01b29fb7ad9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:16.601521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03e925-c283-41f5-a64d-c01b29fb7ad9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:16.634764 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 870/1762] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:16.639607 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03e925-c283-41f5-a64d-c01b29fb7ad9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:16.664723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03e925-c283-41f5-a64d-c01b29fb7ad9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:16.678333 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f19c2-57c6-4639-b050-8303c81578ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:16.679087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f19c2-57c6-4639-b050-8303c81578ad admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:16.679400 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f19c2-57c6-4639-b050-8303c81578ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:16.679638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f19c2-57c6-4639-b050-8303c81578ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:16.680457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f19c2-57c6-4639-b050-8303c81578ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:16.687294 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f19c2-57c6-4639-b050-8303c81578ad admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:16.744075 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 893/1763] 10.222.0.99 () {58 vars in 1018 bytes} [Mon Jul 18 14:18:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:16.752512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 871/1764] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:16 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:16.754165 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84b78a-2f1a-4bd7-aaf2-954ea18b33d0 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:16.769772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84b78a-2f1a-4bd7-aaf2-954ea18b33d0 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:16.795457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:16.827138 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f19c2-57c6-4639-b050-8303c81578ad admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:16.829596 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ff9f19c2-57c6-4639-b050-8303c81578ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:16.912194 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:16.983671 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b05b4-f61e-4c8d-804c-fd8a5afd294d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:16.985159 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b05b4-f61e-4c8d-804c-fd8a5afd294d admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:16.986108 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b05b4-f61e-4c8d-804c-fd8a5afd294d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:16.986732 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b05b4-f61e-4c8d-804c-fd8a5afd294d admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:16.991317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b05b4-f61e-4c8d-804c-fd8a5afd294d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:17.005732 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b05b4-f61e-4c8d-804c-fd8a5afd294d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:17.063046 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 894/1765] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:16 2022] POST /identity/v3/users => generated 290 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:17.068348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b05b4-f61e-4c8d-804c-fd8a5afd294d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:17.095255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f19c2-57c6-4639-b050-8303c81578ad admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:17.096258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b05b4-f61e-4c8d-804c-fd8a5afd294d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:17.104422 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0a210-4a53-4b24-af3a-7eacfa216d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:17.106334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0a210-4a53-4b24-af3a-7eacfa216d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:17.113013 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016f634-a817-4c59-9e71-49ad2463eb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:17.113991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016f634-a817-4c59-9e71-49ad2463eb5c admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:17.114627 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0a210-4a53-4b24-af3a-7eacfa216d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:17.115074 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016f634-a817-4c59-9e71-49ad2463eb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:17.115667 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0a210-4a53-4b24-af3a-7eacfa216d0d admin admin] PATH_INFO: `/v3/users/be6bec974d4642c18ddcf8f0a9d92946` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:17.116100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016f634-a817-4c59-9e71-49ad2463eb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:17.117832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016f634-a817-4c59-9e71-49ad2463eb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:17.118709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0a210-4a53-4b24-af3a-7eacfa216d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6bec974d4642c18ddcf8f0a9d92946)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:17.124476 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016f634-a817-4c59-9e71-49ad2463eb5c admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:17.130851 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0a210-4a53-4b24-af3a-7eacfa216d0d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:17.158751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 895/1766] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:17.167445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016f634-a817-4c59-9e71-49ad2463eb5c admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:17.176135 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e016f634-a817-4c59-9e71-49ad2463eb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:17.313856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bac0a210-4a53-4b24-af3a-7eacfa216d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6bec974d4642c18ddcf8f0a9d92946'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:17.334048 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bac0a210-4a53-4b24-af3a-7eacfa216d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6bec974d4642c18ddcf8f0a9d92946'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:17.334835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bac0a210-4a53-4b24-af3a-7eacfa216d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6bec974d4642c18ddcf8f0a9d92946'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:17.389038 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bac0a210-4a53-4b24-af3a-7eacfa216d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6bec974d4642c18ddcf8f0a9d92946'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:17.429036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bac0a210-4a53-4b24-af3a-7eacfa216d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6bec974d4642c18ddcf8f0a9d92946'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:17.440110 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 872/1767] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:16 2022] DELETE /identity/v3/users/be6bec974d4642c18ddcf8f0a9d92946 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:17.440110 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0a210-4a53-4b24-af3a-7eacfa216d0d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:17.440110 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bac0a210-4a53-4b24-af3a-7eacfa216d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:17.483665 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016f634-a817-4c59-9e71-49ad2463eb5c admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:17.614746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0a210-4a53-4b24-af3a-7eacfa216d0d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:17.632178 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71fe4d-5cfa-4fe7-993a-8b6c0532dc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:17.633811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71fe4d-5cfa-4fe7-993a-8b6c0532dc31 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:17.635487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71fe4d-5cfa-4fe7-993a-8b6c0532dc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:17.636771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71fe4d-5cfa-4fe7-993a-8b6c0532dc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:17.641064 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71fe4d-5cfa-4fe7-993a-8b6c0532dc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:17.664092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71fe4d-5cfa-4fe7-993a-8b6c0532dc31 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:17.700955 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 873/1768] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:17.702184 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8f473-daab-412b-a30f-e8af44bb0e71 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:17.702590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8f473-daab-412b-a30f-e8af44bb0e71 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:17.702877 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8f473-daab-412b-a30f-e8af44bb0e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:17.770440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7bb8f473-daab-412b-a30f-e8af44bb0e71 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:17.772729 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7bb8f473-daab-412b-a30f-e8af44bb0e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:17.799899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 874/1769] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:17.800220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8decdd-edc3-457f-b21b-85579707fc61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:17.800832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8decdd-edc3-457f-b21b-85579707fc61 service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:17.801118 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8decdd-edc3-457f-b21b-85579707fc61 service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:17.801400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8decdd-edc3-457f-b21b-85579707fc61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:17.802837 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8f473-daab-412b-a30f-e8af44bb0e71 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:17.808646 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1b8decdd-edc3-457f-b21b-85579707fc61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:17.841700 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8decdd-edc3-457f-b21b-85579707fc61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:17.846127 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8decdd-edc3-457f-b21b-85579707fc61 service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:17.851682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8f473-daab-412b-a30f-e8af44bb0e71 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:17.885024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b03b3d-e6da-4891-bf1c-d339c27cd740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:17.887127 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b03b3d-e6da-4891-bf1c-d339c27cd740 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:17.887539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b03b3d-e6da-4891-bf1c-d339c27cd740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:17.887951 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b03b3d-e6da-4891-bf1c-d339c27cd740 admin admin] PATH_INFO: `/v3/projects/fead68cf58ca4c19b0d86dea3ca279ee/users/7c3350fdb59f466db26a9891118d6467/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:17.896865 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 896/1770] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:17.931014 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b03b3d-e6da-4891-bf1c-d339c27cd740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fead68cf58ca4c19b0d86dea3ca279ee, user_id=7c3350fdb59f466db26a9891118d6467, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:17.945129 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b03b3d-e6da-4891-bf1c-d339c27cd740 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:17.959417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8decdd-edc3-457f-b21b-85579707fc61 service nova] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:17.961527 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1b8decdd-edc3-457f-b21b-85579707fc61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:17.982166 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 875/1771] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:17 2022] PUT /identity/v3/projects/fead68cf58ca4c19b0d86dea3ca279ee/users/7c3350fdb59f466db26a9891118d6467/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:17.987640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1d231-da87-41a0-ba9d-59a5b12586f8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:17.987912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1d231-da87-41a0-ba9d-59a5b12586f8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:17.988237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1d231-da87-41a0-ba9d-59a5b12586f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:17.996313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:18.046626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:18.079501 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6da1d231-da87-41a0-ba9d-59a5b12586f8 None None] MFA Rules not processed for user `7c3350fdb59f466db26a9891118d6467`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:18.080759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6da1d231-da87-41a0-ba9d-59a5b12586f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:18.257998 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8decdd-edc3-457f-b21b-85579707fc61 service nova] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:18.338128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 876/1772] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:18.339134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1d231-da87-41a0-ba9d-59a5b12586f8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:18.417950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46595bc-792f-45dd-ae32-b81602c04fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:18.418982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46595bc-792f-45dd-ae32-b81602c04fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:18.419692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46595bc-792f-45dd-ae32-b81602c04fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:18.421461 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46595bc-792f-45dd-ae32-b81602c04fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:18.511725 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1d231-da87-41a0-ba9d-59a5b12586f8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:18.520214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6effe2-d317-473e-9ac0-1500ebcf550b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:18.524427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6effe2-d317-473e-9ac0-1500ebcf550b admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:18.526236 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6effe2-d317-473e-9ac0-1500ebcf550b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:18.528582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6effe2-d317-473e-9ac0-1500ebcf550b admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:18.533496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6effe2-d317-473e-9ac0-1500ebcf550b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:18.545158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6effe2-d317-473e-9ac0-1500ebcf550b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:18.638570 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 877/1773] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:18 2022] POST /identity/v3/projects => generated 381 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:18.638570 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6effe2-d317-473e-9ac0-1500ebcf550b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:18.640104 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46595bc-792f-45dd-ae32-b81602c04fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:18.641389 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7f6effe2-d317-473e-9ac0-1500ebcf550b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:18.645307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46595bc-792f-45dd-ae32-b81602c04fa6 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:18.672905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 897/1774] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:18.675900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46595bc-792f-45dd-ae32-b81602c04fa6 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:18.707618 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46595bc-792f-45dd-ae32-b81602c04fa6 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:18.862524 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613afe1-fbb6-4743-ac3a-5c83c0bb2c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:18.863450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613afe1-fbb6-4743-ac3a-5c83c0bb2c60 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:18.864028 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613afe1-fbb6-4743-ac3a-5c83c0bb2c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:18.864428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613afe1-fbb6-4743-ac3a-5c83c0bb2c60 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:18.865327 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613afe1-fbb6-4743-ac3a-5c83c0bb2c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:18.867490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613afe1-fbb6-4743-ac3a-5c83c0bb2c60 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:18.886352 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6effe2-d317-473e-9ac0-1500ebcf550b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:18.900967 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:18.903225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:18.903505 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:18.903817 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa admin admin] PATH_INFO: `/v3/projects/5e10daf9e81344dc9d7bf78374c231b4` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:18.908334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e10daf9e81344dc9d7bf78374c231b4)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:18.908903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 898/1775] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:18 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:18.913108 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613afe1-fbb6-4743-ac3a-5c83c0bb2c60 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:18.916477 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:18.942175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613afe1-fbb6-4743-ac3a-5c83c0bb2c60 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:18.956632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfdd65-3a3a-4185-a496-289131ed46a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:18.957469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfdd65-3a3a-4185-a496-289131ed46a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:18.957876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfdd65-3a3a-4185-a496-289131ed46a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:18.958675 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfdd65-3a3a-4185-a496-289131ed46a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:18.960866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfdd65-3a3a-4185-a496-289131ed46a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:18.975849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfdd65-3a3a-4185-a496-289131ed46a9 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:18.978849 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:19.016983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 899/1776] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:19.022009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfdd65-3a3a-4185-a496-289131ed46a9 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:19.039471 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:19.059832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfdd65-3a3a-4185-a496-289131ed46a9 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:19.083800 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e10daf9e81344dc9d7bf78374c231b4', 'request_id': 'req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.112482 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e10daf9e81344dc9d7bf78374c231b4', 'request_id': 'req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.158057 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e10daf9e81344dc9d7bf78374c231b4', 'request_id': 'req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.203437 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa admin admin] The token cache is being invalidate because project 5e10daf9e81344dc9d7bf78374c231b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:19.203883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.207691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.211944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 878/1777] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:18 2022] DELETE /identity/v3/projects/5e10daf9e81344dc9d7bf78374c231b4 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:19.216940 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:19.226002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:19.262622 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161c57c-2151-4204-9e26-cea9fed0e805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:19.263583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161c57c-2151-4204-9e26-cea9fed0e805 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:19.266110 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161c57c-2151-4204-9e26-cea9fed0e805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:19.266430 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161c57c-2151-4204-9e26-cea9fed0e805 admin admin] PATH_INFO: `/v3/projects/84eae75402264415a5269ebdfa332bc8/users/8a3ad4d7492b488798dbb54fc4900868/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:19.303849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161c57c-2151-4204-9e26-cea9fed0e805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84eae75402264415a5269ebdfa332bc8, user_id=8a3ad4d7492b488798dbb54fc4900868, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:19.310556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161c57c-2151-4204-9e26-cea9fed0e805 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:19.345363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 900/1778] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:19 2022] PUT /identity/v3/projects/84eae75402264415a5269ebdfa332bc8/users/8a3ad4d7492b488798dbb54fc4900868/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:19.349822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161c57c-2151-4204-9e26-cea9fed0e805 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:19.353201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d161c57c-2151-4204-9e26-cea9fed0e805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:19.579654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9c4ba-693c-4eae-80bf-49632fb1f7fa admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:19.582241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161c57c-2151-4204-9e26-cea9fed0e805 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:19.602688 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7f1e4-cad1-4c18-9aaf-fd1ce7511a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:19.603382 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7f1e4-cad1-4c18-9aaf-fd1ce7511a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:19.603664 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7f1e4-cad1-4c18-9aaf-fd1ce7511a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:19.608531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7f1e4-cad1-4c18-9aaf-fd1ce7511a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:19.610776 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7f1e4-cad1-4c18-9aaf-fd1ce7511a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:19.612471 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7f1e4-cad1-4c18-9aaf-fd1ce7511a97 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:19.618615 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41a203-fb21-497d-8de1-777a39d47f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:19.619577 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41a203-fb21-497d-8de1-777a39d47f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:19.619885 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41a203-fb21-497d-8de1-777a39d47f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:19.620348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41a203-fb21-497d-8de1-777a39d47f68 admin admin] PATH_INFO: `/v3/users/266c3ee708ac43809a5a5aeb25480141` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:19.624621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41a203-fb21-497d-8de1-777a39d47f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=266c3ee708ac43809a5a5aeb25480141)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:19.637826 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41a203-fb21-497d-8de1-777a39d47f68 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:19.672229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 901/1779] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:19.677379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7f1e4-cad1-4c18-9aaf-fd1ce7511a97 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:19.742891 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7f1e4-cad1-4c18-9aaf-fd1ce7511a97 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:19.769739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fb41a203-fb21-497d-8de1-777a39d47f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '266c3ee708ac43809a5a5aeb25480141'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.770991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691f603-f3b9-48e6-9108-cb07481dacf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:19.771894 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f603-f3b9-48e6-9108-cb07481dacf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:19.772176 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f603-f3b9-48e6-9108-cb07481dacf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:19.772459 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f603-f3b9-48e6-9108-cb07481dacf3 admin admin] PATH_INFO: `/v3/projects/84eae75402264415a5269ebdfa332bc8/users/8a3ad4d7492b488798dbb54fc4900868/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:19.792899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fb41a203-fb21-497d-8de1-777a39d47f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '266c3ee708ac43809a5a5aeb25480141'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.794984 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fb41a203-fb21-497d-8de1-777a39d47f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '266c3ee708ac43809a5a5aeb25480141'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.799405 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691f603-f3b9-48e6-9108-cb07481dacf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84eae75402264415a5269ebdfa332bc8, user_id=8a3ad4d7492b488798dbb54fc4900868, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:19.808869 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691f603-f3b9-48e6-9108-cb07481dacf3 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:19.868032 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fb41a203-fb21-497d-8de1-777a39d47f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '266c3ee708ac43809a5a5aeb25480141'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.901187 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 902/1780] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:19 2022] PUT /identity/v3/projects/84eae75402264415a5269ebdfa332bc8/users/8a3ad4d7492b488798dbb54fc4900868/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:19.918146 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce953b07-1fd8-46d2-a359-5cd788002a60 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:19.933220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce953b07-1fd8-46d2-a359-5cd788002a60 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:19.933549 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce953b07-1fd8-46d2-a359-5cd788002a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:19.945070 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fb41a203-fb21-497d-8de1-777a39d47f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '266c3ee708ac43809a5a5aeb25480141'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:19.970607 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 879/1781] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:19 2022] DELETE /identity/v3/users/266c3ee708ac43809a5a5aeb25480141 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:19.972583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4d942-15db-4920-85fd-6364f4d9296b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:19.975181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4d942-15db-4920-85fd-6364f4d9296b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:19.975998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4d942-15db-4920-85fd-6364f4d9296b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:19.980823 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 880/1782] 10.222.0.99 () {54 vars in 921 bytes} [Mon Jul 18 14:18:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:18:20.058291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-ce953b07-1fd8-46d2-a359-5cd788002a60 None None] MFA Rules not processed for user `8a3ad4d7492b488798dbb54fc4900868`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:20.059687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ce953b07-1fd8-46d2-a359-5cd788002a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:20.209365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:20.241139 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 903/1783] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:20.248981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4d942-15db-4920-85fd-6364f4d9296b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:20.251521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6af4d942-15db-4920-85fd-6364f4d9296b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:20.262308 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4cc2c-c6fd-4011-aa4b-d6f8896ee544 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:20.262820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4cc2c-c6fd-4011-aa4b-d6f8896ee544 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:20.263216 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4cc2c-c6fd-4011-aa4b-d6f8896ee544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:20.300689 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-cbe4cc2c-c6fd-4011-aa4b-d6f8896ee544 None None] MFA Rules not processed for user `b1b66b55e0374152828913910c4002f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:20.305356 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-cbe4cc2c-c6fd-4011-aa4b-d6f8896ee544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:20.361974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:20.452253 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 904/1784] 10.222.0.99 () {58 vars in 1018 bytes} [Mon Jul 18 14:18:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:20.472964 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4d942-15db-4920-85fd-6364f4d9296b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:20.482413 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b12386-f9c8-48cb-abf2-b5872a6ce8a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:20.483105 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b12386-f9c8-48cb-abf2-b5872a6ce8a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:20.483384 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b12386-f9c8-48cb-abf2-b5872a6ce8a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:20.483665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b12386-f9c8-48cb-abf2-b5872a6ce8a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:20.503745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b12386-f9c8-48cb-abf2-b5872a6ce8a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:20.505016 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b12386-f9c8-48cb-abf2-b5872a6ce8a8 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:20.569761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 881/1785] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:21.261989 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4cc2c-c6fd-4011-aa4b-d6f8896ee544 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:21.273634 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4cc2c-c6fd-4011-aa4b-d6f8896ee544 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:21.280083 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e9804-63eb-4684-ac0c-c66beecdf5e3 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a3ad4d7492b488798dbb54fc4900868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84eae75402264415a5269ebdfa332bc8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:21.281172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e9804-63eb-4684-ac0c-c66beecdf5e3 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:21.281906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e9804-63eb-4684-ac0c-c66beecdf5e3 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:21.282069 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e9804-63eb-4684-ac0c-c66beecdf5e3 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:21.282909 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e9804-63eb-4684-ac0c-c66beecdf5e3 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:21.283198 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e9804-63eb-4684-ac0c-c66beecdf5e3 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:21.285126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e9804-63eb-4684-ac0c-c66beecdf5e3 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:21.302684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 905/1786] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:21.303592 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b12386-f9c8-48cb-abf2-b5872a6ce8a8 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:21.326459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b12386-f9c8-48cb-abf2-b5872a6ce8a8 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:21.339312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac752d-66e2-4090-9ccc-ffb7e56b7c17 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a3ad4d7492b488798dbb54fc4900868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84eae75402264415a5269ebdfa332bc8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:21.340230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac752d-66e2-4090-9ccc-ffb7e56b7c17 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:21.340673 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac752d-66e2-4090-9ccc-ffb7e56b7c17 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:21.341099 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac752d-66e2-4090-9ccc-ffb7e56b7c17 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:21.342629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac752d-66e2-4090-9ccc-ffb7e56b7c17 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:21.346586 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac752d-66e2-4090-9ccc-ffb7e56b7c17 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:21.404320 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 882/1787] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:21 2022] POST /identity/v3/projects => generated 354 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:18:21.404937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e9804-63eb-4684-ac0c-c66beecdf5e3 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:21.409600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac752d-66e2-4090-9ccc-ffb7e56b7c17 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:21.413301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e2ac752d-66e2-4090-9ccc-ffb7e56b7c17 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:21.419575 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e9804-63eb-4684-ac0c-c66beecdf5e3 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:21.487407 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d77e2b-d7ee-4c8a-ba5c-66711ebd2881 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a3ad4d7492b488798dbb54fc4900868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84eae75402264415a5269ebdfa332bc8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:21.488341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d77e2b-d7ee-4c8a-ba5c-66711ebd2881 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:21.488829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d77e2b-d7ee-4c8a-ba5c-66711ebd2881 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:21.489285 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d77e2b-d7ee-4c8a-ba5c-66711ebd2881 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:21.491068 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d77e2b-d7ee-4c8a-ba5c-66711ebd2881 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:21.491068 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d77e2b-d7ee-4c8a-ba5c-66711ebd2881 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:21.494028 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d77e2b-d7ee-4c8a-ba5c-66711ebd2881 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:21.513739 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 906/1788] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:21.545564 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d77e2b-d7ee-4c8a-ba5c-66711ebd2881 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:21.547710 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-78d77e2b-d7ee-4c8a-ba5c-66711ebd2881 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:21.549048 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac752d-66e2-4090-9ccc-ffb7e56b7c17 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:21.564543 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eef30b-fd7b-4875-86e8-998a0bef0160 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:21.565232 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eef30b-fd7b-4875-86e8-998a0bef0160 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:21.565501 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eef30b-fd7b-4875-86e8-998a0bef0160 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:21.565786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eef30b-fd7b-4875-86e8-998a0bef0160 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:21.583628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eef30b-fd7b-4875-86e8-998a0bef0160 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:21.585255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eef30b-fd7b-4875-86e8-998a0bef0160 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:21.608287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 883/1789] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:21.609343 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eef30b-fd7b-4875-86e8-998a0bef0160 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:21.630693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eef30b-fd7b-4875-86e8-998a0bef0160 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:21.643881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e8372-27a1-4ad0-8a88-760b2a37f225 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a3ad4d7492b488798dbb54fc4900868', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84eae75402264415a5269ebdfa332bc8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:21.644769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e8372-27a1-4ad0-8a88-760b2a37f225 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:21.645059 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e8372-27a1-4ad0-8a88-760b2a37f225 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:21.645342 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e8372-27a1-4ad0-8a88-760b2a37f225 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] PATH_INFO: `/v3/projects/2f9ea7ac4dbd4369839981a6c06834a1` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:21.648606 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e8372-27a1-4ad0-8a88-760b2a37f225 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2f9ea7ac4dbd4369839981a6c06834a1)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:21.650600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e8372-27a1-4ad0-8a88-760b2a37f225 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:21.663694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d77e2b-d7ee-4c8a-ba5c-66711ebd2881 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:21.674155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:21.675621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:21.676016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:21.676517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919 admin admin] PATH_INFO: `/v3/projects/7f659e9f3f504ba1a54bc5bbf23fbc5d` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:21.678434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f659e9f3f504ba1a54bc5bbf23fbc5d)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:21.681243 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:21.692150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:21.744782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ce4e8372-27a1-4ad0-8a88-760b2a37f225 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9ea7ac4dbd4369839981a6c06834a1', 'request_id': 'req-ce4e8372-27a1-4ad0-8a88-760b2a37f225'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:21.754270 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ce4e8372-27a1-4ad0-8a88-760b2a37f225 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9ea7ac4dbd4369839981a6c06834a1', 'request_id': 'req-ce4e8372-27a1-4ad0-8a88-760b2a37f225'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:21.761490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ce4e8372-27a1-4ad0-8a88-760b2a37f225 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9ea7ac4dbd4369839981a6c06834a1', 'request_id': 'req-ce4e8372-27a1-4ad0-8a88-760b2a37f225'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:21.767148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f659e9f3f504ba1a54bc5bbf23fbc5d', 'request_id': 'req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:21.776403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f659e9f3f504ba1a54bc5bbf23fbc5d', 'request_id': 'req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:21.780126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ce4e8372-27a1-4ad0-8a88-760b2a37f225 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] The token cache is being invalidate because project 2f9ea7ac4dbd4369839981a6c06834a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:21.780442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ce4e8372-27a1-4ad0-8a88-760b2a37f225 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:21.781129 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ce4e8372-27a1-4ad0-8a88-760b2a37f225 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:21.782783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 884/1790] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:21 2022] DELETE /identity/v3/projects/2f9ea7ac4dbd4369839981a6c06834a1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:21.792723 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f659e9f3f504ba1a54bc5bbf23fbc5d', 'request_id': 'req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:21.826787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919 admin admin] The token cache is being invalidate because project 7f659e9f3f504ba1a54bc5bbf23fbc5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:21.826890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:21.828588 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:21.833025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 907/1791] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:21 2022] DELETE /identity/v3/projects/7f659e9f3f504ba1a54bc5bbf23fbc5d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:21.838990 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e8372-27a1-4ad0-8a88-760b2a37f225 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:21.840876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ce4e8372-27a1-4ad0-8a88-760b2a37f225 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:21.881084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:21.985576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e8372-27a1-4ad0-8a88-760b2a37f225 tempest-VolumeQuotaClassesTest-2012039726 tempest-VolumeQuotaClassesTest-2012039726-project-admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:22.032986 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:22.034531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:22.160394 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205a875-3ecd-4083-8248-d4a2accafb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:22.161217 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205a875-3ecd-4083-8248-d4a2accafb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:22.161495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205a875-3ecd-4083-8248-d4a2accafb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:22.161770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205a875-3ecd-4083-8248-d4a2accafb0a admin admin] PATH_INFO: `/v3/users/5fe61ad4b6ce4a36bb6afbe198949323` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:22.164466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205a875-3ecd-4083-8248-d4a2accafb0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe61ad4b6ce4a36bb6afbe198949323)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:22.167579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205a875-3ecd-4083-8248-d4a2accafb0a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:22.227598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acacc3e-2f64-41c3-8a0c-e7cae18c5919 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:22.239709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1b5be-c16e-4e62-826a-00eafb936764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:22.240741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1b5be-c16e-4e62-826a-00eafb936764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:22.241097 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1b5be-c16e-4e62-826a-00eafb936764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:22.241471 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1b5be-c16e-4e62-826a-00eafb936764 admin admin] PATH_INFO: `/v3/projects/52769612b5634c7bb208484f40a08df1` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:22.243001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1b5be-c16e-4e62-826a-00eafb936764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52769612b5634c7bb208484f40a08df1)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:22.245697 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1b5be-c16e-4e62-826a-00eafb936764 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:22.293095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3205a875-3ecd-4083-8248-d4a2accafb0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe61ad4b6ce4a36bb6afbe198949323'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:22.312383 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3205a875-3ecd-4083-8248-d4a2accafb0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe61ad4b6ce4a36bb6afbe198949323'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:22.317694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3205a875-3ecd-4083-8248-d4a2accafb0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe61ad4b6ce4a36bb6afbe198949323'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:22.339742 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3205a875-3ecd-4083-8248-d4a2accafb0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe61ad4b6ce4a36bb6afbe198949323'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:22.360734 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3205a875-3ecd-4083-8248-d4a2accafb0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe61ad4b6ce4a36bb6afbe198949323'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:22.374220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-a8d1b5be-c16e-4e62-826a-00eafb936764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52769612b5634c7bb208484f40a08df1', 'request_id': 'req-a8d1b5be-c16e-4e62-826a-00eafb936764'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:22.378299 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 885/1792] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:21 2022] DELETE /identity/v3/users/5fe61ad4b6ce4a36bb6afbe198949323 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:22.382834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205a875-3ecd-4083-8248-d4a2accafb0a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:22.385736 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3205a875-3ecd-4083-8248-d4a2accafb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:22.388607 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-a8d1b5be-c16e-4e62-826a-00eafb936764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52769612b5634c7bb208484f40a08df1', 'request_id': 'req-a8d1b5be-c16e-4e62-826a-00eafb936764'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:22.398429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-a8d1b5be-c16e-4e62-826a-00eafb936764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52769612b5634c7bb208484f40a08df1', 'request_id': 'req-a8d1b5be-c16e-4e62-826a-00eafb936764'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:22.458589 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-a8d1b5be-c16e-4e62-826a-00eafb936764 admin admin] The token cache is being invalidate because project 52769612b5634c7bb208484f40a08df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:22.461153 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-a8d1b5be-c16e-4e62-826a-00eafb936764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:22.462838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-a8d1b5be-c16e-4e62-826a-00eafb936764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:22.466560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 908/1793] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:22 2022] DELETE /identity/v3/projects/52769612b5634c7bb208484f40a08df1 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:22.471880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04bdb4-c482-4560-883c-d12d80151aeb None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:22.472386 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04bdb4-c482-4560-883c-d12d80151aeb None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:22.472837 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04bdb4-c482-4560-883c-d12d80151aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:22.520595 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-ff04bdb4-c482-4560-883c-d12d80151aeb None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:22.523217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ff04bdb4-c482-4560-883c-d12d80151aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:22.539617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:22.562767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:22.591617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205a875-3ecd-4083-8248-d4a2accafb0a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:22.606224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e319c56-6164-4574-a3d7-a19be504229e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:22.607293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319c56-6164-4574-a3d7-a19be504229e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:22.607676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319c56-6164-4574-a3d7-a19be504229e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:22.607960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e319c56-6164-4574-a3d7-a19be504229e admin admin] PATH_INFO: `/v3/users/7c3350fdb59f466db26a9891118d6467` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:22.610192 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e319c56-6164-4574-a3d7-a19be504229e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c3350fdb59f466db26a9891118d6467)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:22.615356 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e319c56-6164-4574-a3d7-a19be504229e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:22.655522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 909/1794] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:22.657067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf129a-efd6-44fb-b55c-0064bff1ed45 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:22.657362 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf129a-efd6-44fb-b55c-0064bff1ed45 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:22.657642 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf129a-efd6-44fb-b55c-0064bff1ed45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:22.682092 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-2bbf129a-efd6-44fb-b55c-0064bff1ed45 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:22.686734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2bbf129a-efd6-44fb-b55c-0064bff1ed45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:22.700375 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 910/1795] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:22.703258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf129a-efd6-44fb-b55c-0064bff1ed45 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:22.731448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf129a-efd6-44fb-b55c-0064bff1ed45 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:22.748923 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217a67b-894b-46c3-8e0b-7b067519b4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:22.749622 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217a67b-894b-46c3-8e0b-7b067519b4ed admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:22.749905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217a67b-894b-46c3-8e0b-7b067519b4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:22.750181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217a67b-894b-46c3-8e0b-7b067519b4ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:22.751082 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217a67b-894b-46c3-8e0b-7b067519b4ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:22.751391 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217a67b-894b-46c3-8e0b-7b067519b4ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:22.753003 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217a67b-894b-46c3-8e0b-7b067519b4ed admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:22.761089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7e319c56-6164-4574-a3d7-a19be504229e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c3350fdb59f466db26a9891118d6467'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:22.770508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 911/1796] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:22.771511 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217a67b-894b-46c3-8e0b-7b067519b4ed admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:22.779560 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7e319c56-6164-4574-a3d7-a19be504229e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c3350fdb59f466db26a9891118d6467'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:22.780840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7e319c56-6164-4574-a3d7-a19be504229e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c3350fdb59f466db26a9891118d6467'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:22.783301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217a67b-894b-46c3-8e0b-7b067519b4ed admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:22.806428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd81703-e1c9-4b51-afae-efbc13609390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:22.806428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd81703-e1c9-4b51-afae-efbc13609390 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:22.806428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd81703-e1c9-4b51-afae-efbc13609390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:22.806428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd81703-e1c9-4b51-afae-efbc13609390 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:22.806854 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd81703-e1c9-4b51-afae-efbc13609390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:22.806854 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd81703-e1c9-4b51-afae-efbc13609390 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:22.806981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7e319c56-6164-4574-a3d7-a19be504229e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c3350fdb59f466db26a9891118d6467'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:22.830935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7e319c56-6164-4574-a3d7-a19be504229e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c3350fdb59f466db26a9891118d6467'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:22.851541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 886/1797] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:22 2022] DELETE /identity/v3/users/7c3350fdb59f466db26a9891118d6467 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:22.854276 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0e093-9d09-420f-a144-d5b8ef783d05 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:22.854609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0e093-9d09-420f-a144-d5b8ef783d05 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:22.854887 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0e093-9d09-420f-a144-d5b8ef783d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:22.863543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 912/1798] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:22 2022] POST /identity/v3/projects => generated 393 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:22.867840 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd81703-e1c9-4b51-afae-efbc13609390 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:22.873948 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-fcd81703-e1c9-4b51-afae-efbc13609390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:22.883300 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-60b0e093-9d09-420f-a144-d5b8ef783d05 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:22.884841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-60b0e093-9d09-420f-a144-d5b8ef783d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:22.966759 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd81703-e1c9-4b51-afae-efbc13609390 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:22.974076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c24c5-584d-4bb8-bffc-e169a28e5e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:22.974076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c24c5-584d-4bb8-bffc-e169a28e5e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:22.974076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c24c5-584d-4bb8-bffc-e169a28e5e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:22.974076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c24c5-584d-4bb8-bffc-e169a28e5e9b admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:22.974440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c24c5-584d-4bb8-bffc-e169a28e5e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:22.976527 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c24c5-584d-4bb8-bffc-e169a28e5e9b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:22.980134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 887/1799] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:22.980940 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0e093-9d09-420f-a144-d5b8ef783d05 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:22.982764 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-60b0e093-9d09-420f-a144-d5b8ef783d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:23.000843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0e093-9d09-420f-a144-d5b8ef783d05 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:23.006645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:23.007596 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.007831 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.008338 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42 admin admin] PATH_INFO: `/v3/projects/bc51e0927ead494c93be49b1a6ae3590` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.009709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc51e0927ead494c93be49b1a6ae3590)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:23.011479 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:23.026065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 913/1800] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:22 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:23.026065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c24c5-584d-4bb8-bffc-e169a28e5e9b admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:23.027571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-188c24c5-584d-4bb8-bffc-e169a28e5e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:23.066084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc51e0927ead494c93be49b1a6ae3590', 'request_id': 'req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:23.073179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:23.074357 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc51e0927ead494c93be49b1a6ae3590', 'request_id': 'req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:23.082550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc51e0927ead494c93be49b1a6ae3590', 'request_id': 'req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:23.095628 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c24c5-584d-4bb8-bffc-e169a28e5e9b admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:23.096838 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42 admin admin] The token cache is being invalidate because project bc51e0927ead494c93be49b1a6ae3590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:23.097132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:23.097901 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:23.099924 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 888/1801] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:22 2022] DELETE /identity/v3/projects/bc51e0927ead494c93be49b1a6ae3590 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:23.104037 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:23.105593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:23.136481 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:23.159422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aef6cd-a08b-469f-8b22-0482087249c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:23.160078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aef6cd-a08b-469f-8b22-0482087249c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.160357 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aef6cd-a08b-469f-8b22-0482087249c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.160627 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aef6cd-a08b-469f-8b22-0482087249c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.162554 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-32aef6cd-a08b-469f-8b22-0482087249c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:23.174774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aef6cd-a08b-469f-8b22-0482087249c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:23.175027 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5ad00-1d78-4efb-b0bc-ffb4613feb42 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:23.176140 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aef6cd-a08b-469f-8b22-0482087249c4 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:23.179667 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186c5a0-f741-499a-b0bd-c9592839076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:23.180395 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186c5a0-f741-499a-b0bd-c9592839076a admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.180683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186c5a0-f741-499a-b0bd-c9592839076a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.181012 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186c5a0-f741-499a-b0bd-c9592839076a admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.181859 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186c5a0-f741-499a-b0bd-c9592839076a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:23.183577 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186c5a0-f741-499a-b0bd-c9592839076a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:23.186851 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 914/1802] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:23.188062 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0cf3b-34d1-45ea-aa1f-c6840e0e5859 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.188413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0cf3b-34d1-45ea-aa1f-c6840e0e5859 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.188751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0cf3b-34d1-45ea-aa1f-c6840e0e5859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.195384 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 889/1803] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:23.199911 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186c5a0-f741-499a-b0bd-c9592839076a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:23.211699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-7db0cf3b-34d1-45ea-aa1f-c6840e0e5859 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:23.213111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-7db0cf3b-34d1-45ea-aa1f-c6840e0e5859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:23.213365 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186c5a0-f741-499a-b0bd-c9592839076a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:23.218926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3fdf0-e926-4f0a-8c0c-c778d3ea966d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:23.219988 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3fdf0-e926-4f0a-8c0c-c778d3ea966d admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.220484 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3fdf0-e926-4f0a-8c0c-c778d3ea966d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.220929 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3fdf0-e926-4f0a-8c0c-c778d3ea966d admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.221834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3fdf0-e926-4f0a-8c0c-c778d3ea966d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:23.230115 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 915/1804] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:23.231780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3fdf0-e926-4f0a-8c0c-c778d3ea966d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:23.233706 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7064013-809c-4a1a-93ce-26a7dd9c79b6 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.234935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7064013-809c-4a1a-93ce-26a7dd9c79b6 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.235375 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7064013-809c-4a1a-93ce-26a7dd9c79b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.253695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 890/1805] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:18:23.255056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3fdf0-e926-4f0a-8c0c-c778d3ea966d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:23.261930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-a7064013-809c-4a1a-93ce-26a7dd9c79b6 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:23.263750 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a7064013-809c-4a1a-93ce-26a7dd9c79b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:23.266679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3fdf0-e926-4f0a-8c0c-c778d3ea966d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:23.274338 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e6b29-de38-4733-a739-b58c4738c407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:23.274701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 916/1806] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:23.279660 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7064013-809c-4a1a-93ce-26a7dd9c79b6 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:23.284233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e6b29-de38-4733-a739-b58c4738c407 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.285041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e6b29-de38-4733-a739-b58c4738c407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.285531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e6b29-de38-4733-a739-b58c4738c407 admin admin] PATH_INFO: `/v3/projects/a27d3297f8854e84850f540dbcadc298/users/7d53ed9e8c4546a189ffed17afaa547c/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.291641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7064013-809c-4a1a-93ce-26a7dd9c79b6 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:23.300888 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29419af9-5cf5-42ba-bd33-3d8a2abaccbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:23.301740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29419af9-5cf5-42ba-bd33-3d8a2abaccbd admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.302071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29419af9-5cf5-42ba-bd33-3d8a2abaccbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.302301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29419af9-5cf5-42ba-bd33-3d8a2abaccbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.303736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29419af9-5cf5-42ba-bd33-3d8a2abaccbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:23.304081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29419af9-5cf5-42ba-bd33-3d8a2abaccbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:23.306017 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29419af9-5cf5-42ba-bd33-3d8a2abaccbd admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:23.308798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e6b29-de38-4733-a739-b58c4738c407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27d3297f8854e84850f540dbcadc298, user_id=7d53ed9e8c4546a189ffed17afaa547c, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:23.311829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e6b29-de38-4733-a739-b58c4738c407 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:23.323970 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 917/1807] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:23.325061 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29419af9-5cf5-42ba-bd33-3d8a2abaccbd admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:23.343513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29419af9-5cf5-42ba-bd33-3d8a2abaccbd admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:23.343706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 891/1808] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:23 2022] PUT /identity/v3/projects/a27d3297f8854e84850f540dbcadc298/users/7d53ed9e8c4546a189ffed17afaa547c/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:23.345744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c6e93-e67c-498f-a7db-ad1439d713d2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.346037 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c6e93-e67c-498f-a7db-ad1439d713d2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.346315 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c6e93-e67c-498f-a7db-ad1439d713d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.389828 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ab6c6e93-e67c-498f-a7db-ad1439d713d2 None None] MFA Rules not processed for user `7d53ed9e8c4546a189ffed17afaa547c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:23.392270 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ab6c6e93-e67c-498f-a7db-ad1439d713d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:23.430067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b755c8e-c534-4fb6-a90f-2d6781021fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:23.430067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b755c8e-c534-4fb6-a90f-2d6781021fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.430067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b755c8e-c534-4fb6-a90f-2d6781021fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.430882 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b755c8e-c534-4fb6-a90f-2d6781021fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.431152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b755c8e-c534-4fb6-a90f-2d6781021fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:23.434867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b755c8e-c534-4fb6-a90f-2d6781021fc3 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:23.477760 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 918/1809] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:23 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:23.479417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b755c8e-c534-4fb6-a90f-2d6781021fc3 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:23.501626 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 892/1810] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:23.503063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c6e93-e67c-498f-a7db-ad1439d713d2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:23.526624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c6e93-e67c-498f-a7db-ad1439d713d2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:23.577128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:23.608708 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09968c6e-3c16-426c-90ac-111d4e6a0ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:23.609184 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09968c6e-3c16-426c-90ac-111d4e6a0ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.609483 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09968c6e-3c16-426c-90ac-111d4e6a0ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.609750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09968c6e-3c16-426c-90ac-111d4e6a0ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.610765 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09968c6e-3c16-426c-90ac-111d4e6a0ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:23.612690 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b755c8e-c534-4fb6-a90f-2d6781021fc3 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:23.613675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09968c6e-3c16-426c-90ac-111d4e6a0ce1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:23.630644 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0928e41-564d-43ae-b820-781c85a8adaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:23.632631 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0928e41-564d-43ae-b820-781c85a8adaa admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.633251 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0928e41-564d-43ae-b820-781c85a8adaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.633778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0928e41-564d-43ae-b820-781c85a8adaa admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.635538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0928e41-564d-43ae-b820-781c85a8adaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:23.639075 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0928e41-564d-43ae-b820-781c85a8adaa admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:23.655059 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 893/1811] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:23 2022] POST /identity/v3/projects => generated 393 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:23.660344 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09968c6e-3c16-426c-90ac-111d4e6a0ce1 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:23.683294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 919/1812] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:23 2022] POST /identity/v3/users => generated 285 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:18:23.684159 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0928e41-564d-43ae-b820-781c85a8adaa admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:23.696516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0928e41-564d-43ae-b820-781c85a8adaa admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:23.716625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:23.797179 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7780a-63b9-497c-886c-9e37e8539a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:23.797879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7780a-63b9-497c-886c-9e37e8539a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.798168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7780a-63b9-497c-886c-9e37e8539a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.798481 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7780a-63b9-497c-886c-9e37e8539a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.799529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7780a-63b9-497c-886c-9e37e8539a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:23.800975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7780a-63b9-497c-886c-9e37e8539a0c admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:23.835063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09968c6e-3c16-426c-90ac-111d4e6a0ce1 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:23.844772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 920/1813] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:23.846489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7780a-63b9-497c-886c-9e37e8539a0c admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:23.855628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dd837-9e14-43a0-97c6-f1ed3531484f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:23.856336 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dd837-9e14-43a0-97c6-f1ed3531484f admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.856629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dd837-9e14-43a0-97c6-f1ed3531484f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.856962 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dd837-9e14-43a0-97c6-f1ed3531484f admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.857685 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dd837-9e14-43a0-97c6-f1ed3531484f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:23.859741 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dd837-9e14-43a0-97c6-f1ed3531484f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:23.870119 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7780a-63b9-497c-886c-9e37e8539a0c admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:23.877806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c53624-4533-4ebe-830b-0f2145333561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:23.878539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c53624-4533-4ebe-830b-0f2145333561 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.878828 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c53624-4533-4ebe-830b-0f2145333561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.879108 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c53624-4533-4ebe-830b-0f2145333561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.879855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c53624-4533-4ebe-830b-0f2145333561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:23.881509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c53624-4533-4ebe-830b-0f2145333561 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:23.894148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 921/1814] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:23.900052 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c53624-4533-4ebe-830b-0f2145333561 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:23.917611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 894/1815] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:23 2022] POST /identity/v3/users => generated 303 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:18:23.920780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dd837-9e14-43a0-97c6-f1ed3531484f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:23.928895 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c53624-4533-4ebe-830b-0f2145333561 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:23.934029 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dd837-9e14-43a0-97c6-f1ed3531484f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:23.939923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865d14d-567b-465d-9569-4a7743479f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:23.940903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865d14d-567b-465d-9569-4a7743479f5d admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.941286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865d14d-567b-465d-9569-4a7743479f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.941730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865d14d-567b-465d-9569-4a7743479f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.942621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865d14d-567b-465d-9569-4a7743479f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:23.944386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865d14d-567b-465d-9569-4a7743479f5d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:23.948719 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71f02f-fb29-469a-8886-7a9b59d61683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:23.949640 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71f02f-fb29-469a-8886-7a9b59d61683 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.949925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71f02f-fb29-469a-8886-7a9b59d61683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.950204 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71f02f-fb29-469a-8886-7a9b59d61683 admin admin] PATH_INFO: `/v3/projects/02b73b0edff54bde80696e4d05bcaef1/users/223d4d9321dd4b3fb2f514bf53e1e4be/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.962434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 895/1816] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:23.966045 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865d14d-567b-465d-9569-4a7743479f5d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:23.976667 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865d14d-567b-465d-9569-4a7743479f5d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:23.982157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357182b6-b451-4611-b76e-bcd37e496aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:23.983175 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357182b6-b451-4611-b76e-bcd37e496aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:23.983799 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357182b6-b451-4611-b76e-bcd37e496aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:23.983799 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357182b6-b451-4611-b76e-bcd37e496aa1 admin admin] PATH_INFO: `/v3/projects/1561b45684ec47bdb59090652132dc87/users/9349f5dac08e4a7c94dc96a53bb70759/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:23.988367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71f02f-fb29-469a-8886-7a9b59d61683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b73b0edff54bde80696e4d05bcaef1, user_id=223d4d9321dd4b3fb2f514bf53e1e4be, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:23.991451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71f02f-fb29-469a-8886-7a9b59d61683 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:24.002380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357182b6-b451-4611-b76e-bcd37e496aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1561b45684ec47bdb59090652132dc87, user_id=9349f5dac08e4a7c94dc96a53bb70759, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:24.005221 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357182b6-b451-4611-b76e-bcd37e496aa1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:24.021954 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 922/1817] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:23 2022] PUT /identity/v3/projects/02b73b0edff54bde80696e4d05bcaef1/users/223d4d9321dd4b3fb2f514bf53e1e4be/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:24.027970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 896/1818] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:23 2022] PUT /identity/v3/projects/1561b45684ec47bdb59090652132dc87/users/9349f5dac08e4a7c94dc96a53bb70759/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:24.037506 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71f02f-fb29-469a-8886-7a9b59d61683 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:24.041781 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144077b-e18f-4a47-af66-687ab3977514 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:24.042078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144077b-e18f-4a47-af66-687ab3977514 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:24.042358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144077b-e18f-4a47-af66-687ab3977514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:24.096640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4144077b-e18f-4a47-af66-687ab3977514 None None] MFA Rules not processed for user `223d4d9321dd4b3fb2f514bf53e1e4be`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:24.098086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4144077b-e18f-4a47-af66-687ab3977514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:24.143222 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71f02f-fb29-469a-8886-7a9b59d61683 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:24.211794 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 897/1819] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:24.225766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144077b-e18f-4a47-af66-687ab3977514 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:24.229190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f34e8-2b51-49a4-89b9-ea9d8cae57c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:24.229933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f34e8-2b51-49a4-89b9-ea9d8cae57c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:24.230870 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f34e8-2b51-49a4-89b9-ea9d8cae57c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:24.231156 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f34e8-2b51-49a4-89b9-ea9d8cae57c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:24.232517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f34e8-2b51-49a4-89b9-ea9d8cae57c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:24.234190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f34e8-2b51-49a4-89b9-ea9d8cae57c2 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:24.247076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:24.251566 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 923/1820] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:24.254898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f34e8-2b51-49a4-89b9-ea9d8cae57c2 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:24.259735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144077b-e18f-4a47-af66-687ab3977514 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:24.266516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d086c-3917-468f-a797-d19cb87b821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:24.268251 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d086c-3917-468f-a797-d19cb87b821a admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:24.268578 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d086c-3917-468f-a797-d19cb87b821a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:24.268903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d086c-3917-468f-a797-d19cb87b821a admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:24.270293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d086c-3917-468f-a797-d19cb87b821a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:24.272420 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f34e8-2b51-49a4-89b9-ea9d8cae57c2 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:24.273089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d086c-3917-468f-a797-d19cb87b821a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:24.279154 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c1f44-32df-4f89-80c8-de1eb05d26a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:24.280538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c1f44-32df-4f89-80c8-de1eb05d26a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:24.281300 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c1f44-32df-4f89-80c8-de1eb05d26a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:24.281781 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c1f44-32df-4f89-80c8-de1eb05d26a0 admin admin] PATH_INFO: `/v3/projects/1561b45684ec47bdb59090652132dc87/users/9349f5dac08e4a7c94dc96a53bb70759/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:24.285698 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c1f44-32df-4f89-80c8-de1eb05d26a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1561b45684ec47bdb59090652132dc87, user_id=9349f5dac08e4a7c94dc96a53bb70759, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:24.288701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c1f44-32df-4f89-80c8-de1eb05d26a0 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:24.306233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 924/1821] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:24 2022] PUT /identity/v3/projects/1561b45684ec47bdb59090652132dc87/users/9349f5dac08e4a7c94dc96a53bb70759/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:24.317487 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487bee7-1506-4ce5-b4c9-076b397d1981 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:24.317779 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487bee7-1506-4ce5-b4c9-076b397d1981 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:24.318103 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487bee7-1506-4ce5-b4c9-076b397d1981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:24.322674 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 898/1822] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:24 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:24.327296 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d086c-3917-468f-a797-d19cb87b821a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:24.375640 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:24.381579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-2487bee7-1506-4ce5-b4c9-076b397d1981 None None] MFA Rules not processed for user `9349f5dac08e4a7c94dc96a53bb70759`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:24.384780 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2487bee7-1506-4ce5-b4c9-076b397d1981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:24.447967 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d086c-3917-468f-a797-d19cb87b821a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:24.452757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e7368-5e43-4cb2-9e98-b3a63f86a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:24.453664 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e7368-5e43-4cb2-9e98-b3a63f86a93b admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:24.454051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e7368-5e43-4cb2-9e98-b3a63f86a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:24.454482 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e7368-5e43-4cb2-9e98-b3a63f86a93b admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:24.456053 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e7368-5e43-4cb2-9e98-b3a63f86a93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:24.459181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e7368-5e43-4cb2-9e98-b3a63f86a93b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:24.512153 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 899/1823] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:24 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:24.519199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e7368-5e43-4cb2-9e98-b3a63f86a93b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:24.521083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-112e7368-5e43-4cb2-9e98-b3a63f86a93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:24.542569 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e7368-5e43-4cb2-9e98-b3a63f86a93b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:24.547453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769a651-37a4-48bb-be69-8bd0cf92f255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:24.548497 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769a651-37a4-48bb-be69-8bd0cf92f255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:24.549365 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769a651-37a4-48bb-be69-8bd0cf92f255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:24.549365 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769a651-37a4-48bb-be69-8bd0cf92f255 admin admin] PATH_INFO: `/v3/projects/fead68cf58ca4c19b0d86dea3ca279ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:24.550739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769a651-37a4-48bb-be69-8bd0cf92f255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fead68cf58ca4c19b0d86dea3ca279ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:24.552806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769a651-37a4-48bb-be69-8bd0cf92f255 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:24.585848 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 925/1824] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:24.585848 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487bee7-1506-4ce5-b4c9-076b397d1981 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:24.600722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487bee7-1506-4ce5-b4c9-076b397d1981 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:24.607667 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6eb77-bb69-426d-a215-c92066820eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:24.608402 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6eb77-bb69-426d-a215-c92066820eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:24.608690 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6eb77-bb69-426d-a215-c92066820eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:24.608972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6eb77-bb69-426d-a215-c92066820eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:24.609830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6eb77-bb69-426d-a215-c92066820eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:24.611502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6eb77-bb69-426d-a215-c92066820eaf admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:24.627291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 926/1825] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:24.628225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6eb77-bb69-426d-a215-c92066820eaf admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:24.640143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-87a6eb77-bb69-426d-a215-c92066820eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:24.669947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e769a651-37a4-48bb-be69-8bd0cf92f255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fead68cf58ca4c19b0d86dea3ca279ee', 'request_id': 'req-e769a651-37a4-48bb-be69-8bd0cf92f255'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:24.676613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e769a651-37a4-48bb-be69-8bd0cf92f255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fead68cf58ca4c19b0d86dea3ca279ee', 'request_id': 'req-e769a651-37a4-48bb-be69-8bd0cf92f255'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:24.694380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e769a651-37a4-48bb-be69-8bd0cf92f255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fead68cf58ca4c19b0d86dea3ca279ee', 'request_id': 'req-e769a651-37a4-48bb-be69-8bd0cf92f255'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:24.719795 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e769a651-37a4-48bb-be69-8bd0cf92f255 admin admin] The token cache is being invalidate because project fead68cf58ca4c19b0d86dea3ca279ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:24.720098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e769a651-37a4-48bb-be69-8bd0cf92f255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:24.723768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e769a651-37a4-48bb-be69-8bd0cf92f255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:24.725835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 900/1826] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:24 2022] DELETE /identity/v3/projects/fead68cf58ca4c19b0d86dea3ca279ee => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:24.729944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769a651-37a4-48bb-be69-8bd0cf92f255 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:24.729944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e769a651-37a4-48bb-be69-8bd0cf92f255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:24.763305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6eb77-bb69-426d-a215-c92066820eaf admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:24.875229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96399a27-ff52-4cc7-9f24-8aaa22bcd3a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:24.877467 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96399a27-ff52-4cc7-9f24-8aaa22bcd3a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:24.878075 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96399a27-ff52-4cc7-9f24-8aaa22bcd3a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:24.879166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96399a27-ff52-4cc7-9f24-8aaa22bcd3a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:24.882622 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-96399a27-ff52-4cc7-9f24-8aaa22bcd3a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:24.894141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:24.900170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769a651-37a4-48bb-be69-8bd0cf92f255 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:24.906646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ad15f-c47b-49e7-b386-79ed61829368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:24.907832 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ad15f-c47b-49e7-b386-79ed61829368 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:24.908532 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ad15f-c47b-49e7-b386-79ed61829368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:24.908933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ad15f-c47b-49e7-b386-79ed61829368 admin admin] PATH_INFO: `/v3/projects/40073bb96a3f4191837937782c3a7ced/users/e6949cb59665403fb43768171258eb9f/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:24.928643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ad15f-c47b-49e7-b386-79ed61829368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40073bb96a3f4191837937782c3a7ced, user_id=e6949cb59665403fb43768171258eb9f, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:24.931555 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ad15f-c47b-49e7-b386-79ed61829368 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:24.948669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 901/1827] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:24 2022] PUT /identity/v3/projects/40073bb96a3f4191837937782c3a7ced/users/e6949cb59665403fb43768171258eb9f/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:24.950670 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ad15f-c47b-49e7-b386-79ed61829368 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:24.953373 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-109ad15f-c47b-49e7-b386-79ed61829368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:24.976426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:24.982748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96399a27-ff52-4cc7-9f24-8aaa22bcd3a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:24.984052 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96399a27-ff52-4cc7-9f24-8aaa22bcd3a3 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:24.994955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 927/1828] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:24.995931 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96399a27-ff52-4cc7-9f24-8aaa22bcd3a3 service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:25.008318 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96399a27-ff52-4cc7-9f24-8aaa22bcd3a3 service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:25.046520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ad15f-c47b-49e7-b386-79ed61829368 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:25.054698 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12a8bc-43ac-4c0f-bb1d-a9b597ccc70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:25.055764 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12a8bc-43ac-4c0f-bb1d-a9b597ccc70e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:25.056095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12a8bc-43ac-4c0f-bb1d-a9b597ccc70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:25.056473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12a8bc-43ac-4c0f-bb1d-a9b597ccc70e admin admin] PATH_INFO: `/v3/users/8a3ad4d7492b488798dbb54fc4900868` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:25.059367 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12a8bc-43ac-4c0f-bb1d-a9b597ccc70e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3ad4d7492b488798dbb54fc4900868)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:25.061596 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12a8bc-43ac-4c0f-bb1d-a9b597ccc70e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:25.114330 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4232f-4664-4f45-b0fe-446a57449af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:25.115212 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4232f-4664-4f45-b0fe-446a57449af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:25.115506 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4232f-4664-4f45-b0fe-446a57449af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:25.115788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4232f-4664-4f45-b0fe-446a57449af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:25.116560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4232f-4664-4f45-b0fe-446a57449af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:25.118294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4232f-4664-4f45-b0fe-446a57449af8 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:25.118760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6b12a8bc-43ac-4c0f-bb1d-a9b597ccc70e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3ad4d7492b488798dbb54fc4900868'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:25.130033 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6b12a8bc-43ac-4c0f-bb1d-a9b597ccc70e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3ad4d7492b488798dbb54fc4900868'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:25.131043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6b12a8bc-43ac-4c0f-bb1d-a9b597ccc70e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3ad4d7492b488798dbb54fc4900868'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:25.139332 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 928/1829] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:25.139332 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4232f-4664-4f45-b0fe-446a57449af8 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:25.141460 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6ea4232f-4664-4f45-b0fe-446a57449af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:25.158241 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6b12a8bc-43ac-4c0f-bb1d-a9b597ccc70e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3ad4d7492b488798dbb54fc4900868'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:25.166286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6b12a8bc-43ac-4c0f-bb1d-a9b597ccc70e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3ad4d7492b488798dbb54fc4900868'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:25.177040 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 902/1830] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:24 2022] DELETE /identity/v3/users/8a3ad4d7492b488798dbb54fc4900868 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:25.178836 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12a8bc-43ac-4c0f-bb1d-a9b597ccc70e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:25.180614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6b12a8bc-43ac-4c0f-bb1d-a9b597ccc70e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:25.219866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4232f-4664-4f45-b0fe-446a57449af8 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:25.288869 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:25.293335 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12a8bc-43ac-4c0f-bb1d-a9b597ccc70e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:25.297365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a98d1-138f-4098-b494-5ce55ab3a629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:25.298217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a98d1-138f-4098-b494-5ce55ab3a629 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:25.298586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a98d1-138f-4098-b494-5ce55ab3a629 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:25.298953 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a98d1-138f-4098-b494-5ce55ab3a629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:25.299953 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03431c12-bf86-47d2-a76d-53c6cebdcf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:25.301104 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1a7a98d1-138f-4098-b494-5ce55ab3a629 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:25.301459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03431c12-bf86-47d2-a76d-53c6cebdcf52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:25.302167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03431c12-bf86-47d2-a76d-53c6cebdcf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:25.302679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03431c12-bf86-47d2-a76d-53c6cebdcf52 admin admin] PATH_INFO: `/v3/projects/40073bb96a3f4191837937782c3a7ced/users/e6949cb59665403fb43768171258eb9f/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:25.305390 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03431c12-bf86-47d2-a76d-53c6cebdcf52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40073bb96a3f4191837937782c3a7ced, user_id=e6949cb59665403fb43768171258eb9f, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:25.311044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03431c12-bf86-47d2-a76d-53c6cebdcf52 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:25.328286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 903/1831] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:25 2022] PUT /identity/v3/projects/40073bb96a3f4191837937782c3a7ced/users/e6949cb59665403fb43768171258eb9f/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:25.343101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a2e35-3267-4ddd-aeea-83c1130a9cb4 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:25.343398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a2e35-3267-4ddd-aeea-83c1130a9cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:25.345143 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a2e35-3267-4ddd-aeea-83c1130a9cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:25.387979 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9c2a2e35-3267-4ddd-aeea-83c1130a9cb4 None None] MFA Rules not processed for user `e6949cb59665403fb43768171258eb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:25.390742 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9c2a2e35-3267-4ddd-aeea-83c1130a9cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:25.418781 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a98d1-138f-4098-b494-5ce55ab3a629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:25.420281 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a98d1-138f-4098-b494-5ce55ab3a629 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:25.426510 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:25.432599 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 929/1832] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:25.542962 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 904/1833] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:25.571761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a98d1-138f-4098-b494-5ce55ab3a629 service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:25.573373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1a7a98d1-138f-4098-b494-5ce55ab3a629 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:25.596794 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a98d1-138f-4098-b494-5ce55ab3a629 service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:25.701213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67116bf7-70a6-4279-af5d-90e3a04f0840 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:25.701987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67116bf7-70a6-4279-af5d-90e3a04f0840 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:25.702274 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67116bf7-70a6-4279-af5d-90e3a04f0840 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:25.702662 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67116bf7-70a6-4279-af5d-90e3a04f0840 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:25.722268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67116bf7-70a6-4279-af5d-90e3a04f0840 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:25.724492 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67116bf7-70a6-4279-af5d-90e3a04f0840 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:25.736895 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 930/1834] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:25.807978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a2e35-3267-4ddd-aeea-83c1130a9cb4 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:25.824511 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67116bf7-70a6-4279-af5d-90e3a04f0840 service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:25.826934 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-67116bf7-70a6-4279-af5d-90e3a04f0840 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:25.828099 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a2e35-3267-4ddd-aeea-83c1130a9cb4 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:25.833036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024a571-dad4-48b0-a021-41917c9167bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:25.834522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024a571-dad4-48b0-a021-41917c9167bc service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:25.834978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024a571-dad4-48b0-a021-41917c9167bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:25.835464 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024a571-dad4-48b0-a021-41917c9167bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:25.837906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c024a571-dad4-48b0-a021-41917c9167bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:25.951014 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024a571-dad4-48b0-a021-41917c9167bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:25.953628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c024a571-dad4-48b0-a021-41917c9167bc service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:25.968370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 905/1835] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:25.976952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67116bf7-70a6-4279-af5d-90e3a04f0840 service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:25.982452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:25.983193 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:25.983546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:25.984467 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa admin admin] PATH_INFO: `/v3/projects/84eae75402264415a5269ebdfa332bc8` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:25.985301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=84eae75402264415a5269ebdfa332bc8)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:25.987340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:26.056880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84eae75402264415a5269ebdfa332bc8', 'request_id': 'req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:26.064285 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84eae75402264415a5269ebdfa332bc8', 'request_id': 'req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:26.071238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84eae75402264415a5269ebdfa332bc8', 'request_id': 'req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:26.085333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa admin admin] The token cache is being invalidate because project 84eae75402264415a5269ebdfa332bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:26.085632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:26.086262 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:26.087843 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 931/1836] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:25 2022] DELETE /identity/v3/projects/84eae75402264415a5269ebdfa332bc8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:26.093092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3657bad-0a91-4b14-b0ab-e58b8c696254 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:26.093380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3657bad-0a91-4b14-b0ab-e58b8c696254 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:26.093657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3657bad-0a91-4b14-b0ab-e58b8c696254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:26.148178 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d3657bad-0a91-4b14-b0ab-e58b8c696254 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:26.149342 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d3657bad-0a91-4b14-b0ab-e58b8c696254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:26.286068 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:26.288829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:26.296147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 906/1837] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:26.302586 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283a354-ea9b-4684-ba98-407f9e110534 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:26.303102 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283a354-ea9b-4684-ba98-407f9e110534 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:26.303481 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283a354-ea9b-4684-ba98-407f9e110534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:26.317732 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4234c0f-7d2e-44c2-ac5d-cda36ec036aa admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:26.330132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6283a354-ea9b-4684-ba98-407f9e110534 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:26.331538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6283a354-ea9b-4684-ba98-407f9e110534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:26.332484 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc834a1-9b49-4657-92fc-6bdcf0d56463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:26.333447 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc834a1-9b49-4657-92fc-6bdcf0d56463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:26.334424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc834a1-9b49-4657-92fc-6bdcf0d56463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:26.335258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc834a1-9b49-4657-92fc-6bdcf0d56463 admin admin] PATH_INFO: `/v3/users/2941a9d547ce469691cee5eb3adc6bfa` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:26.337711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc834a1-9b49-4657-92fc-6bdcf0d56463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2941a9d547ce469691cee5eb3adc6bfa)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:26.345413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc834a1-9b49-4657-92fc-6bdcf0d56463 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:26.346787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 907/1838] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:26.350981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283a354-ea9b-4684-ba98-407f9e110534 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:26.364137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283a354-ea9b-4684-ba98-407f9e110534 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:26.370658 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36271912-0324-4224-a44c-e5ca15a185d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:26.372405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36271912-0324-4224-a44c-e5ca15a185d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:26.372548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36271912-0324-4224-a44c-e5ca15a185d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:26.373222 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36271912-0324-4224-a44c-e5ca15a185d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:26.374108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36271912-0324-4224-a44c-e5ca15a185d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:26.374550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36271912-0324-4224-a44c-e5ca15a185d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:26.377840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36271912-0324-4224-a44c-e5ca15a185d2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:26.384028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:26.403379 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 908/1839] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:18:26.405536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36271912-0324-4224-a44c-e5ca15a185d2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:26.418454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:26.422596 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36271912-0324-4224-a44c-e5ca15a185d2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:26.431760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220dcd8-0c95-4ba3-9315-e4ef8a9416de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:26.431760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220dcd8-0c95-4ba3-9315-e4ef8a9416de admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:26.431760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220dcd8-0c95-4ba3-9315-e4ef8a9416de admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:26.434213 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220dcd8-0c95-4ba3-9315-e4ef8a9416de admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:26.434213 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220dcd8-0c95-4ba3-9315-e4ef8a9416de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:26.435455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220dcd8-0c95-4ba3-9315-e4ef8a9416de admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:26.483483 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3dc834a1-9b49-4657-92fc-6bdcf0d56463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2941a9d547ce469691cee5eb3adc6bfa'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:26.497564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 909/1840] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:26 2022] POST /identity/v3/projects => generated 401 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:26.499804 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220dcd8-0c95-4ba3-9315-e4ef8a9416de admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:26.505833 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3dc834a1-9b49-4657-92fc-6bdcf0d56463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2941a9d547ce469691cee5eb3adc6bfa'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:26.517373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3dc834a1-9b49-4657-92fc-6bdcf0d56463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2941a9d547ce469691cee5eb3adc6bfa'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:26.583584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3dc834a1-9b49-4657-92fc-6bdcf0d56463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2941a9d547ce469691cee5eb3adc6bfa'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:26.612883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3dc834a1-9b49-4657-92fc-6bdcf0d56463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2941a9d547ce469691cee5eb3adc6bfa'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:26.613495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220dcd8-0c95-4ba3-9315-e4ef8a9416de admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:26.619699 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584220ed-61c3-4b43-89fe-ee9f33df3c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:26.620562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584220ed-61c3-4b43-89fe-ee9f33df3c21 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:26.620963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584220ed-61c3-4b43-89fe-ee9f33df3c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:26.621338 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584220ed-61c3-4b43-89fe-ee9f33df3c21 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:26.622184 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584220ed-61c3-4b43-89fe-ee9f33df3c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:26.632325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584220ed-61c3-4b43-89fe-ee9f33df3c21 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:26.639565 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 932/1841] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:26 2022] DELETE /identity/v3/users/2941a9d547ce469691cee5eb3adc6bfa => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:26.644310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f3456-ef82-4568-8cc2-df0e179ce93e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:26.644712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f3456-ef82-4568-8cc2-df0e179ce93e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:26.645115 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f3456-ef82-4568-8cc2-df0e179ce93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:26.661731 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 910/1842] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:26 2022] POST /identity/v3/users => generated 301 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:26.667040 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584220ed-61c3-4b43-89fe-ee9f33df3c21 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:26.670918 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-584220ed-61c3-4b43-89fe-ee9f33df3c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:26.693776 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584220ed-61c3-4b43-89fe-ee9f33df3c21 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:26.713995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-010f3456-ef82-4568-8cc2-df0e179ce93e None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:26.720448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-010f3456-ef82-4568-8cc2-df0e179ce93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:26.769223 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e78b7c-7041-4103-a541-9b72b347984f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:26.769965 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e78b7c-7041-4103-a541-9b72b347984f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:26.770140 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e78b7c-7041-4103-a541-9b72b347984f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:26.770577 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e78b7c-7041-4103-a541-9b72b347984f admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:26.771334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e78b7c-7041-4103-a541-9b72b347984f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:26.773045 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e78b7c-7041-4103-a541-9b72b347984f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:26.795845 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 911/1843] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:26.797518 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e78b7c-7041-4103-a541-9b72b347984f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:26.803537 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 933/1844] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:26.811517 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e78b7c-7041-4103-a541-9b72b347984f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:26.817429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8644b-0a34-4c0a-b475-172adf285e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:26.818213 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8644b-0a34-4c0a-b475-172adf285e79 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:26.818599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8644b-0a34-4c0a-b475-172adf285e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:26.818943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8644b-0a34-4c0a-b475-172adf285e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:26.819752 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8644b-0a34-4c0a-b475-172adf285e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:26.821442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8644b-0a34-4c0a-b475-172adf285e79 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:26.821556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f3456-ef82-4568-8cc2-df0e179ce93e None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:26.823625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-010f3456-ef82-4568-8cc2-df0e179ce93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:26.836954 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 912/1845] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:26.837948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8644b-0a34-4c0a-b475-172adf285e79 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:26.849618 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8644b-0a34-4c0a-b475-172adf285e79 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:26.866547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004bf6b-5168-4bf1-9a99-0f71db659418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:26.867910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004bf6b-5168-4bf1-9a99-0f71db659418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:26.868200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004bf6b-5168-4bf1-9a99-0f71db659418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:26.868535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004bf6b-5168-4bf1-9a99-0f71db659418 admin admin] PATH_INFO: `/v3/projects/e4a302d66f3a4bde815d9b476db88fc6/users/452c3b5ff194432eb88e975d9ed8e746/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:26.889152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004bf6b-5168-4bf1-9a99-0f71db659418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a302d66f3a4bde815d9b476db88fc6, user_id=452c3b5ff194432eb88e975d9ed8e746, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:26.893150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004bf6b-5168-4bf1-9a99-0f71db659418 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:26.898642 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f3456-ef82-4568-8cc2-df0e179ce93e None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:26.904141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce661f81-7fd9-4828-b9fe-70d7e408a53f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:26.905110 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce661f81-7fd9-4828-b9fe-70d7e408a53f service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:26.905405 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce661f81-7fd9-4828-b9fe-70d7e408a53f service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:26.905681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce661f81-7fd9-4828-b9fe-70d7e408a53f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:26.914102 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 913/1846] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:26 2022] PUT /identity/v3/projects/e4a302d66f3a4bde815d9b476db88fc6/users/452c3b5ff194432eb88e975d9ed8e746/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:26.931509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c11d0b-acf6-4355-b92c-67774bf1b421 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:26.931962 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c11d0b-acf6-4355-b92c-67774bf1b421 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:26.932327 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c11d0b-acf6-4355-b92c-67774bf1b421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:26.937266 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce661f81-7fd9-4828-b9fe-70d7e408a53f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:26.940346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce661f81-7fd9-4828-b9fe-70d7e408a53f service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:26.956714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 934/1847] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:26.973913 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-43c11d0b-acf6-4355-b92c-67774bf1b421 None None] MFA Rules not processed for user `452c3b5ff194432eb88e975d9ed8e746`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:26.976691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-43c11d0b-acf6-4355-b92c-67774bf1b421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:26.992474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:27.066111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 914/1848] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:27.067358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce661f81-7fd9-4828-b9fe-70d7e408a53f service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:27.080894 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce661f81-7fd9-4828-b9fe-70d7e408a53f service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:27.164216 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:27.182872 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229ac2f-463c-4869-8dc4-26b9dc605b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:27.183827 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229ac2f-463c-4869-8dc4-26b9dc605b1d admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:27.184207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229ac2f-463c-4869-8dc4-26b9dc605b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:27.184735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229ac2f-463c-4869-8dc4-26b9dc605b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:27.185722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229ac2f-463c-4869-8dc4-26b9dc605b1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:27.190417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229ac2f-463c-4869-8dc4-26b9dc605b1d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:27.244186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 935/1849] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:27 2022] POST /identity/v3/projects => generated 401 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:27.254913 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c11d0b-acf6-4355-b92c-67774bf1b421 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:27.276133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c11d0b-acf6-4355-b92c-67774bf1b421 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:27.403056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426321d8-981b-4d8b-81b9-e101aa391999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:27.411741 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426321d8-981b-4d8b-81b9-e101aa391999 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:27.412043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426321d8-981b-4d8b-81b9-e101aa391999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:27.412356 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426321d8-981b-4d8b-81b9-e101aa391999 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:27.413061 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426321d8-981b-4d8b-81b9-e101aa391999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:27.415296 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426321d8-981b-4d8b-81b9-e101aa391999 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:27.447925 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 915/1850] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:27 2022] POST /identity/v3/users => generated 307 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:27.451908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229ac2f-463c-4869-8dc4-26b9dc605b1d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:27.471010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229ac2f-463c-4869-8dc4-26b9dc605b1d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:27.485905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5fea8-a3b6-4a09-8455-a036a65d15da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:27.486787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5fea8-a3b6-4a09-8455-a036a65d15da admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:27.487110 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5fea8-a3b6-4a09-8455-a036a65d15da admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:27.487355 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5fea8-a3b6-4a09-8455-a036a65d15da admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:27.488147 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5fea8-a3b6-4a09-8455-a036a65d15da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:27.489823 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5fea8-a3b6-4a09-8455-a036a65d15da admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:27.502765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 936/1851] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:18:27.507493 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426321d8-981b-4d8b-81b9-e101aa391999 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:27.521661 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426321d8-981b-4d8b-81b9-e101aa391999 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:27.528892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdf0c2-9bab-4257-8d94-3dd44017c18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:27.530428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdf0c2-9bab-4257-8d94-3dd44017c18c admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:27.530428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdf0c2-9bab-4257-8d94-3dd44017c18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:27.530428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdf0c2-9bab-4257-8d94-3dd44017c18c admin admin] PATH_INFO: `/v3/projects/ed6018c8cf9242718cc00d230f472b8e/users/a38c05bbdaf748e09797acb20e1ecbc0/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:27.560387 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdf0c2-9bab-4257-8d94-3dd44017c18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6018c8cf9242718cc00d230f472b8e, user_id=a38c05bbdaf748e09797acb20e1ecbc0, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:27.565654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdf0c2-9bab-4257-8d94-3dd44017c18c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:27.566659 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5fea8-a3b6-4a09-8455-a036a65d15da admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:27.568397 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-37b5fea8-a3b6-4a09-8455-a036a65d15da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:27.584121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5fea8-a3b6-4a09-8455-a036a65d15da admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:27.587390 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 916/1852] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:27 2022] PUT /identity/v3/projects/ed6018c8cf9242718cc00d230f472b8e/users/a38c05bbdaf748e09797acb20e1ecbc0/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:27.591458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdf0c2-9bab-4257-8d94-3dd44017c18c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:27.699536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdf0c2-9bab-4257-8d94-3dd44017c18c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:27.712298 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcccb71-48b1-400d-911a-55d04081d7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:27.712993 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcccb71-48b1-400d-911a-55d04081d7fb admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:27.713317 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcccb71-48b1-400d-911a-55d04081d7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:27.713722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcccb71-48b1-400d-911a-55d04081d7fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:27.716925 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcccb71-48b1-400d-911a-55d04081d7fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:27.718624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcccb71-48b1-400d-911a-55d04081d7fb admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:27.733397 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261c0d3-012d-4ef5-9fcd-46771f13071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:27.733397 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261c0d3-012d-4ef5-9fcd-46771f13071e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:27.733922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261c0d3-012d-4ef5-9fcd-46771f13071e admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:27.733922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261c0d3-012d-4ef5-9fcd-46771f13071e admin admin] PATH_INFO: `/v3/projects/8410988607bb411b896913e7bf9f0bfd` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:27.735341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261c0d3-012d-4ef5-9fcd-46771f13071e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8410988607bb411b896913e7bf9f0bfd)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:27.737942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261c0d3-012d-4ef5-9fcd-46771f13071e admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:27.754947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 917/1853] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:27.761407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcccb71-48b1-400d-911a-55d04081d7fb admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:27.790217 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcccb71-48b1-400d-911a-55d04081d7fb admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:27.802030 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24cf65-e71b-45d3-a478-0abffac94ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:27.803338 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24cf65-e71b-45d3-a478-0abffac94ced admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:27.803791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24cf65-e71b-45d3-a478-0abffac94ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:27.804229 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24cf65-e71b-45d3-a478-0abffac94ced admin admin] PATH_INFO: `/v3/projects/ed6018c8cf9242718cc00d230f472b8e/users/a38c05bbdaf748e09797acb20e1ecbc0/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:27.809915 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24cf65-e71b-45d3-a478-0abffac94ced admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6018c8cf9242718cc00d230f472b8e, user_id=a38c05bbdaf748e09797acb20e1ecbc0, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:27.819898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24cf65-e71b-45d3-a478-0abffac94ced admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:27.824902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1261c0d3-012d-4ef5-9fcd-46771f13071e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8410988607bb411b896913e7bf9f0bfd', 'request_id': 'req-1261c0d3-012d-4ef5-9fcd-46771f13071e'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:27.832306 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1261c0d3-012d-4ef5-9fcd-46771f13071e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8410988607bb411b896913e7bf9f0bfd', 'request_id': 'req-1261c0d3-012d-4ef5-9fcd-46771f13071e'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:27.836093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 918/1854] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:27 2022] PUT /identity/v3/projects/ed6018c8cf9242718cc00d230f472b8e/users/a38c05bbdaf748e09797acb20e1ecbc0/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:27.848190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1261c0d3-012d-4ef5-9fcd-46771f13071e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8410988607bb411b896913e7bf9f0bfd', 'request_id': 'req-1261c0d3-012d-4ef5-9fcd-46771f13071e'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:27.850423 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0623f-2bfa-455b-ac38-8281b485307e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:27.850710 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0623f-2bfa-455b-ac38-8281b485307e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:27.851286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0623f-2bfa-455b-ac38-8281b485307e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:27.860547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:27.860951 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1261c0d3-012d-4ef5-9fcd-46771f13071e admin admin] The token cache is being invalidate because project 8410988607bb411b896913e7bf9f0bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:27.861426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1261c0d3-012d-4ef5-9fcd-46771f13071e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:27.863160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1261c0d3-012d-4ef5-9fcd-46771f13071e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:27.878173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 937/1855] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:27 2022] DELETE /identity/v3/projects/8410988607bb411b896913e7bf9f0bfd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:27.881936 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261c0d3-012d-4ef5-9fcd-46771f13071e admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:27.883596 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1261c0d3-012d-4ef5-9fcd-46771f13071e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:27.906243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cdb0623f-2bfa-455b-ac38-8281b485307e None None] MFA Rules not processed for user `a38c05bbdaf748e09797acb20e1ecbc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:27.908227 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cdb0623f-2bfa-455b-ac38-8281b485307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:27.950860 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:27.966113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261c0d3-012d-4ef5-9fcd-46771f13071e admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:28.053179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 919/1856] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:27 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:28.090837 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853bd94-a32b-4e78-a340-be98e81d02d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:28.091979 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853bd94-a32b-4e78-a340-be98e81d02d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:28.092312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853bd94-a32b-4e78-a340-be98e81d02d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:28.092991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853bd94-a32b-4e78-a340-be98e81d02d4 admin admin] PATH_INFO: `/v3/users/cddeeb59bb5a4ca19b12d7f22a24da02` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:28.094751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853bd94-a32b-4e78-a340-be98e81d02d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cddeeb59bb5a4ca19b12d7f22a24da02)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:28.097225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853bd94-a32b-4e78-a340-be98e81d02d4 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:28.135347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0623f-2bfa-455b-ac38-8281b485307e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:28.136794 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cdb0623f-2bfa-455b-ac38-8281b485307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:28.183043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3853bd94-a32b-4e78-a340-be98e81d02d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cddeeb59bb5a4ca19b12d7f22a24da02'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:28.196686 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3853bd94-a32b-4e78-a340-be98e81d02d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cddeeb59bb5a4ca19b12d7f22a24da02'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:28.198478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3853bd94-a32b-4e78-a340-be98e81d02d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cddeeb59bb5a4ca19b12d7f22a24da02'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:28.216328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3853bd94-a32b-4e78-a340-be98e81d02d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cddeeb59bb5a4ca19b12d7f22a24da02'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:28.223840 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3853bd94-a32b-4e78-a340-be98e81d02d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cddeeb59bb5a4ca19b12d7f22a24da02'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:28.231382 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 938/1857] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:27 2022] DELETE /identity/v3/users/cddeeb59bb5a4ca19b12d7f22a24da02 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:28.237851 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0623f-2bfa-455b-ac38-8281b485307e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:28.306463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc9e98-a12c-46ac-9d82-7d96976df16e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:28.307264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9e98-a12c-46ac-9d82-7d96976df16e service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:28.307601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9e98-a12c-46ac-9d82-7d96976df16e service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:28.307954 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9e98-a12c-46ac-9d82-7d96976df16e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:28.310229 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-48bc9e98-a12c-46ac-9d82-7d96976df16e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:28.407136 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:28.412075 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc9e98-a12c-46ac-9d82-7d96976df16e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:28.414197 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc9e98-a12c-46ac-9d82-7d96976df16e service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:28.433128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 920/1858] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:28 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:28.611754 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853bd94-a32b-4e78-a340-be98e81d02d4 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:28.617073 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3853bd94-a32b-4e78-a340-be98e81d02d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:28.634959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853bd94-a32b-4e78-a340-be98e81d02d4 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:28.647104 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f5a22-afba-4810-ad3c-56cfab1c25be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:28.648126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f5a22-afba-4810-ad3c-56cfab1c25be service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:28.648419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f5a22-afba-4810-ad3c-56cfab1c25be service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:28.648796 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f5a22-afba-4810-ad3c-56cfab1c25be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:28.651372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c39f5a22-afba-4810-ad3c-56cfab1c25be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:28.749460 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f5a22-afba-4810-ad3c-56cfab1c25be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:28.750988 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f5a22-afba-4810-ad3c-56cfab1c25be service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:28.761281 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 939/1859] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:28 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:28.775983 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc9e98-a12c-46ac-9d82-7d96976df16e service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:28.777834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-48bc9e98-a12c-46ac-9d82-7d96976df16e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:28.863941 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc9e98-a12c-46ac-9d82-7d96976df16e service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:28.873081 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676867e8-b266-49e7-b546-313728343c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:28.874101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676867e8-b266-49e7-b546-313728343c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:28.874409 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676867e8-b266-49e7-b546-313728343c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:28.875697 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676867e8-b266-49e7-b546-313728343c03 admin admin] PATH_INFO: `/v3/projects/276c5446bc334b9397d645ed492144c1` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:28.879055 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676867e8-b266-49e7-b546-313728343c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=276c5446bc334b9397d645ed492144c1)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:28.882552 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676867e8-b266-49e7-b546-313728343c03 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:28.957510 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-676867e8-b266-49e7-b546-313728343c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276c5446bc334b9397d645ed492144c1', 'request_id': 'req-676867e8-b266-49e7-b546-313728343c03'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:28.964718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-676867e8-b266-49e7-b546-313728343c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276c5446bc334b9397d645ed492144c1', 'request_id': 'req-676867e8-b266-49e7-b546-313728343c03'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:28.982691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-676867e8-b266-49e7-b546-313728343c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276c5446bc334b9397d645ed492144c1', 'request_id': 'req-676867e8-b266-49e7-b546-313728343c03'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:29.014957 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-676867e8-b266-49e7-b546-313728343c03 admin admin] The token cache is being invalidate because project 276c5446bc334b9397d645ed492144c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:29.015260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-676867e8-b266-49e7-b546-313728343c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:29.016114 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-676867e8-b266-49e7-b546-313728343c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:29.021835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 921/1860] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:28 2022] DELETE /identity/v3/projects/276c5446bc334b9397d645ed492144c1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:29.031409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68cfd1-d06e-4295-a334-ff45ce42e109 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:29.032268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68cfd1-d06e-4295-a334-ff45ce42e109 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:29.032377 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68cfd1-d06e-4295-a334-ff45ce42e109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:29.077095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-cd68cfd1-d06e-4295-a334-ff45ce42e109 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:29.082255 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-cd68cfd1-d06e-4295-a334-ff45ce42e109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:29.114809 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:29.243054 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 940/1861] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:29.250079 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e737-a1b9-4980-b818-748fe13126fe None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:29.250534 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e737-a1b9-4980-b818-748fe13126fe None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:29.251018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e737-a1b9-4980-b818-748fe13126fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:29.305777 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3885e737-a1b9-4980-b818-748fe13126fe None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:29.307173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3885e737-a1b9-4980-b818-748fe13126fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:29.330302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 922/1862] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:29.334353 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68cfd1-d06e-4295-a334-ff45ce42e109 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:29.346197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68cfd1-d06e-4295-a334-ff45ce42e109 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:29.352942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20f49b-4afe-46c1-8ebd-8b8f56b1e3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:29.354410 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20f49b-4afe-46c1-8ebd-8b8f56b1e3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:29.354410 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20f49b-4afe-46c1-8ebd-8b8f56b1e3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:29.354410 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20f49b-4afe-46c1-8ebd-8b8f56b1e3c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:29.355340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20f49b-4afe-46c1-8ebd-8b8f56b1e3c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:29.356010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20f49b-4afe-46c1-8ebd-8b8f56b1e3c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:29.358218 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20f49b-4afe-46c1-8ebd-8b8f56b1e3c0 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:29.374760 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 941/1863] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:29.381025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885e737-a1b9-4980-b818-748fe13126fe None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:29.394846 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885e737-a1b9-4980-b818-748fe13126fe None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:29.403806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20f49b-4afe-46c1-8ebd-8b8f56b1e3c0 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:29.406298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ad20f49b-4afe-46c1-8ebd-8b8f56b1e3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:29.415044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e478ed9-4c76-4326-a700-60711514a167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:29.415724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e478ed9-4c76-4326-a700-60711514a167 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:29.419532 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e478ed9-4c76-4326-a700-60711514a167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:29.419802 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e478ed9-4c76-4326-a700-60711514a167 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:29.420784 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e478ed9-4c76-4326-a700-60711514a167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:29.424271 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e478ed9-4c76-4326-a700-60711514a167 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:29.434915 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20f49b-4afe-46c1-8ebd-8b8f56b1e3c0 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:29.447923 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82d248-6a4a-4be9-9048-ca4ebc4e3cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:29.449895 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82d248-6a4a-4be9-9048-ca4ebc4e3cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:29.450190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82d248-6a4a-4be9-9048-ca4ebc4e3cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:29.450561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82d248-6a4a-4be9-9048-ca4ebc4e3cca admin admin] PATH_INFO: `/v3/users/223d4d9321dd4b3fb2f514bf53e1e4be` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:29.451957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82d248-6a4a-4be9-9048-ca4ebc4e3cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=223d4d9321dd4b3fb2f514bf53e1e4be)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:29.454157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82d248-6a4a-4be9-9048-ca4ebc4e3cca admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:29.464526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 923/1864] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:29 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:29.468782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e478ed9-4c76-4326-a700-60711514a167 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:29.540531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-0d82d248-6a4a-4be9-9048-ca4ebc4e3cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '223d4d9321dd4b3fb2f514bf53e1e4be'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:29.552166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-0d82d248-6a4a-4be9-9048-ca4ebc4e3cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '223d4d9321dd4b3fb2f514bf53e1e4be'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:29.553225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-0d82d248-6a4a-4be9-9048-ca4ebc4e3cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '223d4d9321dd4b3fb2f514bf53e1e4be'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:29.567656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-0d82d248-6a4a-4be9-9048-ca4ebc4e3cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '223d4d9321dd4b3fb2f514bf53e1e4be'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:29.577415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-0d82d248-6a4a-4be9-9048-ca4ebc4e3cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '223d4d9321dd4b3fb2f514bf53e1e4be'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:29.586944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 942/1865] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:29 2022] DELETE /identity/v3/users/223d4d9321dd4b3fb2f514bf53e1e4be => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:29.590197 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:29.591081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9289d1-aae4-446b-b19e-78e3dd240ddd None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:29.591420 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9289d1-aae4-446b-b19e-78e3dd240ddd None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:29.593235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9289d1-aae4-446b-b19e-78e3dd240ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:29.600210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e478ed9-4c76-4326-a700-60711514a167 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:29.626432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-2a9289d1-aae4-446b-b19e-78e3dd240ddd None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:29.627745 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2a9289d1-aae4-446b-b19e-78e3dd240ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:29.751358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b761e68-c865-4ada-b01d-c39a050e8c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:29.752375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b761e68-c865-4ada-b01d-c39a050e8c85 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:29.752640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b761e68-c865-4ada-b01d-c39a050e8c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:29.752962 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b761e68-c865-4ada-b01d-c39a050e8c85 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:29.753682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b761e68-c865-4ada-b01d-c39a050e8c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:29.755919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b761e68-c865-4ada-b01d-c39a050e8c85 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:29.792169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 924/1866] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:29 2022] POST /identity/v3/users => generated 294 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:29.795309 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b761e68-c865-4ada-b01d-c39a050e8c85 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:29.798115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4b761e68-c865-4ada-b01d-c39a050e8c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:29.817008 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b761e68-c865-4ada-b01d-c39a050e8c85 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:29.824392 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c87f86-e4c8-4292-8c18-95417f43b21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:29.825248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c87f86-e4c8-4292-8c18-95417f43b21d admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:29.825455 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 943/1867] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:29.825901 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c87f86-e4c8-4292-8c18-95417f43b21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:29.826458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c87f86-e4c8-4292-8c18-95417f43b21d admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:29.827357 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c87f86-e4c8-4292-8c18-95417f43b21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:29.830263 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c87f86-e4c8-4292-8c18-95417f43b21d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:29.848953 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 925/1868] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:18:29.851019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9289d1-aae4-446b-b19e-78e3dd240ddd None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:29.852197 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c87f86-e4c8-4292-8c18-95417f43b21d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:29.855768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f7c87f86-e4c8-4292-8c18-95417f43b21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:29.866170 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9289d1-aae4-446b-b19e-78e3dd240ddd None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:29.879974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590fc78-da44-4ba3-a655-ac072292ce7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:29.881134 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590fc78-da44-4ba3-a655-ac072292ce7d admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:29.882664 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590fc78-da44-4ba3-a655-ac072292ce7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:29.884177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590fc78-da44-4ba3-a655-ac072292ce7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:29.885198 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590fc78-da44-4ba3-a655-ac072292ce7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:29.888725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590fc78-da44-4ba3-a655-ac072292ce7d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:29.922980 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 944/1869] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:29.925075 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590fc78-da44-4ba3-a655-ac072292ce7d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:29.954566 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590fc78-da44-4ba3-a655-ac072292ce7d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:29.964856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b0f63-4f95-4bc6-b890-0c33f46ec729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:29.967037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b0f63-4f95-4bc6-b890-0c33f46ec729 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:29.967330 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b0f63-4f95-4bc6-b890-0c33f46ec729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:29.967615 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b0f63-4f95-4bc6-b890-0c33f46ec729 admin admin] PATH_INFO: `/v3/projects/b42e457d78e8453b8029049676b8e230/users/4923f990013f4f299d0ac1d1823d99bb/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:29.971745 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:29.978976 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c87f86-e4c8-4292-8c18-95417f43b21d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:29.988252 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55675e62-8ac8-4f4e-af65-deca3dea85fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:29.991328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55675e62-8ac8-4f4e-af65-deca3dea85fe service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:29.992379 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55675e62-8ac8-4f4e-af65-deca3dea85fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:29.993443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55675e62-8ac8-4f4e-af65-deca3dea85fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:29.996995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b0f63-4f95-4bc6-b890-0c33f46ec729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b42e457d78e8453b8029049676b8e230, user_id=4923f990013f4f299d0ac1d1823d99bb, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:30.001164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b0f63-4f95-4bc6-b890-0c33f46ec729 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:30.028502 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55675e62-8ac8-4f4e-af65-deca3dea85fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:30.029986 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55675e62-8ac8-4f4e-af65-deca3dea85fe service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:30.037559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 945/1870] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:29 2022] PUT /identity/v3/projects/b42e457d78e8453b8029049676b8e230/users/4923f990013f4f299d0ac1d1823d99bb/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:30.040172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd732f0f-e649-4abc-b377-38940642cea9 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:30.040506 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd732f0f-e649-4abc-b377-38940642cea9 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:30.040839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd732f0f-e649-4abc-b377-38940642cea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:30.055761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 926/1871] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:30.089044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-cd732f0f-e649-4abc-b377-38940642cea9 None None] MFA Rules not processed for user `4923f990013f4f299d0ac1d1823d99bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:30.090836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-cd732f0f-e649-4abc-b377-38940642cea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:30.104727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55675e62-8ac8-4f4e-af65-deca3dea85fe service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:30.106279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-55675e62-8ac8-4f4e-af65-deca3dea85fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:30.129914 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55675e62-8ac8-4f4e-af65-deca3dea85fe service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:30.193821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 946/1872] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:30.195398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd732f0f-e649-4abc-b377-38940642cea9 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:30.210862 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b7ed3-927d-4e29-9fd6-cad0738977f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:30.211846 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b7ed3-927d-4e29-9fd6-cad0738977f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:30.212202 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b7ed3-927d-4e29-9fd6-cad0738977f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:30.212485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b7ed3-927d-4e29-9fd6-cad0738977f9 admin admin] PATH_INFO: `/v3/users/7d53ed9e8c4546a189ffed17afaa547c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:30.213726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b7ed3-927d-4e29-9fd6-cad0738977f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d53ed9e8c4546a189ffed17afaa547c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:30.216711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b7ed3-927d-4e29-9fd6-cad0738977f9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:30.271935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:30.313773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd732f0f-e649-4abc-b377-38940642cea9 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:30.317892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b8b7ed3-927d-4e29-9fd6-cad0738977f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d53ed9e8c4546a189ffed17afaa547c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:30.327456 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991919f-ac79-4467-9fb2-206baa1f5b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:30.328158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991919f-ac79-4467-9fb2-206baa1f5b8e admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:30.337045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991919f-ac79-4467-9fb2-206baa1f5b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:30.337045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991919f-ac79-4467-9fb2-206baa1f5b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:30.337045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991919f-ac79-4467-9fb2-206baa1f5b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:30.337045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991919f-ac79-4467-9fb2-206baa1f5b8e admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:30.337454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b8b7ed3-927d-4e29-9fd6-cad0738977f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d53ed9e8c4546a189ffed17afaa547c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:30.337454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b8b7ed3-927d-4e29-9fd6-cad0738977f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d53ed9e8c4546a189ffed17afaa547c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:30.369042 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b8b7ed3-927d-4e29-9fd6-cad0738977f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d53ed9e8c4546a189ffed17afaa547c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:30.388676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b8b7ed3-927d-4e29-9fd6-cad0738977f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d53ed9e8c4546a189ffed17afaa547c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:30.410433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 927/1873] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:30 2022] DELETE /identity/v3/users/7d53ed9e8c4546a189ffed17afaa547c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:30.410640 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 947/1874] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:30 2022] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:30.416242 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6072a-54fe-4549-903e-fe63be34f711 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:30.416567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6072a-54fe-4549-903e-fe63be34f711 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:30.416808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6072a-54fe-4549-903e-fe63be34f711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:30.426573 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b7ed3-927d-4e29-9fd6-cad0738977f9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:30.428337 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7b8b7ed3-927d-4e29-9fd6-cad0738977f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:30.494729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-0ba6072a-54fe-4549-903e-fe63be34f711 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:30.496255 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-0ba6072a-54fe-4549-903e-fe63be34f711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:30.600881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:30.602178 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b7ed3-927d-4e29-9fd6-cad0738977f9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:30.614754 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b9858-9d1d-413c-a077-792fd6a2b3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:30.615295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b9858-9d1d-413c-a077-792fd6a2b3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:30.615585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b9858-9d1d-413c-a077-792fd6a2b3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:30.615895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b9858-9d1d-413c-a077-792fd6a2b3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:30.616623 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b9858-9d1d-413c-a077-792fd6a2b3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:30.617333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 948/1875] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:30.621887 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b9858-9d1d-413c-a077-792fd6a2b3d8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:30.643347 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6072a-54fe-4549-903e-fe63be34f711 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:30.646584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-0ba6072a-54fe-4549-903e-fe63be34f711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:30.684036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 928/1876] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:30 2022] POST /identity/v3/users => generated 300 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:30.685724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b9858-9d1d-413c-a077-792fd6a2b3d8 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:30.716769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b9858-9d1d-413c-a077-792fd6a2b3d8 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:30.742247 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88464124-d5fe-4478-930d-51f8a31f9b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:30.743117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464124-d5fe-4478-930d-51f8a31f9b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:30.744508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464124-d5fe-4478-930d-51f8a31f9b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:30.744866 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88464124-d5fe-4478-930d-51f8a31f9b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:30.745733 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88464124-d5fe-4478-930d-51f8a31f9b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:30.755627 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88464124-d5fe-4478-930d-51f8a31f9b59 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:30.780067 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 929/1877] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:30.783905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88464124-d5fe-4478-930d-51f8a31f9b59 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:30.787513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6072a-54fe-4549-903e-fe63be34f711 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:30.798512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88464124-d5fe-4478-930d-51f8a31f9b59 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:30.799354 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da893199-0de9-4596-a8e3-75ea1b52423b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:30.800200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da893199-0de9-4596-a8e3-75ea1b52423b service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:30.800694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da893199-0de9-4596-a8e3-75ea1b52423b service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:30.801033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da893199-0de9-4596-a8e3-75ea1b52423b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:30.805963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943faac7-d781-45a5-8bfc-b42c9e3bbcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:30.807344 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943faac7-d781-45a5-8bfc-b42c9e3bbcdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:30.808516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943faac7-d781-45a5-8bfc-b42c9e3bbcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:30.810076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943faac7-d781-45a5-8bfc-b42c9e3bbcdf admin admin] PATH_INFO: `/v3/projects/e32481fd8ffb420a9c9047379a8f0f4e/users/a5f62adfc84c4a22a51a7c3eca587225/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:30.827455 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da893199-0de9-4596-a8e3-75ea1b52423b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:30.829952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da893199-0de9-4596-a8e3-75ea1b52423b service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:30.835903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943faac7-d781-45a5-8bfc-b42c9e3bbcdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32481fd8ffb420a9c9047379a8f0f4e, user_id=a5f62adfc84c4a22a51a7c3eca587225, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:30.839816 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943faac7-d781-45a5-8bfc-b42c9e3bbcdf admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:30.866109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 949/1878] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:30.869154 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 930/1879] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:30 2022] PUT /identity/v3/projects/e32481fd8ffb420a9c9047379a8f0f4e/users/a5f62adfc84c4a22a51a7c3eca587225/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:30.870321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da893199-0de9-4596-a8e3-75ea1b52423b service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:30.881883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da893199-0de9-4596-a8e3-75ea1b52423b service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:30.954077 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21665a-cb1f-4a8c-b945-6fb2445f7910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:30.954804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21665a-cb1f-4a8c-b945-6fb2445f7910 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:30.955085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21665a-cb1f-4a8c-b945-6fb2445f7910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:30.955357 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21665a-cb1f-4a8c-b945-6fb2445f7910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:30.956088 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21665a-cb1f-4a8c-b945-6fb2445f7910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:30.958102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21665a-cb1f-4a8c-b945-6fb2445f7910 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:30.974956 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 950/1880] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:18:30.978829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943faac7-d781-45a5-8bfc-b42c9e3bbcdf admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:30.999501 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943faac7-d781-45a5-8bfc-b42c9e3bbcdf admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:31.017806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4054d-3072-47b9-8171-bfd4b404f9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:31.022013 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4054d-3072-47b9-8171-bfd4b404f9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:31.022300 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4054d-3072-47b9-8171-bfd4b404f9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:31.024293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4054d-3072-47b9-8171-bfd4b404f9d4 admin admin] PATH_INFO: `/v3/projects/e32481fd8ffb420a9c9047379a8f0f4e/users/a5f62adfc84c4a22a51a7c3eca587225/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:31.027549 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4054d-3072-47b9-8171-bfd4b404f9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32481fd8ffb420a9c9047379a8f0f4e, user_id=a5f62adfc84c4a22a51a7c3eca587225, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:31.030272 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4054d-3072-47b9-8171-bfd4b404f9d4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:31.041549 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21665a-cb1f-4a8c-b945-6fb2445f7910 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:31.043747 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2c21665a-cb1f-4a8c-b945-6fb2445f7910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:31.067712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 931/1881] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:30 2022] PUT /identity/v3/projects/e32481fd8ffb420a9c9047379a8f0f4e/users/a5f62adfc84c4a22a51a7c3eca587225/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:31.070230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5309a4-adb8-45c0-bc00-f08a844c53da None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:31.070558 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5309a4-adb8-45c0-bc00-f08a844c53da None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:31.070837 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5309a4-adb8-45c0-bc00-f08a844c53da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:31.080140 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21665a-cb1f-4a8c-b945-6fb2445f7910 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:31.105805 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cc5309a4-adb8-45c0-bc00-f08a844c53da None None] MFA Rules not processed for user `a5f62adfc84c4a22a51a7c3eca587225`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:31.112316 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cc5309a4-adb8-45c0-bc00-f08a844c53da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:31.186029 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=6,keystone:SELECT=88,keystone:INSERT=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:31.209354 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88171942-cd3d-4293-92ea-d986ebe57950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:31.210530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88171942-cd3d-4293-92ea-d986ebe57950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:31.210813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88171942-cd3d-4293-92ea-d986ebe57950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:31.211228 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88171942-cd3d-4293-92ea-d986ebe57950 admin admin] PATH_INFO: `/v3/projects/02b73b0edff54bde80696e4d05bcaef1` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:31.213025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88171942-cd3d-4293-92ea-d986ebe57950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b73b0edff54bde80696e4d05bcaef1)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:31.215757 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88171942-cd3d-4293-92ea-d986ebe57950 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:31.273920 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 932/1882] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:31.277670 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5309a4-adb8-45c0-bc00-f08a844c53da None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:31.279406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:31.280307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cc5309a4-adb8-45c0-bc00-f08a844c53da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:31.290040 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-88171942-cd3d-4293-92ea-d986ebe57950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b73b0edff54bde80696e4d05bcaef1', 'request_id': 'req-88171942-cd3d-4293-92ea-d986ebe57950'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:31.299492 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-88171942-cd3d-4293-92ea-d986ebe57950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b73b0edff54bde80696e4d05bcaef1', 'request_id': 'req-88171942-cd3d-4293-92ea-d986ebe57950'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:31.310418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-88171942-cd3d-4293-92ea-d986ebe57950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b73b0edff54bde80696e4d05bcaef1', 'request_id': 'req-88171942-cd3d-4293-92ea-d986ebe57950'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:31.338571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-88171942-cd3d-4293-92ea-d986ebe57950 admin admin] The token cache is being invalidate because project 02b73b0edff54bde80696e4d05bcaef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:31.338571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-88171942-cd3d-4293-92ea-d986ebe57950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:31.338571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-88171942-cd3d-4293-92ea-d986ebe57950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:31.342026 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 951/1883] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:31 2022] DELETE /identity/v3/projects/02b73b0edff54bde80696e4d05bcaef1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:31.346917 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88171942-cd3d-4293-92ea-d986ebe57950 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:31.348788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-88171942-cd3d-4293-92ea-d986ebe57950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:31.395194 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5309a4-adb8-45c0-bc00-f08a844c53da None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:31.473571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88171942-cd3d-4293-92ea-d986ebe57950 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:31.477876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a97a2-7c33-4b84-a519-1ed8b3e5e56e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:31.478817 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a97a2-7c33-4b84-a519-1ed8b3e5e56e service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:31.479246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a97a2-7c33-4b84-a519-1ed8b3e5e56e service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:31.479684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a97a2-7c33-4b84-a519-1ed8b3e5e56e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:31.480827 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b2052-0d47-49ef-a45b-7814bc0e9d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:31.483343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b2052-0d47-49ef-a45b-7814bc0e9d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:31.483343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b2052-0d47-49ef-a45b-7814bc0e9d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:31.483343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b2052-0d47-49ef-a45b-7814bc0e9d74 admin admin] PATH_INFO: `/v3/users/e6949cb59665403fb43768171258eb9f` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:31.483927 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6d8a97a2-7c33-4b84-a519-1ed8b3e5e56e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:31.484457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b2052-0d47-49ef-a45b-7814bc0e9d74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6949cb59665403fb43768171258eb9f)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:31.486653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b2052-0d47-49ef-a45b-7814bc0e9d74 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:31.549116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-573b2052-0d47-49ef-a45b-7814bc0e9d74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6949cb59665403fb43768171258eb9f'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:31.578639 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-573b2052-0d47-49ef-a45b-7814bc0e9d74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6949cb59665403fb43768171258eb9f'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:31.580772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-573b2052-0d47-49ef-a45b-7814bc0e9d74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6949cb59665403fb43768171258eb9f'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:31.591969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a97a2-7c33-4b84-a519-1ed8b3e5e56e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:31.595165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a97a2-7c33-4b84-a519-1ed8b3e5e56e service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:31.612832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-573b2052-0d47-49ef-a45b-7814bc0e9d74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6949cb59665403fb43768171258eb9f'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:31.621113 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 933/1884] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:31.621967 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a97a2-7c33-4b84-a519-1ed8b3e5e56e service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:31.624136 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6d8a97a2-7c33-4b84-a519-1ed8b3e5e56e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:31.630881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-573b2052-0d47-49ef-a45b-7814bc0e9d74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6949cb59665403fb43768171258eb9f'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:31.660300 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a97a2-7c33-4b84-a519-1ed8b3e5e56e service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:31.663464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 952/1885] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:31 2022] DELETE /identity/v3/users/e6949cb59665403fb43768171258eb9f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:31.666080 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a35ad7-ecc3-4665-bdb7-14db8df047e9 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:31.666829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a35ad7-ecc3-4665-bdb7-14db8df047e9 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:31.667306 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a35ad7-ecc3-4665-bdb7-14db8df047e9 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:31.668998 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 953/1886] 10.222.0.99 () {54 vars in 921 bytes} [Mon Jul 18 14:18:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:18:31.694931 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79d660-8956-4e85-9f74-167c06006a46 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:31.695463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79d660-8956-4e85-9f74-167c06006a46 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:31.695927 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79d660-8956-4e85-9f74-167c06006a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:31.725237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-ce79d660-8956-4e85-9f74-167c06006a46 None None] MFA Rules not processed for user `b1b66b55e0374152828913910c4002f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:31.726638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:31.727024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ce79d660-8956-4e85-9f74-167c06006a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:31.766115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd145bd-dda4-46ea-a859-e7e523808af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:31.767749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd145bd-dda4-46ea-a859-e7e523808af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:31.768041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd145bd-dda4-46ea-a859-e7e523808af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:31.768326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd145bd-dda4-46ea-a859-e7e523808af5 admin admin] PATH_INFO: `/v3/projects/a27d3297f8854e84850f540dbcadc298` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:31.769746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd145bd-dda4-46ea-a859-e7e523808af5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27d3297f8854e84850f540dbcadc298)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:31.771793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd145bd-dda4-46ea-a859-e7e523808af5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:31.789526 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:31.830705 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 954/1887] 10.222.0.99 () {58 vars in 1018 bytes} [Mon Jul 18 14:18:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:31.832133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79d660-8956-4e85-9f74-167c06006a46 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:31.834180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ce79d660-8956-4e85-9f74-167c06006a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:31.851026 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-afd145bd-dda4-46ea-a859-e7e523808af5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27d3297f8854e84850f540dbcadc298', 'request_id': 'req-afd145bd-dda4-46ea-a859-e7e523808af5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:31.860131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79d660-8956-4e85-9f74-167c06006a46 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:31.861641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-afd145bd-dda4-46ea-a859-e7e523808af5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27d3297f8854e84850f540dbcadc298', 'request_id': 'req-afd145bd-dda4-46ea-a859-e7e523808af5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:31.873810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-afd145bd-dda4-46ea-a859-e7e523808af5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27d3297f8854e84850f540dbcadc298', 'request_id': 'req-afd145bd-dda4-46ea-a859-e7e523808af5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:31.888519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-afd145bd-dda4-46ea-a859-e7e523808af5 admin admin] The token cache is being invalidate because project a27d3297f8854e84850f540dbcadc298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:31.888906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-afd145bd-dda4-46ea-a859-e7e523808af5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:31.889771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-afd145bd-dda4-46ea-a859-e7e523808af5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:31.894443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 934/1888] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:31 2022] DELETE /identity/v3/projects/a27d3297f8854e84850f540dbcadc298 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:31.894443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd145bd-dda4-46ea-a859-e7e523808af5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:31.898157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-afd145bd-dda4-46ea-a859-e7e523808af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:31.935850 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54382e4-7b34-4b76-bec7-482d802e1d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:31.936750 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54382e4-7b34-4b76-bec7-482d802e1d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:31.937032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54382e4-7b34-4b76-bec7-482d802e1d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:31.937307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54382e4-7b34-4b76-bec7-482d802e1d8b admin admin] PATH_INFO: `/v3/users/4923f990013f4f299d0ac1d1823d99bb` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:31.938639 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54382e4-7b34-4b76-bec7-482d802e1d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4923f990013f4f299d0ac1d1823d99bb)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:31.940595 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54382e4-7b34-4b76-bec7-482d802e1d8b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:31.991254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd145bd-dda4-46ea-a859-e7e523808af5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:32.006172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e54382e4-7b34-4b76-bec7-482d802e1d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4923f990013f4f299d0ac1d1823d99bb'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.010926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ab322-4f5f-47dd-947c-a7176b76a191 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:32.011603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ab322-4f5f-47dd-947c-a7176b76a191 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:32.011887 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ab322-4f5f-47dd-947c-a7176b76a191 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:32.012159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ab322-4f5f-47dd-947c-a7176b76a191 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:32.014112 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8c8ab322-4f5f-47dd-947c-a7176b76a191 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:32.020574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e54382e4-7b34-4b76-bec7-482d802e1d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4923f990013f4f299d0ac1d1823d99bb'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.021534 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e54382e4-7b34-4b76-bec7-482d802e1d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4923f990013f4f299d0ac1d1823d99bb'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.030194 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ab322-4f5f-47dd-947c-a7176b76a191 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:32.032226 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ab322-4f5f-47dd-947c-a7176b76a191 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:32.045497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e54382e4-7b34-4b76-bec7-482d802e1d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4923f990013f4f299d0ac1d1823d99bb'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.045713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 935/1889] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:32.046603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ab322-4f5f-47dd-947c-a7176b76a191 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:32.048170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8c8ab322-4f5f-47dd-947c-a7176b76a191 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:32.054531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e54382e4-7b34-4b76-bec7-482d802e1d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4923f990013f4f299d0ac1d1823d99bb'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.061694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 955/1890] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:31 2022] DELETE /identity/v3/users/4923f990013f4f299d0ac1d1823d99bb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:32.062369 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ab322-4f5f-47dd-947c-a7176b76a191 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:32.062564 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54382e4-7b34-4b76-bec7-482d802e1d8b admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:32.064105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e54382e4-7b34-4b76-bec7-482d802e1d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:32.116138 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:32.136524 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf5d36-a940-47b9-b61d-7905a1057792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:32.137500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf5d36-a940-47b9-b61d-7905a1057792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:32.137873 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf5d36-a940-47b9-b61d-7905a1057792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:32.138136 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf5d36-a940-47b9-b61d-7905a1057792 admin admin] PATH_INFO: `/v3/users/9349f5dac08e4a7c94dc96a53bb70759` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:32.140172 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf5d36-a940-47b9-b61d-7905a1057792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9349f5dac08e4a7c94dc96a53bb70759)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:32.142187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf5d36-a940-47b9-b61d-7905a1057792 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:32.155078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:32.163920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54382e4-7b34-4b76-bec7-482d802e1d8b admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:32.179989 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0301e-2f23-4ed4-afba-3ae12d4bfd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:32.181608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0301e-2f23-4ed4-afba-3ae12d4bfd84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:32.182413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0301e-2f23-4ed4-afba-3ae12d4bfd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:32.182876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0301e-2f23-4ed4-afba-3ae12d4bfd84 admin admin] PATH_INFO: `/v3/projects/40073bb96a3f4191837937782c3a7ced` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:32.187388 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0301e-2f23-4ed4-afba-3ae12d4bfd84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40073bb96a3f4191837937782c3a7ced)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:32.191555 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0301e-2f23-4ed4-afba-3ae12d4bfd84 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:32.216898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-83bf5d36-a940-47b9-b61d-7905a1057792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9349f5dac08e4a7c94dc96a53bb70759'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.229048 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-83bf5d36-a940-47b9-b61d-7905a1057792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9349f5dac08e4a7c94dc96a53bb70759'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.229756 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-83bf5d36-a940-47b9-b61d-7905a1057792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9349f5dac08e4a7c94dc96a53bb70759'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.248155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-83bf5d36-a940-47b9-b61d-7905a1057792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9349f5dac08e4a7c94dc96a53bb70759'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.251536 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-65e0301e-2f23-4ed4-afba-3ae12d4bfd84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40073bb96a3f4191837937782c3a7ced', 'request_id': 'req-65e0301e-2f23-4ed4-afba-3ae12d4bfd84'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.258429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-83bf5d36-a940-47b9-b61d-7905a1057792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9349f5dac08e4a7c94dc96a53bb70759'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.259213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-65e0301e-2f23-4ed4-afba-3ae12d4bfd84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40073bb96a3f4191837937782c3a7ced', 'request_id': 'req-65e0301e-2f23-4ed4-afba-3ae12d4bfd84'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.265204 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 936/1891] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:32 2022] DELETE /identity/v3/users/9349f5dac08e4a7c94dc96a53bb70759 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:32.266724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd866f03-3663-4940-b8d6-b9f337ce77ce None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:32.266833 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-65e0301e-2f23-4ed4-afba-3ae12d4bfd84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40073bb96a3f4191837937782c3a7ced', 'request_id': 'req-65e0301e-2f23-4ed4-afba-3ae12d4bfd84'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.267010 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd866f03-3663-4940-b8d6-b9f337ce77ce None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:32.267284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd866f03-3663-4940-b8d6-b9f337ce77ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:32.294569 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-65e0301e-2f23-4ed4-afba-3ae12d4bfd84 admin admin] The token cache is being invalidate because project 40073bb96a3f4191837937782c3a7ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:32.294862 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-65e0301e-2f23-4ed4-afba-3ae12d4bfd84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.295522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-65e0301e-2f23-4ed4-afba-3ae12d4bfd84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.298222 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 956/1892] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:32 2022] DELETE /identity/v3/projects/40073bb96a3f4191837937782c3a7ced => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:32.302636 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caac2a9-e76b-4835-b3ce-1a2a543369cb None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:32.302929 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caac2a9-e76b-4835-b3ce-1a2a543369cb None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:32.303433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caac2a9-e76b-4835-b3ce-1a2a543369cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:32.304122 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-dd866f03-3663-4940-b8d6-b9f337ce77ce None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:32.307266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dd866f03-3663-4940-b8d6-b9f337ce77ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:32.326940 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-0caac2a9-e76b-4835-b3ce-1a2a543369cb None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:32.328932 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-0caac2a9-e76b-4835-b3ce-1a2a543369cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:32.450825 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 937/1893] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:32.468833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3967e-ef3e-4c06-8595-6be8a2611261 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:32.469139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3967e-ef3e-4c06-8595-6be8a2611261 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:32.469446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3967e-ef3e-4c06-8595-6be8a2611261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:32.469922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 957/1894] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:32.499424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caac2a9-e76b-4835-b3ce-1a2a543369cb None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:32.501416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-0caac2a9-e76b-4835-b3ce-1a2a543369cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:32.504657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b5f3967e-ef3e-4c06-8595-6be8a2611261 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:32.505768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b5f3967e-ef3e-4c06-8595-6be8a2611261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:32.520010 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 938/1895] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:32.521060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3967e-ef3e-4c06-8595-6be8a2611261 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:32.531605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3967e-ef3e-4c06-8595-6be8a2611261 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:32.537401 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664c921-3397-4f28-8df2-f81a387898ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:32.538080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664c921-3397-4f28-8df2-f81a387898ea admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:32.538363 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664c921-3397-4f28-8df2-f81a387898ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:32.538666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664c921-3397-4f28-8df2-f81a387898ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:32.540208 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664c921-3397-4f28-8df2-f81a387898ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:32.540519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664c921-3397-4f28-8df2-f81a387898ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:32.542145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664c921-3397-4f28-8df2-f81a387898ea admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:32.561334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 939/1896] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:32.565683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664c921-3397-4f28-8df2-f81a387898ea admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:32.576411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664c921-3397-4f28-8df2-f81a387898ea admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:32.581448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5a327-26d1-4cdf-86ad-ba9f3522c284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:32.582171 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5a327-26d1-4cdf-86ad-ba9f3522c284 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:32.582553 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5a327-26d1-4cdf-86ad-ba9f3522c284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:32.582898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5a327-26d1-4cdf-86ad-ba9f3522c284 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:32.584352 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5a327-26d1-4cdf-86ad-ba9f3522c284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:32.586906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5a327-26d1-4cdf-86ad-ba9f3522c284 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:32.591787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caac2a9-e76b-4835-b3ce-1a2a543369cb None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:32.599142 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741fc57-a827-42c0-80f4-317a510aeba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:32.600204 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741fc57-a827-42c0-80f4-317a510aeba1 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:32.600770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741fc57-a827-42c0-80f4-317a510aeba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:32.601196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741fc57-a827-42c0-80f4-317a510aeba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:32.612471 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741fc57-a827-42c0-80f4-317a510aeba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:32.613919 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741fc57-a827-42c0-80f4-317a510aeba1 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:32.622079 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 940/1897] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:32 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:18:32.627455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5a327-26d1-4cdf-86ad-ba9f3522c284 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:32.628498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 958/1898] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:32.629351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741fc57-a827-42c0-80f4-317a510aeba1 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:32.630700 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a741fc57-a827-42c0-80f4-317a510aeba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:32.647727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741fc57-a827-42c0-80f4-317a510aeba1 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:32.693718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:32.710969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:32.762783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5a327-26d1-4cdf-86ad-ba9f3522c284 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:32.780047 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea188c0-cae8-46a0-b16d-737d9e6791a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:32.781058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50661c64-a6f8-4787-bd51-72a6ebc43005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:32.781813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661c64-a6f8-4787-bd51-72a6ebc43005 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:32.782223 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661c64-a6f8-4787-bd51-72a6ebc43005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:32.783111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661c64-a6f8-4787-bd51-72a6ebc43005 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:32.783584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea188c0-cae8-46a0-b16d-737d9e6791a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:32.784047 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50661c64-a6f8-4787-bd51-72a6ebc43005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:32.787881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea188c0-cae8-46a0-b16d-737d9e6791a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:32.787881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea188c0-cae8-46a0-b16d-737d9e6791a3 admin admin] PATH_INFO: `/v3/projects/1561b45684ec47bdb59090652132dc87` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:32.788165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50661c64-a6f8-4787-bd51-72a6ebc43005 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:32.789029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea188c0-cae8-46a0-b16d-737d9e6791a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1561b45684ec47bdb59090652132dc87)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:32.791029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea188c0-cae8-46a0-b16d-737d9e6791a3 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:32.819530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 941/1899] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:32 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:32.823534 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50661c64-a6f8-4787-bd51-72a6ebc43005 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:32.841397 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50661c64-a6f8-4787-bd51-72a6ebc43005 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:32.877354 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fea188c0-cae8-46a0-b16d-737d9e6791a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1561b45684ec47bdb59090652132dc87', 'request_id': 'req-fea188c0-cae8-46a0-b16d-737d9e6791a3'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.886774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fea188c0-cae8-46a0-b16d-737d9e6791a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1561b45684ec47bdb59090652132dc87', 'request_id': 'req-fea188c0-cae8-46a0-b16d-737d9e6791a3'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.898289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fea188c0-cae8-46a0-b16d-737d9e6791a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1561b45684ec47bdb59090652132dc87', 'request_id': 'req-fea188c0-cae8-46a0-b16d-737d9e6791a3'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.924312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fea188c0-cae8-46a0-b16d-737d9e6791a3 admin admin] The token cache is being invalidate because project 1561b45684ec47bdb59090652132dc87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:32.924678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fea188c0-cae8-46a0-b16d-737d9e6791a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.925347 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fea188c0-cae8-46a0-b16d-737d9e6791a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:32.933883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 959/1900] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:32 2022] DELETE /identity/v3/projects/1561b45684ec47bdb59090652132dc87 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:32.935624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb48c84-37bd-499f-9315-74f225fe0b14 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:32.935913 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb48c84-37bd-499f-9315-74f225fe0b14 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:32.936281 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb48c84-37bd-499f-9315-74f225fe0b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:32.961306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b012eb-6a16-41c0-9323-7c8edc2110c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:32.962428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b012eb-6a16-41c0-9323-7c8edc2110c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:32.962827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b012eb-6a16-41c0-9323-7c8edc2110c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:32.963176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b012eb-6a16-41c0-9323-7c8edc2110c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:32.964509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b012eb-6a16-41c0-9323-7c8edc2110c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:32.966728 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b012eb-6a16-41c0-9323-7c8edc2110c3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:32.983828 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 942/1901] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:32.984050 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-ddb48c84-37bd-499f-9315-74f225fe0b14 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:32.985030 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b012eb-6a16-41c0-9323-7c8edc2110c3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:32.985375 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ddb48c84-37bd-499f-9315-74f225fe0b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:32.987078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-62b012eb-6a16-41c0-9323-7c8edc2110c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:32.997283 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 960/1902] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:33.003861 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b012eb-6a16-41c0-9323-7c8edc2110c3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:33.009693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c8e36-14c7-45cd-a7bd-fbef46ac1da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:33.010238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c8e36-14c7-45cd-a7bd-fbef46ac1da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:33.010868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c8e36-14c7-45cd-a7bd-fbef46ac1da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:33.011691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c8e36-14c7-45cd-a7bd-fbef46ac1da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:33.012907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c8e36-14c7-45cd-a7bd-fbef46ac1da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:33.016187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c8e36-14c7-45cd-a7bd-fbef46ac1da7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:33.018199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee731dbf-6483-466f-bf29-8144a765e239 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:33.018522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee731dbf-6483-466f-bf29-8144a765e239 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:33.018801 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee731dbf-6483-466f-bf29-8144a765e239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:33.028844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 943/1903] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:33.035531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c8e36-14c7-45cd-a7bd-fbef46ac1da7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:33.044254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c8e36-14c7-45cd-a7bd-fbef46ac1da7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:33.049716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd7334-4be4-4ec3-a439-2b668d1c731d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:33.050776 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd7334-4be4-4ec3-a439-2b668d1c731d admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:33.051159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd7334-4be4-4ec3-a439-2b668d1c731d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:33.051556 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd7334-4be4-4ec3-a439-2b668d1c731d admin admin] PATH_INFO: `/v3/projects/db7138b2ece84a928e6d2eff2c7d5a0b/users/20649803793a47bb99431845711876bd/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:33.071290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd7334-4be4-4ec3-a439-2b668d1c731d admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7138b2ece84a928e6d2eff2c7d5a0b, user_id=20649803793a47bb99431845711876bd, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:33.074150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd7334-4be4-4ec3-a439-2b668d1c731d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:33.074320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-ee731dbf-6483-466f-bf29-8144a765e239 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:33.075723 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ee731dbf-6483-466f-bf29-8144a765e239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:33.095543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 961/1904] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:33.096741 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 944/1905] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:33 2022] PUT /identity/v3/projects/db7138b2ece84a928e6d2eff2c7d5a0b/users/20649803793a47bb99431845711876bd/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:33.101203 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee731dbf-6483-466f-bf29-8144a765e239 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:33.109306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bdfb0-4649-4747-ae40-4abd8f17f180 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:33.109592 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bdfb0-4649-4747-ae40-4abd8f17f180 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:33.109875 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bdfb0-4649-4747-ae40-4abd8f17f180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:33.131629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee731dbf-6483-466f-bf29-8144a765e239 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:33.162254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ce8bdfb0-4649-4747-ae40-4abd8f17f180 None None] MFA Rules not processed for user `20649803793a47bb99431845711876bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:33.163615 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ce8bdfb0-4649-4747-ae40-4abd8f17f180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:33.258766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 945/1906] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:33.259726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bdfb0-4649-4747-ae40-4abd8f17f180 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:33.274133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:33.289109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a02fc0-2be9-42d5-8cfa-2458b761db5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:33.289928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a02fc0-2be9-42d5-8cfa-2458b761db5a admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:33.290336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a02fc0-2be9-42d5-8cfa-2458b761db5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:33.290892 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a02fc0-2be9-42d5-8cfa-2458b761db5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:33.291769 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a02fc0-2be9-42d5-8cfa-2458b761db5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:33.292177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a02fc0-2be9-42d5-8cfa-2458b761db5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:33.294325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a02fc0-2be9-42d5-8cfa-2458b761db5a admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:33.328544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 962/1907] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:33.335495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a02fc0-2be9-42d5-8cfa-2458b761db5a admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:33.354485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a02fc0-2be9-42d5-8cfa-2458b761db5a admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:33.365703 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bdfb0-4649-4747-ae40-4abd8f17f180 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:33.367917 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ea351-3518-441a-b079-4ec289935f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:33.368741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ea351-3518-441a-b079-4ec289935f05 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:33.369131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ea351-3518-441a-b079-4ec289935f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:33.369521 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ea351-3518-441a-b079-4ec289935f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:33.370334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ea351-3518-441a-b079-4ec289935f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:33.372504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313c433-f296-4f06-a594-3ac79fe9f556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:33.372967 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ea351-3518-441a-b079-4ec289935f05 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:33.373859 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313c433-f296-4f06-a594-3ac79fe9f556 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:33.374840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313c433-f296-4f06-a594-3ac79fe9f556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:33.375258 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313c433-f296-4f06-a594-3ac79fe9f556 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:33.376155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313c433-f296-4f06-a594-3ac79fe9f556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:33.378275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313c433-f296-4f06-a594-3ac79fe9f556 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:33.427364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 963/1908] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:33 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:33.428298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ea351-3518-441a-b079-4ec289935f05 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:33.435000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 946/1909] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:33 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:33.438172 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313c433-f296-4f06-a594-3ac79fe9f556 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:33.473950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:33.550996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313c433-f296-4f06-a594-3ac79fe9f556 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:33.556558 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a764d-6516-4c70-bd5d-fbaf191694cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:33.557064 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a764d-6516-4c70-bd5d-fbaf191694cf admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:33.557420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a764d-6516-4c70-bd5d-fbaf191694cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:33.557769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a764d-6516-4c70-bd5d-fbaf191694cf admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:33.558584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a764d-6516-4c70-bd5d-fbaf191694cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:33.560986 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a764d-6516-4c70-bd5d-fbaf191694cf admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:33.583851 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ea351-3518-441a-b079-4ec289935f05 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:33.589268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bef540-e2b1-4599-b5dc-fb5a8d763e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:33.589954 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bef540-e2b1-4599-b5dc-fb5a8d763e2d admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:33.590420 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bef540-e2b1-4599-b5dc-fb5a8d763e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:33.590593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bef540-e2b1-4599-b5dc-fb5a8d763e2d admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:33.591240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 947/1910] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:33 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:18:33.591352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bef540-e2b1-4599-b5dc-fb5a8d763e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:33.593369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bef540-e2b1-4599-b5dc-fb5a8d763e2d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:33.597153 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a764d-6516-4c70-bd5d-fbaf191694cf admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:33.600811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-aa7a764d-6516-4c70-bd5d-fbaf191694cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:33.624448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 964/1911] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:33 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:33.624610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a764d-6516-4c70-bd5d-fbaf191694cf admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:33.624708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bef540-e2b1-4599-b5dc-fb5a8d763e2d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:33.629593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:33.631090 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:33.631450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:33.631797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8 admin admin] PATH_INFO: `/v3/projects/b42e457d78e8453b8029049676b8e230` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:33.634683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b42e457d78e8453b8029049676b8e230)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:33.637200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:33.638368 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bef540-e2b1-4599-b5dc-fb5a8d763e2d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:33.645474 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2b7d6-932f-4a84-ac74-93aa569788cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:33.646043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2b7d6-932f-4a84-ac74-93aa569788cf admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:33.646205 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2b7d6-932f-4a84-ac74-93aa569788cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:33.646524 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2b7d6-932f-4a84-ac74-93aa569788cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:33.647432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2b7d6-932f-4a84-ac74-93aa569788cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:33.652163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2b7d6-932f-4a84-ac74-93aa569788cf admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:33.666741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 965/1912] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:33.666741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2b7d6-932f-4a84-ac74-93aa569788cf admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:33.681193 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2b7d6-932f-4a84-ac74-93aa569788cf admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:33.688316 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0c457-51e1-4df2-8828-cf1baeb79a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:33.689009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0c457-51e1-4df2-8828-cf1baeb79a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:33.689299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0c457-51e1-4df2-8828-cf1baeb79a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:33.689568 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0c457-51e1-4df2-8828-cf1baeb79a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:33.690305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0c457-51e1-4df2-8828-cf1baeb79a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:33.693617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0c457-51e1-4df2-8828-cf1baeb79a1c admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:33.706730 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 966/1913] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:33.707620 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0c457-51e1-4df2-8828-cf1baeb79a1c admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:33.718914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0c457-51e1-4df2-8828-cf1baeb79a1c admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:33.723506 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b42e457d78e8453b8029049676b8e230', 'request_id': 'req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:33.732276 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b42e457d78e8453b8029049676b8e230', 'request_id': 'req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:33.739769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b42e457d78e8453b8029049676b8e230', 'request_id': 'req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:33.756953 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8 admin admin] The token cache is being invalidate because project b42e457d78e8453b8029049676b8e230 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:33.757317 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:33.758030 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:33.759995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 948/1914] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:33 2022] DELETE /identity/v3/projects/b42e457d78e8453b8029049676b8e230 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:33.760732 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:33.762092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:33.772072 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:33.790952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1894d-2606-481d-9ab5-63642f6794d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:33.792361 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1894d-2606-481d-9ab5-63642f6794d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:33.792361 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1894d-2606-481d-9ab5-63642f6794d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:33.792703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1894d-2606-481d-9ab5-63642f6794d6 admin admin] PATH_INFO: `/v3/projects/ddb34d8613664824b5b2d43f8fdc241b/users/995aef922dca4891be129b0ef2a52205/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:33.814868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1894d-2606-481d-9ab5-63642f6794d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb34d8613664824b5b2d43f8fdc241b, user_id=995aef922dca4891be129b0ef2a52205, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:33.819722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1894d-2606-481d-9ab5-63642f6794d6 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:33.841981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 967/1915] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:33 2022] PUT /identity/v3/projects/ddb34d8613664824b5b2d43f8fdc241b/users/995aef922dca4891be129b0ef2a52205/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:33.843148 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1894d-2606-481d-9ab5-63642f6794d6 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:33.843694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657a8bd-43b1-4338-89fd-8893ac7ba1b8 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:33.845175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f1b1894d-2606-481d-9ab5-63642f6794d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:33.901648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198204a-9852-40e3-8c02-01525aebb296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:33.902356 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198204a-9852-40e3-8c02-01525aebb296 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:33.902671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198204a-9852-40e3-8c02-01525aebb296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:33.902951 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198204a-9852-40e3-8c02-01525aebb296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:33.903722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198204a-9852-40e3-8c02-01525aebb296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:33.905344 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198204a-9852-40e3-8c02-01525aebb296 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:33.914249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1894d-2606-481d-9ab5-63642f6794d6 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:33.917614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 949/1916] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:33.917614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198204a-9852-40e3-8c02-01525aebb296 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:33.920051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a198204a-9852-40e3-8c02-01525aebb296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:33.920189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6266c-c794-4678-974b-489c36519f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:33.921069 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6266c-c794-4678-974b-489c36519f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:33.921420 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6266c-c794-4678-974b-489c36519f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:33.921632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6266c-c794-4678-974b-489c36519f3f admin admin] PATH_INFO: `/v3/users/452c3b5ff194432eb88e975d9ed8e746` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:33.922886 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6266c-c794-4678-974b-489c36519f3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=452c3b5ff194432eb88e975d9ed8e746)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:33.924839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6266c-c794-4678-974b-489c36519f3f admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:33.932350 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198204a-9852-40e3-8c02-01525aebb296 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:33.937192 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fe65b-a41b-4867-adee-1410ace706c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:33.938035 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fe65b-a41b-4867-adee-1410ace706c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:33.938173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:33.938295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fe65b-a41b-4867-adee-1410ace706c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:33.938612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fe65b-a41b-4867-adee-1410ace706c1 admin admin] PATH_INFO: `/v3/users/a5f62adfc84c4a22a51a7c3eca587225` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:33.939920 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234fe65b-a41b-4867-adee-1410ace706c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f62adfc84c4a22a51a7c3eca587225)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:33.941852 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234fe65b-a41b-4867-adee-1410ace706c1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:33.979942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9df6266c-c794-4678-974b-489c36519f3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452c3b5ff194432eb88e975d9ed8e746'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:33.987625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9df6266c-c794-4678-974b-489c36519f3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452c3b5ff194432eb88e975d9ed8e746'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:33.988284 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9df6266c-c794-4678-974b-489c36519f3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452c3b5ff194432eb88e975d9ed8e746'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:33.991330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-234fe65b-a41b-4867-adee-1410ace706c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f62adfc84c4a22a51a7c3eca587225'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:34.000040 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-234fe65b-a41b-4867-adee-1410ace706c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f62adfc84c4a22a51a7c3eca587225'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:34.001067 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-234fe65b-a41b-4867-adee-1410ace706c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f62adfc84c4a22a51a7c3eca587225'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:34.001870 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9df6266c-c794-4678-974b-489c36519f3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452c3b5ff194432eb88e975d9ed8e746'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:34.009225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9df6266c-c794-4678-974b-489c36519f3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452c3b5ff194432eb88e975d9ed8e746'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:34.013636 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-234fe65b-a41b-4867-adee-1410ace706c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f62adfc84c4a22a51a7c3eca587225'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:34.015393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 968/1917] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:33 2022] DELETE /identity/v3/users/452c3b5ff194432eb88e975d9ed8e746 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:34.016184 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6266c-c794-4678-974b-489c36519f3f admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:34.017549 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9df6266c-c794-4678-974b-489c36519f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:34.023602 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-234fe65b-a41b-4867-adee-1410ace706c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f62adfc84c4a22a51a7c3eca587225'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:34.029587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 950/1918] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:33 2022] DELETE /identity/v3/users/a5f62adfc84c4a22a51a7c3eca587225 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:34.030375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fe65b-a41b-4867-adee-1410ace706c1 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:34.031726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-234fe65b-a41b-4867-adee-1410ace706c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:34.059066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:34.089987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6266c-c794-4678-974b-489c36519f3f admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:34.109911 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fe65b-a41b-4867-adee-1410ace706c1 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:34.114802 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70489626-a7f0-4ce9-b1fb-5c10d9a5cb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:34.115773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70489626-a7f0-4ce9-b1fb-5c10d9a5cb8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.116060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70489626-a7f0-4ce9-b1fb-5c10d9a5cb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.116358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70489626-a7f0-4ce9-b1fb-5c10d9a5cb8b admin admin] PATH_INFO: `/v3/projects/31d50ace2bf04051b80b9fb6dca853f2/users/e44cbfc285544798be44b1db8dac6279/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:34.133904 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70489626-a7f0-4ce9-b1fb-5c10d9a5cb8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d50ace2bf04051b80b9fb6dca853f2, user_id=e44cbfc285544798be44b1db8dac6279, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:34.136630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70489626-a7f0-4ce9-b1fb-5c10d9a5cb8b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:34.160624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 951/1919] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:34 2022] PUT /identity/v3/projects/31d50ace2bf04051b80b9fb6dca853f2/users/e44cbfc285544798be44b1db8dac6279/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:34.162659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64962918-61d6-4fd9-997d-8ef3e3c9238d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.162979 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64962918-61d6-4fd9-997d-8ef3e3c9238d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.163281 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64962918-61d6-4fd9-997d-8ef3e3c9238d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:34.171330 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dfadd-6449-4704-96a8-1b4e86c92c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:34.172265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dfadd-6449-4704-96a8-1b4e86c92c6b admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.172652 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dfadd-6449-4704-96a8-1b4e86c92c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.173047 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dfadd-6449-4704-96a8-1b4e86c92c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:34.174710 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dfadd-6449-4704-96a8-1b4e86c92c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:34.176819 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dfadd-6449-4704-96a8-1b4e86c92c6b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:34.186327 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-64962918-61d6-4fd9-997d-8ef3e3c9238d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:34.187610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-64962918-61d6-4fd9-997d-8ef3e3c9238d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:34.203929 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 969/1920] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:34.205561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4cb2f-e7bf-460d-bdab-ed90112b85eb None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.205987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4cb2f-e7bf-460d-bdab-ed90112b85eb None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.206640 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4cb2f-e7bf-460d-bdab-ed90112b85eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:34.259578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-91c4cb2f-e7bf-460d-bdab-ed90112b85eb None None] MFA Rules not processed for user `e44cbfc285544798be44b1db8dac6279`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:34.260787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-91c4cb2f-e7bf-460d-bdab-ed90112b85eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:34.287492 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 952/1921] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:34.288396 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64962918-61d6-4fd9-997d-8ef3e3c9238d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:34.289717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-64962918-61d6-4fd9-997d-8ef3e3c9238d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:34.291419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:34.303735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64962918-61d6-4fd9-997d-8ef3e3c9238d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:34.316083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bd098-a3ea-4d6a-9c63-b2179ba4a0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:34.317350 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd098-a3ea-4d6a-9c63-b2179ba4a0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.318500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd098-a3ea-4d6a-9c63-b2179ba4a0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.318799 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd098-a3ea-4d6a-9c63-b2179ba4a0b0 admin admin] PATH_INFO: `/v3/projects/ddb34d8613664824b5b2d43f8fdc241b/users/995aef922dca4891be129b0ef2a52205/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:34.324794 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bd098-a3ea-4d6a-9c63-b2179ba4a0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb34d8613664824b5b2d43f8fdc241b, user_id=995aef922dca4891be129b0ef2a52205, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:34.329141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bd098-a3ea-4d6a-9c63-b2179ba4a0b0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:34.354484 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 953/1922] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:34 2022] PUT /identity/v3/projects/ddb34d8613664824b5b2d43f8fdc241b/users/995aef922dca4891be129b0ef2a52205/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:34.354484 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bd098-a3ea-4d6a-9c63-b2179ba4a0b0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:34.354484 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-667bd098-a3ea-4d6a-9c63-b2179ba4a0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:34.356636 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 970/1923] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:34.362012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a09e93-4eaa-4f79-94cd-d2fcd1ba2151 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.362587 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a09e93-4eaa-4f79-94cd-d2fcd1ba2151 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.363009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a09e93-4eaa-4f79-94cd-d2fcd1ba2151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:34.402930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-46a09e93-4eaa-4f79-94cd-d2fcd1ba2151 None None] MFA Rules not processed for user `995aef922dca4891be129b0ef2a52205`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:34.404230 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-46a09e93-4eaa-4f79-94cd-d2fcd1ba2151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:34.434351 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bd098-a3ea-4d6a-9c63-b2179ba4a0b0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:34.438228 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dcf36-43f8-429b-932a-fb8c19b9b3ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:34.438920 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dcf36-43f8-429b-932a-fb8c19b9b3ad service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.439199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dcf36-43f8-429b-932a-fb8c19b9b3ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.439473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dcf36-43f8-429b-932a-fb8c19b9b3ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:34.479911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 971/1924] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:34.480706 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a09e93-4eaa-4f79-94cd-d2fcd1ba2151 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:34.491842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:34.510789 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dcf36-43f8-429b-932a-fb8c19b9b3ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:34.512239 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dcf36-43f8-429b-932a-fb8c19b9b3ad service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:34.522540 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 954/1925] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:34.523458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dcf36-43f8-429b-932a-fb8c19b9b3ad service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:34.524738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2c2dcf36-43f8-429b-932a-fb8c19b9b3ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:34.537553 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dcf36-43f8-429b-932a-fb8c19b9b3ad service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:34.545005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941facea-5173-450b-b7f5-4d4b0daf5c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:34.546141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941facea-5173-450b-b7f5-4d4b0daf5c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.546508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941facea-5173-450b-b7f5-4d4b0daf5c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.546878 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941facea-5173-450b-b7f5-4d4b0daf5c4d admin admin] PATH_INFO: `/v3/projects/e32481fd8ffb420a9c9047379a8f0f4e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:34.548093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941facea-5173-450b-b7f5-4d4b0daf5c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32481fd8ffb420a9c9047379a8f0f4e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:34.550019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941facea-5173-450b-b7f5-4d4b0daf5c4d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:34.560693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a09e93-4eaa-4f79-94cd-d2fcd1ba2151 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:34.568595 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9aadfb-ca97-495c-930f-6f2c38752035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:34.569376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aadfb-ca97-495c-930f-6f2c38752035 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.569753 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aadfb-ca97-495c-930f-6f2c38752035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.571439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aadfb-ca97-495c-930f-6f2c38752035 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:34.572255 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9aadfb-ca97-495c-930f-6f2c38752035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:34.574958 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9aadfb-ca97-495c-930f-6f2c38752035 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:34.608881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-941facea-5173-450b-b7f5-4d4b0daf5c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32481fd8ffb420a9c9047379a8f0f4e', 'request_id': 'req-941facea-5173-450b-b7f5-4d4b0daf5c4d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:34.616614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-941facea-5173-450b-b7f5-4d4b0daf5c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32481fd8ffb420a9c9047379a8f0f4e', 'request_id': 'req-941facea-5173-450b-b7f5-4d4b0daf5c4d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:34.617510 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 972/1926] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:34 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:34.618900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9aadfb-ca97-495c-930f-6f2c38752035 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:34.621203 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-cc9aadfb-ca97-495c-930f-6f2c38752035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:34.628926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-941facea-5173-450b-b7f5-4d4b0daf5c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32481fd8ffb420a9c9047379a8f0f4e', 'request_id': 'req-941facea-5173-450b-b7f5-4d4b0daf5c4d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:34.652913 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-941facea-5173-450b-b7f5-4d4b0daf5c4d admin admin] The token cache is being invalidate because project e32481fd8ffb420a9c9047379a8f0f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:34.653512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-941facea-5173-450b-b7f5-4d4b0daf5c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:34.654647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-941facea-5173-450b-b7f5-4d4b0daf5c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:34.660930 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 955/1927] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:34 2022] DELETE /identity/v3/projects/e32481fd8ffb420a9c9047379a8f0f4e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:34.660930 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941facea-5173-450b-b7f5-4d4b0daf5c4d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:34.660930 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-941facea-5173-450b-b7f5-4d4b0daf5c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:34.670735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:34.710512 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9aadfb-ca97-495c-930f-6f2c38752035 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:34.715462 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da3615-c4b6-41d2-a144-de7872b022bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:34.716295 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da3615-c4b6-41d2-a144-de7872b022bc service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.716603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da3615-c4b6-41d2-a144-de7872b022bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.716940 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da3615-c4b6-41d2-a144-de7872b022bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:34.718839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-35da3615-c4b6-41d2-a144-de7872b022bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:34.759523 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941facea-5173-450b-b7f5-4d4b0daf5c4d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:34.808179 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da3615-c4b6-41d2-a144-de7872b022bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:34.809729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da3615-c4b6-41d2-a144-de7872b022bc service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:34.821081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 973/1928] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:34.822325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f9a54-b7fa-41a4-a56d-362fda9394bc None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.822684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f9a54-b7fa-41a4-a56d-362fda9394bc None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.823030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f9a54-b7fa-41a4-a56d-362fda9394bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:34.830261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28daa00c-d1fd-42a2-b9b8-923d4b853c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:34.830995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daa00c-d1fd-42a2-b9b8-923d4b853c7e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.831281 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daa00c-d1fd-42a2-b9b8-923d4b853c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.831557 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daa00c-d1fd-42a2-b9b8-923d4b853c7e admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:34.832585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28daa00c-d1fd-42a2-b9b8-923d4b853c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:34.834238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28daa00c-d1fd-42a2-b9b8-923d4b853c7e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:34.845464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-bb7f9a54-b7fa-41a4-a56d-362fda9394bc None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:34.847010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-bb7f9a54-b7fa-41a4-a56d-362fda9394bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:34.858633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 974/1929] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:34.865926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 956/1930] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:34 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:34.866340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70e73a-76b1-4336-b5a6-3c5608bd28f3 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.866340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70e73a-76b1-4336-b5a6-3c5608bd28f3 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.866340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70e73a-76b1-4336-b5a6-3c5608bd28f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:34.867980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28daa00c-d1fd-42a2-b9b8-923d4b853c7e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:34.874622 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:34.885785 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28daa00c-d1fd-42a2-b9b8-923d4b853c7e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:34.892009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-3a70e73a-76b1-4336-b5a6-3c5608bd28f3 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:34.892938 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1a649-82b5-48d8-8cd9-992d2686263b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:34.893235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3a70e73a-76b1-4336-b5a6-3c5608bd28f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:34.893830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1a649-82b5-48d8-8cd9-992d2686263b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.894340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1a649-82b5-48d8-8cd9-992d2686263b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.894787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1a649-82b5-48d8-8cd9-992d2686263b admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:34.896548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1a649-82b5-48d8-8cd9-992d2686263b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:34.899344 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b1a649-82b5-48d8-8cd9-992d2686263b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:34.906550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 975/1931] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:34.907614 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70e73a-76b1-4336-b5a6-3c5608bd28f3 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:34.909273 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3a70e73a-76b1-4336-b5a6-3c5608bd28f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:34.924911 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 957/1932] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:18:34.926224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70e73a-76b1-4336-b5a6-3c5608bd28f3 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:34.927912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1a649-82b5-48d8-8cd9-992d2686263b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:34.941035 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1a649-82b5-48d8-8cd9-992d2686263b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:34.941586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd26d4-e120-46ca-88a7-67677b8265ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:34.943793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd26d4-e120-46ca-88a7-67677b8265ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.944163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd26d4-e120-46ca-88a7-67677b8265ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.944446 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd26d4-e120-46ca-88a7-67677b8265ca admin admin] PATH_INFO: `/v3/users/20649803793a47bb99431845711876bd` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:34.945709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd26d4-e120-46ca-88a7-67677b8265ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=20649803793a47bb99431845711876bd)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:34.947860 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd26d4-e120-46ca-88a7-67677b8265ca admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:34.954228 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a6a9e-575c-4ba0-82c5-79bbb974b228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:34.955119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a6a9e-575c-4ba0-82c5-79bbb974b228 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.955552 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a6a9e-575c-4ba0-82c5-79bbb974b228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.955927 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a6a9e-575c-4ba0-82c5-79bbb974b228 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:34.956793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a6a9e-575c-4ba0-82c5-79bbb974b228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:34.957802 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a6a9e-575c-4ba0-82c5-79bbb974b228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:34.959909 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a6a9e-575c-4ba0-82c5-79bbb974b228 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:34.980024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 958/1933] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:34.980024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a6a9e-575c-4ba0-82c5-79bbb974b228 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:34.991502 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a6a9e-575c-4ba0-82c5-79bbb974b228 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:34.997612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54500526-2f24-4dfe-bf2c-cd0dc12058a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:34.999004 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54500526-2f24-4dfe-bf2c-cd0dc12058a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:34.999442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54500526-2f24-4dfe-bf2c-cd0dc12058a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:34.999807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54500526-2f24-4dfe-bf2c-cd0dc12058a7 admin admin] PATH_INFO: `/v3/projects/426e75174f744cf2b51be546d3d32ed2/users/59b028d2a0404f5bbb49ecc06e69a73c/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:35.019901 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54500526-2f24-4dfe-bf2c-cd0dc12058a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=426e75174f744cf2b51be546d3d32ed2, user_id=59b028d2a0404f5bbb49ecc06e69a73c, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:35.023833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54500526-2f24-4dfe-bf2c-cd0dc12058a7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:35.030077 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-39bd26d4-e120-46ca-88a7-67677b8265ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20649803793a47bb99431845711876bd'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:35.042184 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-39bd26d4-e120-46ca-88a7-67677b8265ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20649803793a47bb99431845711876bd'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:35.043454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-39bd26d4-e120-46ca-88a7-67677b8265ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20649803793a47bb99431845711876bd'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:35.055368 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 959/1934] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:34 2022] PUT /identity/v3/projects/426e75174f744cf2b51be546d3d32ed2/users/59b028d2a0404f5bbb49ecc06e69a73c/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:35.056821 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54500526-2f24-4dfe-bf2c-cd0dc12058a7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:35.059348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-54500526-2f24-4dfe-bf2c-cd0dc12058a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:35.063680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-39bd26d4-e120-46ca-88a7-67677b8265ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20649803793a47bb99431845711876bd'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:35.072131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-39bd26d4-e120-46ca-88a7-67677b8265ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20649803793a47bb99431845711876bd'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:35.079713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 976/1935] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:34 2022] DELETE /identity/v3/users/20649803793a47bb99431845711876bd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:35.083206 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd26d4-e120-46ca-88a7-67677b8265ca admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:35.084571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-39bd26d4-e120-46ca-88a7-67677b8265ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:35.137633 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54500526-2f24-4dfe-bf2c-cd0dc12058a7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:35.144371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:35.167033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd26d4-e120-46ca-88a7-67677b8265ca admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:35.171948 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974077ab-c8d2-48c1-a4cb-520fd533b2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:35.172617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974077ab-c8d2-48c1-a4cb-520fd533b2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:35.173050 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974077ab-c8d2-48c1-a4cb-520fd533b2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:35.173332 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974077ab-c8d2-48c1-a4cb-520fd533b2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:35.174022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974077ab-c8d2-48c1-a4cb-520fd533b2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:35.175968 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974077ab-c8d2-48c1-a4cb-520fd533b2f0 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:35.205598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 977/1936] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:35 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:35.206702 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974077ab-c8d2-48c1-a4cb-520fd533b2f0 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:35.208584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-974077ab-c8d2-48c1-a4cb-520fd533b2f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:35.223665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624ec53-d20b-4466-bdf3-b99e820b7899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:35.224530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624ec53-d20b-4466-bdf3-b99e820b7899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:35.224815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624ec53-d20b-4466-bdf3-b99e820b7899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:35.225086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624ec53-d20b-4466-bdf3-b99e820b7899 admin admin] PATH_INFO: `/v3/projects/e4a302d66f3a4bde815d9b476db88fc6` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:35.226328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624ec53-d20b-4466-bdf3-b99e820b7899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a302d66f3a4bde815d9b476db88fc6)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:35.228598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624ec53-d20b-4466-bdf3-b99e820b7899 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:35.285799 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a624ec53-d20b-4466-bdf3-b99e820b7899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a302d66f3a4bde815d9b476db88fc6', 'request_id': 'req-a624ec53-d20b-4466-bdf3-b99e820b7899'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:35.287513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974077ab-c8d2-48c1-a4cb-520fd533b2f0 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:35.291970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a624ec53-d20b-4466-bdf3-b99e820b7899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a302d66f3a4bde815d9b476db88fc6', 'request_id': 'req-a624ec53-d20b-4466-bdf3-b99e820b7899'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:35.299496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a624ec53-d20b-4466-bdf3-b99e820b7899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a302d66f3a4bde815d9b476db88fc6', 'request_id': 'req-a624ec53-d20b-4466-bdf3-b99e820b7899'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:35.300735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:35.314260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a624ec53-d20b-4466-bdf3-b99e820b7899 admin admin] The token cache is being invalidate because project e4a302d66f3a4bde815d9b476db88fc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:35.314665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a624ec53-d20b-4466-bdf3-b99e820b7899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:35.315373 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a624ec53-d20b-4466-bdf3-b99e820b7899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:35.317262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 960/1937] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:35 2022] DELETE /identity/v3/projects/e4a302d66f3a4bde815d9b476db88fc6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:35.318470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41baac78-d3c7-4160-bf7f-6de4179bbcb1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:35.318756 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41baac78-d3c7-4160-bf7f-6de4179bbcb1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:35.319028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41baac78-d3c7-4160-bf7f-6de4179bbcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:35.336756 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-41baac78-d3c7-4160-bf7f-6de4179bbcb1 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:35.337985 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-41baac78-d3c7-4160-bf7f-6de4179bbcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:35.349955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591fdd7-ffe8-4b0d-9bcc-26e1abb6f23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:35.350738 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591fdd7-ffe8-4b0d-9bcc-26e1abb6f23d admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:35.351019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591fdd7-ffe8-4b0d-9bcc-26e1abb6f23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:35.351299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591fdd7-ffe8-4b0d-9bcc-26e1abb6f23d admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:35.352033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591fdd7-ffe8-4b0d-9bcc-26e1abb6f23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:35.353624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591fdd7-ffe8-4b0d-9bcc-26e1abb6f23d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:35.365348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 978/1938] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:35.366133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591fdd7-ffe8-4b0d-9bcc-26e1abb6f23d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:35.369575 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5591fdd7-ffe8-4b0d-9bcc-26e1abb6f23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:35.381935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591fdd7-ffe8-4b0d-9bcc-26e1abb6f23d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:35.386684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702af22-9519-45ed-8d77-ed7e3e13b11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:35.387343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702af22-9519-45ed-8d77-ed7e3e13b11f admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:35.387626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702af22-9519-45ed-8d77-ed7e3e13b11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:35.387950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702af22-9519-45ed-8d77-ed7e3e13b11f admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:35.388642 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702af22-9519-45ed-8d77-ed7e3e13b11f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:35.390599 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702af22-9519-45ed-8d77-ed7e3e13b11f admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:35.399316 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 961/1939] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:35.400147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41baac78-d3c7-4160-bf7f-6de4179bbcb1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:35.401406 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-41baac78-d3c7-4160-bf7f-6de4179bbcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:35.414657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41baac78-d3c7-4160-bf7f-6de4179bbcb1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:35.417792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 979/1940] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:35 2022] POST /identity/v3/users => generated 284 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:35.418671 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702af22-9519-45ed-8d77-ed7e3e13b11f admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:35.420610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-7702af22-9519-45ed-8d77-ed7e3e13b11f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:35.423767 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7e0ae-c9f6-4e1b-a2d5-0cb0073caab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:35.424764 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e0ae-c9f6-4e1b-a2d5-0cb0073caab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:35.425184 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e0ae-c9f6-4e1b-a2d5-0cb0073caab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:35.425536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e0ae-c9f6-4e1b-a2d5-0cb0073caab3 admin admin] PATH_INFO: `/v3/users/a38c05bbdaf748e09797acb20e1ecbc0` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:35.426977 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7e0ae-c9f6-4e1b-a2d5-0cb0073caab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a38c05bbdaf748e09797acb20e1ecbc0)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:35.429945 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef7e0ae-c9f6-4e1b-a2d5-0cb0073caab3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:35.432602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702af22-9519-45ed-8d77-ed7e3e13b11f admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:35.437397 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de3269-8325-451e-af20-f3ef762853ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:35.438292 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de3269-8325-451e-af20-f3ef762853ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:35.438614 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de3269-8325-451e-af20-f3ef762853ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:35.439427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de3269-8325-451e-af20-f3ef762853ec admin admin] PATH_INFO: `/v3/projects/426e75174f744cf2b51be546d3d32ed2/users/59b028d2a0404f5bbb49ecc06e69a73c/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:35.441124 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de3269-8325-451e-af20-f3ef762853ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=426e75174f744cf2b51be546d3d32ed2, user_id=59b028d2a0404f5bbb49ecc06e69a73c, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:35.443832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de3269-8325-451e-af20-f3ef762853ec admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:35.455524 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 980/1941] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:35 2022] PUT /identity/v3/projects/426e75174f744cf2b51be546d3d32ed2/users/59b028d2a0404f5bbb49ecc06e69a73c/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:35.456384 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de3269-8325-451e-af20-f3ef762853ec admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:35.467904 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a8de3269-8325-451e-af20-f3ef762853ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:35.488989 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8ef7e0ae-c9f6-4e1b-a2d5-0cb0073caab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a38c05bbdaf748e09797acb20e1ecbc0'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:35.499670 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8ef7e0ae-c9f6-4e1b-a2d5-0cb0073caab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a38c05bbdaf748e09797acb20e1ecbc0'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:35.500952 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8ef7e0ae-c9f6-4e1b-a2d5-0cb0073caab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a38c05bbdaf748e09797acb20e1ecbc0'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:35.515175 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8ef7e0ae-c9f6-4e1b-a2d5-0cb0073caab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a38c05bbdaf748e09797acb20e1ecbc0'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:35.519620 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:35.522548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8ef7e0ae-c9f6-4e1b-a2d5-0cb0073caab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a38c05bbdaf748e09797acb20e1ecbc0'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:35.531687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 962/1942] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:35 2022] DELETE /identity/v3/users/a38c05bbdaf748e09797acb20e1ecbc0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:35.531687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7e0ae-c9f6-4e1b-a2d5-0cb0073caab3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:35.531687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8ef7e0ae-c9f6-4e1b-a2d5-0cb0073caab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:35.541042 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de3269-8325-451e-af20-f3ef762853ec admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:35.604268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f60f8f-d8f2-453e-b80a-a0b47917a853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:35.604942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f60f8f-d8f2-453e-b80a-a0b47917a853 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:35.605235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f60f8f-d8f2-453e-b80a-a0b47917a853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:35.605695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f60f8f-d8f2-453e-b80a-a0b47917a853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:35.607472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-21f60f8f-d8f2-453e-b80a-a0b47917a853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:35.627659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7e0ae-c9f6-4e1b-a2d5-0cb0073caab3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:35.633183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a6ca7-89e6-45f9-9156-1325074fe795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:35.634407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a6ca7-89e6-45f9-9156-1325074fe795 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:35.634894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a6ca7-89e6-45f9-9156-1325074fe795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:35.635389 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a6ca7-89e6-45f9-9156-1325074fe795 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:35.636662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a6ca7-89e6-45f9-9156-1325074fe795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:35.639316 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a6ca7-89e6-45f9-9156-1325074fe795 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:35.646454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:35.652689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 963/1943] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:35.654196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc487773-a5e2-4ea3-96f7-7f64b81fabda None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:35.654582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc487773-a5e2-4ea3-96f7-7f64b81fabda None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:35.654949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc487773-a5e2-4ea3-96f7-7f64b81fabda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:35.684930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f60f8f-d8f2-453e-b80a-a0b47917a853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:35.685717 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f60f8f-d8f2-453e-b80a-a0b47917a853 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:35.687732 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cc487773-a5e2-4ea3-96f7-7f64b81fabda None None] MFA Rules not processed for user `59b028d2a0404f5bbb49ecc06e69a73c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:35.688946 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cc487773-a5e2-4ea3-96f7-7f64b81fabda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:35.696865 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 981/1944] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:35.697719 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f60f8f-d8f2-453e-b80a-a0b47917a853 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:35.710020 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f60f8f-d8f2-453e-b80a-a0b47917a853 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:35.714886 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b2d02-7ce5-4afa-a04a-0758887f4779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:35.715561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b2d02-7ce5-4afa-a04a-0758887f4779 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:35.715969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b2d02-7ce5-4afa-a04a-0758887f4779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:35.716273 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b2d02-7ce5-4afa-a04a-0758887f4779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:35.716994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b2d02-7ce5-4afa-a04a-0758887f4779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:35.718655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b2d02-7ce5-4afa-a04a-0758887f4779 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:35.732381 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 982/1945] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:35.752169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b2d02-7ce5-4afa-a04a-0758887f4779 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:35.774485 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b2d02-7ce5-4afa-a04a-0758887f4779 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:35.784342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99077c-d56d-4775-a856-48f33a7b506c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:35.785491 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99077c-d56d-4775-a856-48f33a7b506c admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:35.785491 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99077c-d56d-4775-a856-48f33a7b506c admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:35.785784 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99077c-d56d-4775-a856-48f33a7b506c admin admin] PATH_INFO: `/v3/projects/3be75e9d85d44544aa99c6071861f53f/users/1913ed7d5af1404cb2a09114fda8ab06/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:35.803025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99077c-d56d-4775-a856-48f33a7b506c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be75e9d85d44544aa99c6071861f53f, user_id=1913ed7d5af1404cb2a09114fda8ab06, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:35.805708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99077c-d56d-4775-a856-48f33a7b506c admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:35.830411 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 983/1946] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:35 2022] PUT /identity/v3/projects/3be75e9d85d44544aa99c6071861f53f/users/1913ed7d5af1404cb2a09114fda8ab06/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:35.832225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 964/1947] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:35.833622 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a28954-568a-43b9-bcb9-9a2c09e3303e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:35.833915 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a28954-568a-43b9-bcb9-9a2c09e3303e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:35.834190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a28954-568a-43b9-bcb9-9a2c09e3303e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:35.845703 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc487773-a5e2-4ea3-96f7-7f64b81fabda None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:35.848225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cc487773-a5e2-4ea3-96f7-7f64b81fabda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:35.874560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-b6a28954-568a-43b9-bcb9-9a2c09e3303e None None] MFA Rules not processed for user `1913ed7d5af1404cb2a09114fda8ab06`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:35.876247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b6a28954-568a-43b9-bcb9-9a2c09e3303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:36.013037 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc487773-a5e2-4ea3-96f7-7f64b81fabda None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:36.068230 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:36.081025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 984/1948] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:36.082179 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a28954-568a-43b9-bcb9-9a2c09e3303e None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:36.134977 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73515775-f382-40af-b9a1-412cb4715bec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:36.136233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73515775-f382-40af-b9a1-412cb4715bec service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:36.136681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73515775-f382-40af-b9a1-412cb4715bec service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:36.137131 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73515775-f382-40af-b9a1-412cb4715bec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:36.191024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a28954-568a-43b9-bcb9-9a2c09e3303e None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:36.205663 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be70bd-ef2f-450f-a4d4-05ba83cf9d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:36.206683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be70bd-ef2f-450f-a4d4-05ba83cf9d5a admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:36.207003 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be70bd-ef2f-450f-a4d4-05ba83cf9d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:36.207325 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be70bd-ef2f-450f-a4d4-05ba83cf9d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:36.215594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:36.226559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be70bd-ef2f-450f-a4d4-05ba83cf9d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:36.230163 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73515775-f382-40af-b9a1-412cb4715bec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:36.232419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73515775-f382-40af-b9a1-412cb4715bec service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:36.233805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be70bd-ef2f-450f-a4d4-05ba83cf9d5a admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:36.246621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 965/1949] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:36.252131 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73515775-f382-40af-b9a1-412cb4715bec service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:36.253600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-73515775-f382-40af-b9a1-412cb4715bec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:36.276056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73515775-f382-40af-b9a1-412cb4715bec service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:36.281637 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:36.282562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:36.282846 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:36.283412 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b admin admin] PATH_INFO: `/v3/projects/ed6018c8cf9242718cc00d230f472b8e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:36.284784 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed6018c8cf9242718cc00d230f472b8e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:36.286904 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:36.317955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 985/1950] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:36 2022] POST /identity/v3/projects => generated 365 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:36.322688 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be70bd-ef2f-450f-a4d4-05ba83cf9d5a admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:36.358063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed6018c8cf9242718cc00d230f472b8e', 'request_id': 'req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:36.371615 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed6018c8cf9242718cc00d230f472b8e', 'request_id': 'req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:36.380676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed6018c8cf9242718cc00d230f472b8e', 'request_id': 'req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:36.400199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b admin admin] The token cache is being invalidate because project ed6018c8cf9242718cc00d230f472b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:36.400493 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:36.401629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:36.406594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 966/1951] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:36 2022] DELETE /identity/v3/projects/ed6018c8cf9242718cc00d230f472b8e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:36.406594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:36.406594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:36.420516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be70bd-ef2f-450f-a4d4-05ba83cf9d5a admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:36.474516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9a9e8-e5e9-4ffd-84a6-e91ca8e4281b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:36.478954 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4f22b-72d5-48a2-99cd-3cf8d22a6a79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:36.479642 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4f22b-72d5-48a2-99cd-3cf8d22a6a79 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:36.479928 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4f22b-72d5-48a2-99cd-3cf8d22a6a79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:36.480206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4f22b-72d5-48a2-99cd-3cf8d22a6a79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:36.482785 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-49b4f22b-72d5-48a2-99cd-3cf8d22a6a79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:36.505018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40638ca6-e818-4c6d-b204-c941aa222686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:36.506355 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40638ca6-e818-4c6d-b204-c941aa222686 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:36.506899 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40638ca6-e818-4c6d-b204-c941aa222686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:36.507244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40638ca6-e818-4c6d-b204-c941aa222686 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:36.509063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40638ca6-e818-4c6d-b204-c941aa222686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:36.512348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40638ca6-e818-4c6d-b204-c941aa222686 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:36.550976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 986/1952] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:36 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:18:36.552753 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6553cf-0842-4baf-a7d2-45bda3d550be None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:36.553050 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6553cf-0842-4baf-a7d2-45bda3d550be None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:36.553558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6553cf-0842-4baf-a7d2-45bda3d550be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:36.561210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4f22b-72d5-48a2-99cd-3cf8d22a6a79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:36.564286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4f22b-72d5-48a2-99cd-3cf8d22a6a79 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:36.575534 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-ec6553cf-0842-4baf-a7d2-45bda3d550be None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:36.577014 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ec6553cf-0842-4baf-a7d2-45bda3d550be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:36.582536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 967/1953] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:36.583881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4f22b-72d5-48a2-99cd-3cf8d22a6a79 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:36.585937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-49b4f22b-72d5-48a2-99cd-3cf8d22a6a79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:36.586559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 987/1954] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:36.595207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80055f17-5613-4f28-9a5b-d0eb3f8d2026 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:36.595540 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80055f17-5613-4f28-9a5b-d0eb3f8d2026 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:36.595847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80055f17-5613-4f28-9a5b-d0eb3f8d2026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:36.605393 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4f22b-72d5-48a2-99cd-3cf8d22a6a79 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:36.612727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a39e18-277b-4d5e-9a48-43a86315a884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:36.613458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a39e18-277b-4d5e-9a48-43a86315a884 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:36.613749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a39e18-277b-4d5e-9a48-43a86315a884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:36.614027 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a39e18-277b-4d5e-9a48-43a86315a884 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:36.615115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a39e18-277b-4d5e-9a48-43a86315a884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:36.616396 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a39e18-277b-4d5e-9a48-43a86315a884 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:36.617025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-80055f17-5613-4f28-9a5b-d0eb3f8d2026 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:36.618577 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-80055f17-5613-4f28-9a5b-d0eb3f8d2026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:36.629864 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 968/1955] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:36.633777 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a39e18-277b-4d5e-9a48-43a86315a884 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:36.634449 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 988/1956] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:36.635592 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80055f17-5613-4f28-9a5b-d0eb3f8d2026 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:36.645840 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80055f17-5613-4f28-9a5b-d0eb3f8d2026 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:36.646329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a39e18-277b-4d5e-9a48-43a86315a884 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:36.652519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401824c-712f-4df7-a2e4-285c284f3f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:36.653100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e58b2-d711-4144-b067-089b380638cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:36.653784 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401824c-712f-4df7-a2e4-285c284f3f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:36.654134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401824c-712f-4df7-a2e4-285c284f3f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:36.654254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e58b2-d711-4144-b067-089b380638cd admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:36.654576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401824c-712f-4df7-a2e4-285c284f3f81 admin admin] PATH_INFO: `/v3/projects/749e6e206f6f4c038f9603c04cd544ce/users/ff49bb924a5c4c149f51809a964c9d09/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:36.654703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e58b2-d711-4144-b067-089b380638cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:36.655151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e58b2-d711-4144-b067-089b380638cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:36.656650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e58b2-d711-4144-b067-089b380638cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:36.657258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e58b2-d711-4144-b067-089b380638cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:36.659594 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e58b2-d711-4144-b067-089b380638cd admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:36.662362 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:36.675351 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401824c-712f-4df7-a2e4-285c284f3f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=749e6e206f6f4c038f9603c04cd544ce, user_id=ff49bb924a5c4c149f51809a964c9d09, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:36.677764 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401824c-712f-4df7-a2e4-285c284f3f81 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:36.678795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 989/1957] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:36.679707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e58b2-d711-4144-b067-089b380638cd admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:36.681384 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:36.692096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e58b2-d711-4144-b067-089b380638cd admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:36.702442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 969/1958] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:36 2022] PUT /identity/v3/projects/749e6e206f6f4c038f9603c04cd544ce/users/ff49bb924a5c4c149f51809a964c9d09/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:36.706649 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401824c-712f-4df7-a2e4-285c284f3f81 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:36.755675 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc4885-8939-4342-930b-1a4fd7f72e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:36.755930 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc4885-8939-4342-930b-1a4fd7f72e29 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:36.756242 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc4885-8939-4342-930b-1a4fd7f72e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:36.756530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc4885-8939-4342-930b-1a4fd7f72e29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:36.757260 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc4885-8939-4342-930b-1a4fd7f72e29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:36.759595 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc4885-8939-4342-930b-1a4fd7f72e29 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:36.797845 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401824c-712f-4df7-a2e4-285c284f3f81 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:36.804319 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 990/1959] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:36 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:36.805769 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc4885-8939-4342-930b-1a4fd7f72e29 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:36.888435 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4b501-7230-423a-9ffb-8c2e7664bafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:36.889666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4b501-7230-423a-9ffb-8c2e7664bafc admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:36.890159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4b501-7230-423a-9ffb-8c2e7664bafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:36.890672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4b501-7230-423a-9ffb-8c2e7664bafc admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:36.892118 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4b501-7230-423a-9ffb-8c2e7664bafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:36.892692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc4885-8939-4342-930b-1a4fd7f72e29 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:36.894695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4b501-7230-423a-9ffb-8c2e7664bafc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:36.898307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b9dbe-5504-41c7-b4ab-e9e2cf20676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:36.899986 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b9dbe-5504-41c7-b4ab-e9e2cf20676c admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:36.900279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b9dbe-5504-41c7-b4ab-e9e2cf20676c admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:36.900562 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b9dbe-5504-41c7-b4ab-e9e2cf20676c admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:36.901274 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b9dbe-5504-41c7-b4ab-e9e2cf20676c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:36.903735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b9dbe-5504-41c7-b4ab-e9e2cf20676c admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:36.908582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 970/1960] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:36.910162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4b501-7230-423a-9ffb-8c2e7664bafc admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:36.913149 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-35d4b501-7230-423a-9ffb-8c2e7664bafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:36.930903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4b501-7230-423a-9ffb-8c2e7664bafc admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:36.937150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186d303-da45-4134-b68b-c6e69f2618ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:36.938704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186d303-da45-4134-b68b-c6e69f2618ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:36.939088 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186d303-da45-4134-b68b-c6e69f2618ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:36.939492 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186d303-da45-4134-b68b-c6e69f2618ed admin admin] PATH_INFO: `/v3/projects/db7138b2ece84a928e6d2eff2c7d5a0b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:36.941113 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186d303-da45-4134-b68b-c6e69f2618ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=db7138b2ece84a928e6d2eff2c7d5a0b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:36.943850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186d303-da45-4134-b68b-c6e69f2618ed admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:36.955836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 991/1961] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:36 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:36.956736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b9dbe-5504-41c7-b4ab-e9e2cf20676c admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:36.979395 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b9dbe-5504-41c7-b4ab-e9e2cf20676c admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:36.985560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dea0f-4caf-45f0-a9da-97daababe81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:36.986638 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dea0f-4caf-45f0-a9da-97daababe81b admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:36.986921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dea0f-4caf-45f0-a9da-97daababe81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:36.987202 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dea0f-4caf-45f0-a9da-97daababe81b admin admin] PATH_INFO: `/v3/projects/749e6e206f6f4c038f9603c04cd544ce/users/ff49bb924a5c4c149f51809a964c9d09/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:36.990072 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dea0f-4caf-45f0-a9da-97daababe81b admin admin] RBAC: Authorizing `identity:create_grant(project_id=749e6e206f6f4c038f9603c04cd544ce, user_id=ff49bb924a5c4c149f51809a964c9d09, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:36.992974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dea0f-4caf-45f0-a9da-97daababe81b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:37.004925 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b186d303-da45-4134-b68b-c6e69f2618ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db7138b2ece84a928e6d2eff2c7d5a0b', 'request_id': 'req-b186d303-da45-4134-b68b-c6e69f2618ed'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:37.007263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 992/1962] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:36 2022] PUT /identity/v3/projects/749e6e206f6f4c038f9603c04cd544ce/users/ff49bb924a5c4c149f51809a964c9d09/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:37.008154 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dea0f-4caf-45f0-a9da-97daababe81b admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:37.033440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b186d303-da45-4134-b68b-c6e69f2618ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db7138b2ece84a928e6d2eff2c7d5a0b', 'request_id': 'req-b186d303-da45-4134-b68b-c6e69f2618ed'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:37.043406 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b186d303-da45-4134-b68b-c6e69f2618ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db7138b2ece84a928e6d2eff2c7d5a0b', 'request_id': 'req-b186d303-da45-4134-b68b-c6e69f2618ed'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:37.063081 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b186d303-da45-4134-b68b-c6e69f2618ed admin admin] The token cache is being invalidate because project db7138b2ece84a928e6d2eff2c7d5a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:37.063472 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b186d303-da45-4134-b68b-c6e69f2618ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:37.065031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b186d303-da45-4134-b68b-c6e69f2618ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:37.070239 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 971/1963] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:36 2022] DELETE /identity/v3/projects/db7138b2ece84a928e6d2eff2c7d5a0b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:37.073341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31252f1f-7884-48ae-8ad2-d9ba6b830eef None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:37.073554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31252f1f-7884-48ae-8ad2-d9ba6b830eef None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:37.073923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31252f1f-7884-48ae-8ad2-d9ba6b830eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:37.123000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-31252f1f-7884-48ae-8ad2-d9ba6b830eef None None] MFA Rules not processed for user `ff49bb924a5c4c149f51809a964c9d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:37.124426 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-31252f1f-7884-48ae-8ad2-d9ba6b830eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:37.146717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:37.154272 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:37.162023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dea0f-4caf-45f0-a9da-97daababe81b admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:37.171070 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548e475-0241-4403-971a-894fff84570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:37.172344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548e475-0241-4403-971a-894fff84570a admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:37.173057 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548e475-0241-4403-971a-894fff84570a admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:37.173560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548e475-0241-4403-971a-894fff84570a admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:37.174597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548e475-0241-4403-971a-894fff84570a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:37.176572 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548e475-0241-4403-971a-894fff84570a admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:37.188474 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 993/1964] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:37.189652 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548e475-0241-4403-971a-894fff84570a admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:37.213826 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-7548e475-0241-4403-971a-894fff84570a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:37.241950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548e475-0241-4403-971a-894fff84570a admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:37.247561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba02bf-27f1-4e65-8e50-1ba752f8a975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:37.248783 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba02bf-27f1-4e65-8e50-1ba752f8a975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:37.249063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba02bf-27f1-4e65-8e50-1ba752f8a975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:37.250559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba02bf-27f1-4e65-8e50-1ba752f8a975 admin admin] PATH_INFO: `/v3/users/995aef922dca4891be129b0ef2a52205` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:37.250867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba02bf-27f1-4e65-8e50-1ba752f8a975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=995aef922dca4891be129b0ef2a52205)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:37.253098 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba02bf-27f1-4e65-8e50-1ba752f8a975 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:37.253222 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 972/1965] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:37.254597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31252f1f-7884-48ae-8ad2-d9ba6b830eef None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:37.255569 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-31252f1f-7884-48ae-8ad2-d9ba6b830eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:37.277571 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31252f1f-7884-48ae-8ad2-d9ba6b830eef None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:37.284347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbbdad-5179-40f0-b27d-e6b1c9e3578d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:37.285098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbbdad-5179-40f0-b27d-e6b1c9e3578d admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:37.286253 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbbdad-5179-40f0-b27d-e6b1c9e3578d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:37.286615 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbbdad-5179-40f0-b27d-e6b1c9e3578d admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:37.287374 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbbdad-5179-40f0-b27d-e6b1c9e3578d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:37.289272 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbbdad-5179-40f0-b27d-e6b1c9e3578d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:37.309940 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 973/1966] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:37.311269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbbdad-5179-40f0-b27d-e6b1c9e3578d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:37.313223 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-96bbbdad-5179-40f0-b27d-e6b1c9e3578d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:37.341598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-95ba02bf-27f1-4e65-8e50-1ba752f8a975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '995aef922dca4891be129b0ef2a52205'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:37.354880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-95ba02bf-27f1-4e65-8e50-1ba752f8a975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '995aef922dca4891be129b0ef2a52205'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:37.357199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-95ba02bf-27f1-4e65-8e50-1ba752f8a975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '995aef922dca4891be129b0ef2a52205'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:37.377441 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-95ba02bf-27f1-4e65-8e50-1ba752f8a975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '995aef922dca4891be129b0ef2a52205'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:37.391668 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-95ba02bf-27f1-4e65-8e50-1ba752f8a975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '995aef922dca4891be129b0ef2a52205'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:37.399504 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 994/1967] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:37 2022] DELETE /identity/v3/users/995aef922dca4891be129b0ef2a52205 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:37.402924 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba02bf-27f1-4e65-8e50-1ba752f8a975 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:37.402924 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-95ba02bf-27f1-4e65-8e50-1ba752f8a975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:37.440967 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbbdad-5179-40f0-b27d-e6b1c9e3578d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:37.505153 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba02bf-27f1-4e65-8e50-1ba752f8a975 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:37.512158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b25a0b-29b4-4b3b-89a7-483b2ef26461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:37.513589 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b25a0b-29b4-4b3b-89a7-483b2ef26461 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:37.513872 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b25a0b-29b4-4b3b-89a7-483b2ef26461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:37.514549 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b25a0b-29b4-4b3b-89a7-483b2ef26461 admin admin] PATH_INFO: `/v3/projects/62f4b4582b2b49f997c66e678fdc22c1/users/ddf8aba12a6e43fe8486eba137834ff9/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:37.524022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11be64-7fc9-4cd1-8d51-6126519e46ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:37.525232 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11be64-7fc9-4cd1-8d51-6126519e46ae service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:37.525532 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11be64-7fc9-4cd1-8d51-6126519e46ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:37.525819 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11be64-7fc9-4cd1-8d51-6126519e46ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:37.528466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-db11be64-7fc9-4cd1-8d51-6126519e46ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:37.538120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b25a0b-29b4-4b3b-89a7-483b2ef26461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f4b4582b2b49f997c66e678fdc22c1, user_id=ddf8aba12a6e43fe8486eba137834ff9, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:37.542211 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b25a0b-29b4-4b3b-89a7-483b2ef26461 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:37.584271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 995/1968] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:37 2022] PUT /identity/v3/projects/62f4b4582b2b49f997c66e678fdc22c1/users/ddf8aba12a6e43fe8486eba137834ff9/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:37.596740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7201f94-66fe-4fc2-8a37-e7f1cbecd2e6 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:37.597141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7201f94-66fe-4fc2-8a37-e7f1cbecd2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:37.597533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7201f94-66fe-4fc2-8a37-e7f1cbecd2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:37.634885 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11be64-7fc9-4cd1-8d51-6126519e46ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:37.636896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-b7201f94-66fe-4fc2-8a37-e7f1cbecd2e6 None None] MFA Rules not processed for user `ddf8aba12a6e43fe8486eba137834ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:37.637573 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11be64-7fc9-4cd1-8d51-6126519e46ae service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:37.639358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b7201f94-66fe-4fc2-8a37-e7f1cbecd2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:37.644369 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:37.652531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 974/1969] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:37.691683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:37.744319 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 996/1970] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:37.745971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11be64-7fc9-4cd1-8d51-6126519e46ae service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:37.764372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11be64-7fc9-4cd1-8d51-6126519e46ae service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:37.807431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7201f94-66fe-4fc2-8a37-e7f1cbecd2e6 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:37.811184 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b7201f94-66fe-4fc2-8a37-e7f1cbecd2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:37.861820 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a774d-793c-42f0-9e4c-8496f757195b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:37.862738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a774d-793c-42f0-9e4c-8496f757195b admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:37.863244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a774d-793c-42f0-9e4c-8496f757195b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:37.863526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a774d-793c-42f0-9e4c-8496f757195b admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:37.864225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a774d-793c-42f0-9e4c-8496f757195b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:37.866167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a774d-793c-42f0-9e4c-8496f757195b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:37.890295 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7201f94-66fe-4fc2-8a37-e7f1cbecd2e6 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:37.893998 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb95507-f79f-4059-b95e-54d92f6e3ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:37.894731 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb95507-f79f-4059-b95e-54d92f6e3ffc service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:37.895009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb95507-f79f-4059-b95e-54d92f6e3ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:37.895288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb95507-f79f-4059-b95e-54d92f6e3ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:37.897079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-0cb95507-f79f-4059-b95e-54d92f6e3ffc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:37.897932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 975/1971] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:37 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:37.901796 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a774d-793c-42f0-9e4c-8496f757195b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:37.970174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb95507-f79f-4059-b95e-54d92f6e3ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:37.974900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb95507-f79f-4059-b95e-54d92f6e3ffc service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:37.983133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a774d-793c-42f0-9e4c-8496f757195b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:37.988193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a377d98-9ce7-4689-875f-83eb85a2b54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:37.988698 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 997/1972] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:37.989566 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb95507-f79f-4059-b95e-54d92f6e3ffc service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:37.991304 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-0cb95507-f79f-4059-b95e-54d92f6e3ffc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:37.999186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a377d98-9ce7-4689-875f-83eb85a2b54f admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:37.999481 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a377d98-9ce7-4689-875f-83eb85a2b54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:38.001395 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a377d98-9ce7-4689-875f-83eb85a2b54f admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:38.002163 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a377d98-9ce7-4689-875f-83eb85a2b54f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:38.004881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a377d98-9ce7-4689-875f-83eb85a2b54f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:38.011871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb95507-f79f-4059-b95e-54d92f6e3ffc service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:38.018330 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d393bd6-f280-4259-ba7c-f408effef123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:38.019262 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d393bd6-f280-4259-ba7c-f408effef123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:38.019612 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d393bd6-f280-4259-ba7c-f408effef123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:38.019921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d393bd6-f280-4259-ba7c-f408effef123 admin admin] PATH_INFO: `/v3/projects/ddb34d8613664824b5b2d43f8fdc241b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:38.021172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d393bd6-f280-4259-ba7c-f408effef123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb34d8613664824b5b2d43f8fdc241b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:38.023222 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d393bd6-f280-4259-ba7c-f408effef123 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:38.033672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 976/1973] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:37 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:18:38.037589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a377d98-9ce7-4689-875f-83eb85a2b54f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:38.049990 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a377d98-9ce7-4689-875f-83eb85a2b54f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:38.054964 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158568a-60c7-4822-8b48-0c2499e46abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:38.055629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158568a-60c7-4822-8b48-0c2499e46abc admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:38.055954 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158568a-60c7-4822-8b48-0c2499e46abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:38.056335 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158568a-60c7-4822-8b48-0c2499e46abc admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:38.057295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158568a-60c7-4822-8b48-0c2499e46abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:38.059077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158568a-60c7-4822-8b48-0c2499e46abc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:38.085961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 977/1974] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:38.087345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7d393bd6-f280-4259-ba7c-f408effef123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb34d8613664824b5b2d43f8fdc241b', 'request_id': 'req-7d393bd6-f280-4259-ba7c-f408effef123'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:38.094810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7d393bd6-f280-4259-ba7c-f408effef123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb34d8613664824b5b2d43f8fdc241b', 'request_id': 'req-7d393bd6-f280-4259-ba7c-f408effef123'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:38.104135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158568a-60c7-4822-8b48-0c2499e46abc admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:38.106495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7d393bd6-f280-4259-ba7c-f408effef123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb34d8613664824b5b2d43f8fdc241b', 'request_id': 'req-7d393bd6-f280-4259-ba7c-f408effef123'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:38.132717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158568a-60c7-4822-8b48-0c2499e46abc admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:38.142169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7d393bd6-f280-4259-ba7c-f408effef123 admin admin] The token cache is being invalidate because project ddb34d8613664824b5b2d43f8fdc241b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:38.142745 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7d393bd6-f280-4259-ba7c-f408effef123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:38.143952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7d393bd6-f280-4259-ba7c-f408effef123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:38.145618 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 998/1975] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:37 2022] DELETE /identity/v3/projects/ddb34d8613664824b5b2d43f8fdc241b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:38.155439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71f754-7d25-4fb2-a142-de9bd53832c6 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:38.155962 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71f754-7d25-4fb2-a142-de9bd53832c6 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:38.156038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71f754-7d25-4fb2-a142-de9bd53832c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:38.193977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-ac71f754-7d25-4fb2-a142-de9bd53832c6 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:38.200046 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ac71f754-7d25-4fb2-a142-de9bd53832c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:38.224038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:38.300465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d31a3b-836c-4fee-852a-7c38794bf61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:38.301583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d31a3b-836c-4fee-852a-7c38794bf61f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:38.302199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d31a3b-836c-4fee-852a-7c38794bf61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:38.302707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d31a3b-836c-4fee-852a-7c38794bf61f admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:38.303630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d31a3b-836c-4fee-852a-7c38794bf61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:38.311112 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d31a3b-836c-4fee-852a-7c38794bf61f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:38.320298 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:38.326721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 999/1976] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:38.335828 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc1f07-d910-4e1f-b88d-17ca0cd78944 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:38.338772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc1f07-d910-4e1f-b88d-17ca0cd78944 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:38.339071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc1f07-d910-4e1f-b88d-17ca0cd78944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:38.339818 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 978/1977] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:38.340862 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d31a3b-836c-4fee-852a-7c38794bf61f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:38.343106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-55d31a3b-836c-4fee-852a-7c38794bf61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:38.363873 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d31a3b-836c-4fee-852a-7c38794bf61f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:38.364787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-c3cc1f07-d910-4e1f-b88d-17ca0cd78944 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:38.366664 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c3cc1f07-d910-4e1f-b88d-17ca0cd78944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:38.376599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8f60b-991c-4b24-af39-0550b0379009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:38.380173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8f60b-991c-4b24-af39-0550b0379009 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:38.386267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8f60b-991c-4b24-af39-0550b0379009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:38.386267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8f60b-991c-4b24-af39-0550b0379009 admin admin] PATH_INFO: `/v3/projects/ef24a1aeb0a54dd6a41ac2ad771b724f/users/936cd988d8484c4a9e9bcae44cef6b5c/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:38.404463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1000/1978] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:38.407483 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc1f07-d910-4e1f-b88d-17ca0cd78944 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:38.423236 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8f60b-991c-4b24-af39-0550b0379009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef24a1aeb0a54dd6a41ac2ad771b724f, user_id=936cd988d8484c4a9e9bcae44cef6b5c, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:38.426025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8f60b-991c-4b24-af39-0550b0379009 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:38.432769 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc1f07-d910-4e1f-b88d-17ca0cd78944 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:38.444889 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8e735-a932-4035-b553-5562c9f74f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:38.446082 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 979/1979] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:38 2022] PUT /identity/v3/projects/ef24a1aeb0a54dd6a41ac2ad771b724f/users/936cd988d8484c4a9e9bcae44cef6b5c/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:38.455328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8e735-a932-4035-b553-5562c9f74f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:38.457159 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8e735-a932-4035-b553-5562c9f74f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:38.457687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8e735-a932-4035-b553-5562c9f74f5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:38.461298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8e735-a932-4035-b553-5562c9f74f5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:38.461439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee74500-727c-4605-934f-1babc8f19b7b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:38.461620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee74500-727c-4605-934f-1babc8f19b7b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:38.461901 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee74500-727c-4605-934f-1babc8f19b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:38.466047 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8e735-a932-4035-b553-5562c9f74f5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:38.469104 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8e735-a932-4035-b553-5562c9f74f5b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:38.502644 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1001/1980] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:38.508039 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8e735-a932-4035-b553-5562c9f74f5b admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:38.510378 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7ee74500-727c-4605-934f-1babc8f19b7b None None] MFA Rules not processed for user `936cd988d8484c4a9e9bcae44cef6b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:38.512220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7ee74500-727c-4605-934f-1babc8f19b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:38.526864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8e735-a932-4035-b553-5562c9f74f5b admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:38.638025 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 980/1981] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:38.639445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee74500-727c-4605-934f-1babc8f19b7b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:38.671044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb453e89-d443-49d0-9322-e915f7425c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:38.671728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb453e89-d443-49d0-9322-e915f7425c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:38.672009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb453e89-d443-49d0-9322-e915f7425c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:38.678490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb453e89-d443-49d0-9322-e915f7425c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:38.679687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb453e89-d443-49d0-9322-e915f7425c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:38.682048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb453e89-d443-49d0-9322-e915f7425c29 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:38.734548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee74500-727c-4605-934f-1babc8f19b7b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:38.744816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1002/1982] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:38 2022] POST /identity/v3/projects => generated 381 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:18:38.746408 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e39c33-19b4-41a3-a984-a270d6eb417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:38.746957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb453e89-d443-49d0-9322-e915f7425c29 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:38.748112 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e39c33-19b4-41a3-a984-a270d6eb417c admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:38.748702 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e39c33-19b4-41a3-a984-a270d6eb417c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:38.749258 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e39c33-19b4-41a3-a984-a270d6eb417c admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:38.750726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e39c33-19b4-41a3-a984-a270d6eb417c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:38.754311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e39c33-19b4-41a3-a984-a270d6eb417c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:38.801697 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 981/1983] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:38 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:38.805443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e39c33-19b4-41a3-a984-a270d6eb417c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:38.878163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb453e89-d443-49d0-9322-e915f7425c29 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:38.894998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:38.908976 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e39c33-19b4-41a3-a984-a270d6eb417c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:38.915685 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0a5bf-3bd7-4462-8e5e-1c4475dd7258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:38.916506 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0a5bf-3bd7-4462-8e5e-1c4475dd7258 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:38.916799 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0a5bf-3bd7-4462-8e5e-1c4475dd7258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:38.917079 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0a5bf-3bd7-4462-8e5e-1c4475dd7258 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:38.917784 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0a5bf-3bd7-4462-8e5e-1c4475dd7258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:38.920064 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0a5bf-3bd7-4462-8e5e-1c4475dd7258 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:38.922001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:38.950425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 982/1984] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:38 2022] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:38.950425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0a5bf-3bd7-4462-8e5e-1c4475dd7258 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:38.963128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0a5bf-3bd7-4462-8e5e-1c4475dd7258 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:38.967946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4098b22-4568-4b33-97b9-9966db431ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:38.968773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdf188-3483-4233-b0f9-8dc76174cc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:38.970076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdf188-3483-4233-b0f9-8dc76174cc1a admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:38.970076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdf188-3483-4233-b0f9-8dc76174cc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:38.970076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdf188-3483-4233-b0f9-8dc76174cc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:38.970978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdf188-3483-4233-b0f9-8dc76174cc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:38.972660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdf188-3483-4233-b0f9-8dc76174cc1a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:38.975870 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098b22-4568-4b33-97b9-9966db431ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:38.976328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098b22-4568-4b33-97b9-9966db431ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:38.976781 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098b22-4568-4b33-97b9-9966db431ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:38.977650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4098b22-4568-4b33-97b9-9966db431ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:38.979868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4098b22-4568-4b33-97b9-9966db431ef5 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:38.990676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 983/1985] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:38.992204 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdf188-3483-4233-b0f9-8dc76174cc1a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:39.005328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdf188-3483-4233-b0f9-8dc76174cc1a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:39.008735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1003/1986] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:38 2022] POST /identity/v3/users => generated 291 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:39.009765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4098b22-4568-4b33-97b9-9966db431ef5 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:39.018750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55077b7a-28d8-409c-a652-6820e20c25e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:39.020092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077b7a-28d8-409c-a652-6820e20c25e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.020378 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077b7a-28d8-409c-a652-6820e20c25e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.020794 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077b7a-28d8-409c-a652-6820e20c25e1 admin admin] PATH_INFO: `/v3/projects/7397632bb6324b4f874505b11c7e06ba/users/38efb962f62c4f7ea21c337df0b5f6d5/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.021505 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4098b22-4568-4b33-97b9-9966db431ef5 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:39.026912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f85f2-b8b7-4623-aadd-dd7ff7d266e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:39.027713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f85f2-b8b7-4623-aadd-dd7ff7d266e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.028001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f85f2-b8b7-4623-aadd-dd7ff7d266e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.028342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f85f2-b8b7-4623-aadd-dd7ff7d266e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.029073 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f85f2-b8b7-4623-aadd-dd7ff7d266e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:39.030809 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f85f2-b8b7-4623-aadd-dd7ff7d266e2 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:39.038176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55077b7a-28d8-409c-a652-6820e20c25e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7397632bb6324b4f874505b11c7e06ba, user_id=38efb962f62c4f7ea21c337df0b5f6d5, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:39.040987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55077b7a-28d8-409c-a652-6820e20c25e1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:39.041423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1004/1987] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:18:39.045796 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f85f2-b8b7-4623-aadd-dd7ff7d266e2 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:39.054818 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 984/1988] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:38 2022] PUT /identity/v3/projects/7397632bb6324b4f874505b11c7e06ba/users/38efb962f62c4f7ea21c337df0b5f6d5/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:39.056214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f85f2-b8b7-4623-aadd-dd7ff7d266e2 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:39.058897 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55077b7a-28d8-409c-a652-6820e20c25e1 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:39.114555 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adfed1-cd6f-4935-8146-62bd3d1ad91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:39.115533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adfed1-cd6f-4935-8146-62bd3d1ad91e admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.115971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adfed1-cd6f-4935-8146-62bd3d1ad91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.116301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adfed1-cd6f-4935-8146-62bd3d1ad91e admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.117135 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adfed1-cd6f-4935-8146-62bd3d1ad91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:39.119022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adfed1-cd6f-4935-8146-62bd3d1ad91e admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:39.129018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55077b7a-28d8-409c-a652-6820e20c25e1 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:39.133832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1005/1989] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:39.135781 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664e543-0ef4-43a4-9183-1cb7711b407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:39.136612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664e543-0ef4-43a4-9183-1cb7711b407b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.137231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664e543-0ef4-43a4-9183-1cb7711b407b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.137680 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664e543-0ef4-43a4-9183-1cb7711b407b admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.138628 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adfed1-cd6f-4935-8146-62bd3d1ad91e admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:39.138751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664e543-0ef4-43a4-9183-1cb7711b407b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:39.140513 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664e543-0ef4-43a4-9183-1cb7711b407b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:39.148350 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adfed1-cd6f-4935-8146-62bd3d1ad91e admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:39.157472 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 985/1990] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:39.157643 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85049c-e219-4134-9cb2-a5d8d5126de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:39.157643 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85049c-e219-4134-9cb2-a5d8d5126de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.157643 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85049c-e219-4134-9cb2-a5d8d5126de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.157643 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85049c-e219-4134-9cb2-a5d8d5126de4 admin admin] PATH_INFO: `/v3/projects/0ee0fc41308e43e9abed9bf247cd569a/users/ebb0ec9550984ee0a54b19763b7ca161/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.158698 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664e543-0ef4-43a4-9183-1cb7711b407b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:39.170624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664e543-0ef4-43a4-9183-1cb7711b407b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:39.175723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c0dbd-8e5d-4e41-bb42-228104651168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:39.176628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c0dbd-8e5d-4e41-bb42-228104651168 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.176921 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c0dbd-8e5d-4e41-bb42-228104651168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.177191 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c0dbd-8e5d-4e41-bb42-228104651168 admin admin] PATH_INFO: `/v3/projects/7397632bb6324b4f874505b11c7e06ba/users/38efb962f62c4f7ea21c337df0b5f6d5/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.179207 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c0dbd-8e5d-4e41-bb42-228104651168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7397632bb6324b4f874505b11c7e06ba, user_id=38efb962f62c4f7ea21c337df0b5f6d5, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:39.182074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c0dbd-8e5d-4e41-bb42-228104651168 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:39.183665 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85049c-e219-4134-9cb2-a5d8d5126de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ee0fc41308e43e9abed9bf247cd569a, user_id=ebb0ec9550984ee0a54b19763b7ca161, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:39.186852 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85049c-e219-4134-9cb2-a5d8d5126de4 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:39.197079 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 986/1991] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:39 2022] PUT /identity/v3/projects/7397632bb6324b4f874505b11c7e06ba/users/38efb962f62c4f7ea21c337df0b5f6d5/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:39.212496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9692f89-ba58-4f4d-a048-fc67b8c2c7d8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.213432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9692f89-ba58-4f4d-a048-fc67b8c2c7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.213729 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9692f89-ba58-4f4d-a048-fc67b8c2c7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.218708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1006/1992] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:39 2022] PUT /identity/v3/projects/0ee0fc41308e43e9abed9bf247cd569a/users/ebb0ec9550984ee0a54b19763b7ca161/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:39.229813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9621688-cdfc-4d80-86b3-4a53dbffe976 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.230570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9621688-cdfc-4d80-86b3-4a53dbffe976 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.231170 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9621688-cdfc-4d80-86b3-4a53dbffe976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.258712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f9692f89-ba58-4f4d-a048-fc67b8c2c7d8 None None] MFA Rules not processed for user `38efb962f62c4f7ea21c337df0b5f6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:39.260104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f9692f89-ba58-4f4d-a048-fc67b8c2c7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:39.286867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-d9621688-cdfc-4d80-86b3-4a53dbffe976 None None] MFA Rules not processed for user `ebb0ec9550984ee0a54b19763b7ca161`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:39.288822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d9621688-cdfc-4d80-86b3-4a53dbffe976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:39.358273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 987/1993] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:39.373062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9692f89-ba58-4f4d-a048-fc67b8c2c7d8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:39.375099 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f9692f89-ba58-4f4d-a048-fc67b8c2c7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:39.389871 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1007/1994] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:39.394661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9621688-cdfc-4d80-86b3-4a53dbffe976 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:39.395783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:39.407967 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:39.455854 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9692f89-ba58-4f4d-a048-fc67b8c2c7d8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:39.460260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab9703-4450-478a-aacd-666712ec2bb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:39.460925 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9703-4450-478a-aacd-666712ec2bb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.461214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9703-4450-478a-aacd-666712ec2bb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.461496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9703-4450-478a-aacd-666712ec2bb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.472490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab9703-4450-478a-aacd-666712ec2bb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:39.473961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab9703-4450-478a-aacd-666712ec2bb8 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:39.478455 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9621688-cdfc-4d80-86b3-4a53dbffe976 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:39.483488 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568b415-dd60-44c4-a39b-9d2ac836a77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:39.483847 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 988/1995] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:39.484236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568b415-dd60-44c4-a39b-9d2ac836a77e admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.484543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568b415-dd60-44c4-a39b-9d2ac836a77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.484824 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568b415-dd60-44c4-a39b-9d2ac836a77e admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.485601 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568b415-dd60-44c4-a39b-9d2ac836a77e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:39.487597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568b415-dd60-44c4-a39b-9d2ac836a77e admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:39.519359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1008/1996] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:39 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:39.523079 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab9703-4450-478a-aacd-666712ec2bb8 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:39.529416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568b415-dd60-44c4-a39b-9d2ac836a77e admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:39.531811 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b568b415-dd60-44c4-a39b-9d2ac836a77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:39.534215 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab9703-4450-478a-aacd-666712ec2bb8 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:39.590749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568b415-dd60-44c4-a39b-9d2ac836a77e admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:39.592103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fb333-2ee5-453c-a500-153b5b61d4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:39.592269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fb333-2ee5-453c-a500-153b5b61d4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.592505 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fb333-2ee5-453c-a500-153b5b61d4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.592747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fb333-2ee5-453c-a500-153b5b61d4a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.593455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fb333-2ee5-453c-a500-153b5b61d4a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:39.595414 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fb333-2ee5-453c-a500-153b5b61d4a3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:39.595593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee57726-deb5-4fd5-97e2-5a021cf6f3d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:39.596239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee57726-deb5-4fd5-97e2-5a021cf6f3d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.596519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee57726-deb5-4fd5-97e2-5a021cf6f3d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.596793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee57726-deb5-4fd5-97e2-5a021cf6f3d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.598620 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-fee57726-deb5-4fd5-97e2-5a021cf6f3d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:39.624128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 989/1997] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:39 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:39.625266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fb333-2ee5-453c-a500-153b5b61d4a3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:39.638995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fb333-2ee5-453c-a500-153b5b61d4a3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:39.644574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c4fbc-2440-4175-9529-18f8acf41c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:39.645543 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c4fbc-2440-4175-9529-18f8acf41c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.646182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c4fbc-2440-4175-9529-18f8acf41c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.646528 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c4fbc-2440-4175-9529-18f8acf41c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.648389 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c4fbc-2440-4175-9529-18f8acf41c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:39.649134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c4fbc-2440-4175-9529-18f8acf41c85 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:39.661769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 990/1998] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:39.665079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee57726-deb5-4fd5-97e2-5a021cf6f3d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:39.666107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c4fbc-2440-4175-9529-18f8acf41c85 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:39.666666 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee57726-deb5-4fd5-97e2-5a021cf6f3d0 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:39.677306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c4fbc-2440-4175-9529-18f8acf41c85 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:39.678248 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1009/1999] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:39.682481 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839eeb3-6aab-491d-b53f-b8d395e76b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:39.683375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839eeb3-6aab-491d-b53f-b8d395e76b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.683648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839eeb3-6aab-491d-b53f-b8d395e76b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.683898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839eeb3-6aab-491d-b53f-b8d395e76b6d admin admin] PATH_INFO: `/v3/projects/031438f5d9ec4019b619c859913c1402/users/5c0a5058b41d49bb816ca3d1d8cdb3ca/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.699821 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839eeb3-6aab-491d-b53f-b8d395e76b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=031438f5d9ec4019b619c859913c1402, user_id=5c0a5058b41d49bb816ca3d1d8cdb3ca, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:39.702727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839eeb3-6aab-491d-b53f-b8d395e76b6d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:39.730888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 991/2000] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:39 2022] PUT /identity/v3/projects/031438f5d9ec4019b619c859913c1402/users/5c0a5058b41d49bb816ca3d1d8cdb3ca/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:39.734946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee57726-deb5-4fd5-97e2-5a021cf6f3d0 service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:39.750650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee57726-deb5-4fd5-97e2-5a021cf6f3d0 service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:39.807710 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:39.828317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6148f7e-e417-470b-9fd2-19431046efcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:39.836863 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6148f7e-e417-470b-9fd2-19431046efcf admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.837540 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6148f7e-e417-470b-9fd2-19431046efcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.838015 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6148f7e-e417-470b-9fd2-19431046efcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.839071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6148f7e-e417-470b-9fd2-19431046efcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:39.840888 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6148f7e-e417-470b-9fd2-19431046efcf admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:39.853156 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1010/2001] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:18:39.857651 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839eeb3-6aab-491d-b53f-b8d395e76b6d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:39.870586 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839eeb3-6aab-491d-b53f-b8d395e76b6d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:39.878281 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c717b-50c7-4be4-89db-3874782f83e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:39.879235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c717b-50c7-4be4-89db-3874782f83e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.879519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c717b-50c7-4be4-89db-3874782f83e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.879967 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c717b-50c7-4be4-89db-3874782f83e8 admin admin] PATH_INFO: `/v3/projects/031438f5d9ec4019b619c859913c1402/users/5c0a5058b41d49bb816ca3d1d8cdb3ca/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.882570 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c717b-50c7-4be4-89db-3874782f83e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=031438f5d9ec4019b619c859913c1402, user_id=5c0a5058b41d49bb816ca3d1d8cdb3ca, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:39.885385 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c717b-50c7-4be4-89db-3874782f83e8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:39.900690 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 992/2002] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:39 2022] PUT /identity/v3/projects/031438f5d9ec4019b619c859913c1402/users/5c0a5058b41d49bb816ca3d1d8cdb3ca/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:39.912323 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2a40a-1ed6-49de-b6b8-e0783ae9f8d8 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:39.912749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2a40a-1ed6-49de-b6b8-e0783ae9f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:39.913212 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2a40a-1ed6-49de-b6b8-e0783ae9f8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:39.954197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-6ed2a40a-1ed6-49de-b6b8-e0783ae9f8d8 None None] MFA Rules not processed for user `5c0a5058b41d49bb816ca3d1d8cdb3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:39.955707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6ed2a40a-1ed6-49de-b6b8-e0783ae9f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:39.984881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c717b-50c7-4be4-89db-3874782f83e8 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:39.986747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-933c717b-50c7-4be4-89db-3874782f83e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:40.122355 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:40.127403 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c717b-50c7-4be4-89db-3874782f83e8 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:40.155958 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1011/2003] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:40.166619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1d8ed-ec4a-4cec-a888-97cfe7afa3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:40.167884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2a40a-1ed6-49de-b6b8-e0783ae9f8d8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:40.168399 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1d8ed-ec4a-4cec-a888-97cfe7afa3c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:40.170884 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1d8ed-ec4a-4cec-a888-97cfe7afa3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:40.174038 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1d8ed-ec4a-4cec-a888-97cfe7afa3c4 admin admin] PATH_INFO: `/v3/users/e44cbfc285544798be44b1db8dac6279` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:40.177096 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1d8ed-ec4a-4cec-a888-97cfe7afa3c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e44cbfc285544798be44b1db8dac6279)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:40.183382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1d8ed-ec4a-4cec-a888-97cfe7afa3c4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:40.275050 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14f1d8ed-ec4a-4cec-a888-97cfe7afa3c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e44cbfc285544798be44b1db8dac6279'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:40.290985 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14f1d8ed-ec4a-4cec-a888-97cfe7afa3c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e44cbfc285544798be44b1db8dac6279'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:40.292566 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14f1d8ed-ec4a-4cec-a888-97cfe7afa3c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e44cbfc285544798be44b1db8dac6279'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:40.303299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2a40a-1ed6-49de-b6b8-e0783ae9f8d8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:40.308271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23950748-da17-42ed-ba1f-40c6e1c1a99e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:40.309154 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23950748-da17-42ed-ba1f-40c6e1c1a99e service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:40.309565 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23950748-da17-42ed-ba1f-40c6e1c1a99e service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:40.309923 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23950748-da17-42ed-ba1f-40c6e1c1a99e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:40.312326 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-23950748-da17-42ed-ba1f-40c6e1c1a99e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:40.316230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14f1d8ed-ec4a-4cec-a888-97cfe7afa3c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e44cbfc285544798be44b1db8dac6279'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:40.326691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14f1d8ed-ec4a-4cec-a888-97cfe7afa3c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e44cbfc285544798be44b1db8dac6279'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:40.336457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 993/2004] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:39 2022] DELETE /identity/v3/users/e44cbfc285544798be44b1db8dac6279 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:40.340925 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605d16-302b-479e-ab70-b72b1d1fd566 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:40.341321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605d16-302b-479e-ab70-b72b1d1fd566 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:40.341713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605d16-302b-479e-ab70-b72b1d1fd566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:40.356894 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23950748-da17-42ed-ba1f-40c6e1c1a99e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:40.358832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23950748-da17-42ed-ba1f-40c6e1c1a99e service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:40.364469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-90605d16-302b-479e-ab70-b72b1d1fd566 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:40.365695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-90605d16-302b-479e-ab70-b72b1d1fd566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:40.379038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1012/2005] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:40.443120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 994/2006] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:40.449678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23950748-da17-42ed-ba1f-40c6e1c1a99e service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:40.451332 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-23950748-da17-42ed-ba1f-40c6e1c1a99e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:40.514260 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23950748-da17-42ed-ba1f-40c6e1c1a99e service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:40.560689 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:40.593640 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c69d3-ed40-452b-ade3-8d1c35e8412a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:40.594302 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c69d3-ed40-452b-ade3-8d1c35e8412a service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:40.594609 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c69d3-ed40-452b-ade3-8d1c35e8412a service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:40.594883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c69d3-ed40-452b-ade3-8d1c35e8412a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:40.608278 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c69d3-ed40-452b-ade3-8d1c35e8412a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:40.609718 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c69d3-ed40-452b-ade3-8d1c35e8412a service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:40.620536 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1013/2007] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:40.826554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90605d16-302b-479e-ab70-b72b1d1fd566 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:40.827998 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-90605d16-302b-479e-ab70-b72b1d1fd566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:40.839906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90605d16-302b-479e-ab70-b72b1d1fd566 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:40.845094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb835dd8-0388-4fac-94a6-5ca4348b9218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:40.845975 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb835dd8-0388-4fac-94a6-5ca4348b9218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:40.846262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb835dd8-0388-4fac-94a6-5ca4348b9218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:40.846575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb835dd8-0388-4fac-94a6-5ca4348b9218 admin admin] PATH_INFO: `/v3/users/ebb0ec9550984ee0a54b19763b7ca161` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:40.847771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb835dd8-0388-4fac-94a6-5ca4348b9218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebb0ec9550984ee0a54b19763b7ca161)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:40.849723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb835dd8-0388-4fac-94a6-5ca4348b9218 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:40.899217 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cb835dd8-0388-4fac-94a6-5ca4348b9218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebb0ec9550984ee0a54b19763b7ca161'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:40.907081 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cb835dd8-0388-4fac-94a6-5ca4348b9218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebb0ec9550984ee0a54b19763b7ca161'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:40.907844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cb835dd8-0388-4fac-94a6-5ca4348b9218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebb0ec9550984ee0a54b19763b7ca161'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:40.919440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c69d3-ed40-452b-ade3-8d1c35e8412a service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:40.921276 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f50c69d3-ed40-452b-ade3-8d1c35e8412a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:40.923887 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cb835dd8-0388-4fac-94a6-5ca4348b9218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebb0ec9550984ee0a54b19763b7ca161'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:40.925242 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:40.939672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cb835dd8-0388-4fac-94a6-5ca4348b9218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebb0ec9550984ee0a54b19763b7ca161'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:40.940312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c69d3-ed40-452b-ade3-8d1c35e8412a service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:40.946958 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd2740-6888-43b1-9500-4494e33e8f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:40.947142 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 995/2008] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:40 2022] DELETE /identity/v3/users/ebb0ec9550984ee0a54b19763b7ca161 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:40.948103 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2740-6888-43b1-9500-4494e33e8f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:40.948420 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2740-6888-43b1-9500-4494e33e8f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:40.948695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd2740-6888-43b1-9500-4494e33e8f8e admin admin] PATH_INFO: `/v3/projects/31d50ace2bf04051b80b9fb6dca853f2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:40.949928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd2740-6888-43b1-9500-4494e33e8f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d50ace2bf04051b80b9fb6dca853f2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:40.951669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222ee5d-ca97-4ccd-8333-25772c654729 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:40.951968 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222ee5d-ca97-4ccd-8333-25772c654729 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:40.952246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222ee5d-ca97-4ccd-8333-25772c654729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:40.952358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd2740-6888-43b1-9500-4494e33e8f8e admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:40.974494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a222ee5d-ca97-4ccd-8333-25772c654729 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:40.975753 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a222ee5d-ca97-4ccd-8333-25772c654729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:41.010420 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9abd2740-6888-43b1-9500-4494e33e8f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d50ace2bf04051b80b9fb6dca853f2', 'request_id': 'req-9abd2740-6888-43b1-9500-4494e33e8f8e'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:41.016646 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9abd2740-6888-43b1-9500-4494e33e8f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d50ace2bf04051b80b9fb6dca853f2', 'request_id': 'req-9abd2740-6888-43b1-9500-4494e33e8f8e'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:41.023849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9abd2740-6888-43b1-9500-4494e33e8f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d50ace2bf04051b80b9fb6dca853f2', 'request_id': 'req-9abd2740-6888-43b1-9500-4494e33e8f8e'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:41.041019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9abd2740-6888-43b1-9500-4494e33e8f8e admin admin] The token cache is being invalidate because project 31d50ace2bf04051b80b9fb6dca853f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:41.041317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9abd2740-6888-43b1-9500-4494e33e8f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:41.041956 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9abd2740-6888-43b1-9500-4494e33e8f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:41.043889 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1014/2009] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:40 2022] DELETE /identity/v3/projects/31d50ace2bf04051b80b9fb6dca853f2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:41.047763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd2740-6888-43b1-9500-4494e33e8f8e admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:41.049340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9abd2740-6888-43b1-9500-4494e33e8f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:41.053082 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 996/2010] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:41.067632 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222ee5d-ca97-4ccd-8333-25772c654729 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:41.069930 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a222ee5d-ca97-4ccd-8333-25772c654729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:41.131270 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd2740-6888-43b1-9500-4494e33e8f8e admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:41.137015 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6149f4-8d36-4e42-a605-34471e6a2a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:41.138177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6149f4-8d36-4e42-a605-34471e6a2a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:41.138687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6149f4-8d36-4e42-a605-34471e6a2a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:41.139543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6149f4-8d36-4e42-a605-34471e6a2a7f admin admin] PATH_INFO: `/v3/users/59b028d2a0404f5bbb49ecc06e69a73c` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:41.150851 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6149f4-8d36-4e42-a605-34471e6a2a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b028d2a0404f5bbb49ecc06e69a73c)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:41.153086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6149f4-8d36-4e42-a605-34471e6a2a7f admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:41.155394 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222ee5d-ca97-4ccd-8333-25772c654729 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:41.211261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204f415-c0af-46b2-866c-9f7959981bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:41.212502 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204f415-c0af-46b2-866c-9f7959981bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:41.212792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204f415-c0af-46b2-866c-9f7959981bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:41.213077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204f415-c0af-46b2-866c-9f7959981bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:41.215989 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9e6149f4-8d36-4e42-a605-34471e6a2a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b028d2a0404f5bbb49ecc06e69a73c'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:41.225086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204f415-c0af-46b2-866c-9f7959981bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:41.225453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9e6149f4-8d36-4e42-a605-34471e6a2a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b028d2a0404f5bbb49ecc06e69a73c'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:41.226154 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9e6149f4-8d36-4e42-a605-34471e6a2a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b028d2a0404f5bbb49ecc06e69a73c'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:41.226989 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204f415-c0af-46b2-866c-9f7959981bf5 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:41.228395 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:41.246029 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 997/2011] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:41.257748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9e6149f4-8d36-4e42-a605-34471e6a2a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b028d2a0404f5bbb49ecc06e69a73c'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:41.264607 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9e6149f4-8d36-4e42-a605-34471e6a2a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b028d2a0404f5bbb49ecc06e69a73c'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:41.272090 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1015/2012] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:41 2022] DELETE /identity/v3/users/59b028d2a0404f5bbb49ecc06e69a73c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:41.795104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204f415-c0af-46b2-866c-9f7959981bf5 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:41.805141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204f415-c0af-46b2-866c-9f7959981bf5 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:41.845448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6149f4-8d36-4e42-a605-34471e6a2a7f admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:41.846993 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9e6149f4-8d36-4e42-a605-34471e6a2a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:41.897225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:41.920027 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e210b9-c2df-4d75-be19-06387c540004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:41.921282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e210b9-c2df-4d75-be19-06387c540004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:41.921579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e210b9-c2df-4d75-be19-06387c540004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:41.922018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e210b9-c2df-4d75-be19-06387c540004 admin admin] PATH_INFO: `/v3/projects/426e75174f744cf2b51be546d3d32ed2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:41.925355 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e210b9-c2df-4d75-be19-06387c540004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=426e75174f744cf2b51be546d3d32ed2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:41.928737 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e210b9-c2df-4d75-be19-06387c540004 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:41.984738 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6149f4-8d36-4e42-a605-34471e6a2a7f admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:41.995397 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-88e210b9-c2df-4d75-be19-06387c540004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426e75174f744cf2b51be546d3d32ed2', 'request_id': 'req-88e210b9-c2df-4d75-be19-06387c540004'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:42.007862 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-88e210b9-c2df-4d75-be19-06387c540004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426e75174f744cf2b51be546d3d32ed2', 'request_id': 'req-88e210b9-c2df-4d75-be19-06387c540004'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:42.015585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-88e210b9-c2df-4d75-be19-06387c540004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426e75174f744cf2b51be546d3d32ed2', 'request_id': 'req-88e210b9-c2df-4d75-be19-06387c540004'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:42.031886 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-88e210b9-c2df-4d75-be19-06387c540004 admin admin] The token cache is being invalidate because project 426e75174f744cf2b51be546d3d32ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:42.032174 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-88e210b9-c2df-4d75-be19-06387c540004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:42.035065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-88e210b9-c2df-4d75-be19-06387c540004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:42.042939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 998/2013] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:41 2022] DELETE /identity/v3/projects/426e75174f744cf2b51be546d3d32ed2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:42.047954 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30868fd2-c570-455b-aaaa-656ee5527ce7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:42.048316 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30868fd2-c570-455b-aaaa-656ee5527ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:42.048664 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30868fd2-c570-455b-aaaa-656ee5527ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:42.067014 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:42.068255 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:42.068629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:42.069037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34 admin admin] PATH_INFO: `/v3/projects/0ee0fc41308e43e9abed9bf247cd569a` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:42.070346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ee0fc41308e43e9abed9bf247cd569a)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:42.072490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:42.072623 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-30868fd2-c570-455b-aaaa-656ee5527ce7 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:42.074150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-30868fd2-c570-455b-aaaa-656ee5527ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:42.083659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 999/2014] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:42.091542 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96ccd9-c6cb-4fc3-b139-0b47dad4f7da None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:42.091896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96ccd9-c6cb-4fc3-b139-0b47dad4f7da None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:42.092114 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96ccd9-c6cb-4fc3-b139-0b47dad4f7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:42.116338 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7b96ccd9-c6cb-4fc3-b139-0b47dad4f7da None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:42.117615 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7b96ccd9-c6cb-4fc3-b139-0b47dad4f7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:42.152271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ee0fc41308e43e9abed9bf247cd569a', 'request_id': 'req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:42.163816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ee0fc41308e43e9abed9bf247cd569a', 'request_id': 'req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:42.171841 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ee0fc41308e43e9abed9bf247cd569a', 'request_id': 'req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:42.189245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34 admin admin] The token cache is being invalidate because project 0ee0fc41308e43e9abed9bf247cd569a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:42.189596 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:42.190548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:42.192429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1016/2015] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:41 2022] DELETE /identity/v3/projects/0ee0fc41308e43e9abed9bf247cd569a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:42.196235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:42.197708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:42.212079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:42.216217 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1000/2016] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:42.221796 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96ccd9-c6cb-4fc3-b139-0b47dad4f7da None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:42.239867 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96ccd9-c6cb-4fc3-b139-0b47dad4f7da None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:42.248772 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc8c83-c230-4cdc-a0c9-a32906adc831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:42.249624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc8c83-c230-4cdc-a0c9-a32906adc831 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:42.249906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc8c83-c230-4cdc-a0c9-a32906adc831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:42.250180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc8c83-c230-4cdc-a0c9-a32906adc831 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:42.251022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc8c83-c230-4cdc-a0c9-a32906adc831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:42.251326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc8c83-c230-4cdc-a0c9-a32906adc831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:42.253672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc8c83-c230-4cdc-a0c9-a32906adc831 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:42.275062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1001/2017] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:42.280077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc8c83-c230-4cdc-a0c9-a32906adc831 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:42.295456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc8c83-c230-4cdc-a0c9-a32906adc831 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:42.301662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7fd3e-1a74-418e-8819-d4907ec20dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:42.302672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7fd3e-1a74-418e-8819-d4907ec20dfc admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:42.303056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7fd3e-1a74-418e-8819-d4907ec20dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:42.303960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7fd3e-1a74-418e-8819-d4907ec20dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:42.304234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b676fdf-7872-4434-84b9-3dbe9fa0ef34 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:42.304851 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7fd3e-1a74-418e-8819-d4907ec20dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:42.307266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7fd3e-1a74-418e-8819-d4907ec20dfc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:42.314611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e8c1b-fa3c-48a4-bbcf-1eef0dbd0738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:42.315572 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e8c1b-fa3c-48a4-bbcf-1eef0dbd0738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:42.315859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e8c1b-fa3c-48a4-bbcf-1eef0dbd0738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:42.316137 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e8c1b-fa3c-48a4-bbcf-1eef0dbd0738 admin admin] PATH_INFO: `/v3/users/5c0a5058b41d49bb816ca3d1d8cdb3ca` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:42.317450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e8c1b-fa3c-48a4-bbcf-1eef0dbd0738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c0a5058b41d49bb816ca3d1d8cdb3ca)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:42.326711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e8c1b-fa3c-48a4-bbcf-1eef0dbd0738 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:42.350362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1002/2018] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:42 2022] POST /identity/v3/projects => generated 409 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:18:42.354797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7fd3e-1a74-418e-8819-d4907ec20dfc admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:42.376328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-478e8c1b-fa3c-48a4-bbcf-1eef0dbd0738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c0a5058b41d49bb816ca3d1d8cdb3ca'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:42.384635 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-478e8c1b-fa3c-48a4-bbcf-1eef0dbd0738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c0a5058b41d49bb816ca3d1d8cdb3ca'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:42.386692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-478e8c1b-fa3c-48a4-bbcf-1eef0dbd0738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c0a5058b41d49bb816ca3d1d8cdb3ca'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:42.401531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:42.401736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-478e8c1b-fa3c-48a4-bbcf-1eef0dbd0738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c0a5058b41d49bb816ca3d1d8cdb3ca'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:42.411440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-478e8c1b-fa3c-48a4-bbcf-1eef0dbd0738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c0a5058b41d49bb816ca3d1d8cdb3ca'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:42.421429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1017/2019] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:42 2022] DELETE /identity/v3/users/5c0a5058b41d49bb816ca3d1d8cdb3ca => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:42.428388 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7fd3e-1a74-418e-8819-d4907ec20dfc admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:42.503710 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681db3b7-1fc1-4c3d-b2ad-4a031e8bd82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:42.504396 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681db3b7-1fc1-4c3d-b2ad-4a031e8bd82e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:42.504672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681db3b7-1fc1-4c3d-b2ad-4a031e8bd82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:42.504982 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681db3b7-1fc1-4c3d-b2ad-4a031e8bd82e admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:42.505666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681db3b7-1fc1-4c3d-b2ad-4a031e8bd82e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:42.507680 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681db3b7-1fc1-4c3d-b2ad-4a031e8bd82e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:42.533716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1003/2020] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:42 2022] POST /identity/v3/users => generated 305 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:42.537611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e8c1b-fa3c-48a4-bbcf-1eef0dbd0738 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:42.539259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-478e8c1b-fa3c-48a4-bbcf-1eef0dbd0738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:42.553729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e8c1b-fa3c-48a4-bbcf-1eef0dbd0738 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:42.559627 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebca82d-7f1f-4631-8c84-59b020f71c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:42.560262 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebca82d-7f1f-4631-8c84-59b020f71c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:42.561202 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebca82d-7f1f-4631-8c84-59b020f71c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:42.561488 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebca82d-7f1f-4631-8c84-59b020f71c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:42.562279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebca82d-7f1f-4631-8c84-59b020f71c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:42.564067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebca82d-7f1f-4631-8c84-59b020f71c2a admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:42.578345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1018/2021] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:42.579852 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681db3b7-1fc1-4c3d-b2ad-4a031e8bd82e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:42.592727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681db3b7-1fc1-4c3d-b2ad-4a031e8bd82e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:42.598040 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97a9d7-8751-464d-bd71-cf5e975ce64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:42.598759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97a9d7-8751-464d-bd71-cf5e975ce64c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:42.599069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97a9d7-8751-464d-bd71-cf5e975ce64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:42.599350 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97a9d7-8751-464d-bd71-cf5e975ce64c admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:42.600092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97a9d7-8751-464d-bd71-cf5e975ce64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:42.602101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97a9d7-8751-464d-bd71-cf5e975ce64c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:42.620534 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1004/2022] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:42.621313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebca82d-7f1f-4631-8c84-59b020f71c2a admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:42.638064 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebca82d-7f1f-4631-8c84-59b020f71c2a admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:42.655780 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160b547-232f-4869-a0d6-32b19363857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:42.656709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160b547-232f-4869-a0d6-32b19363857c admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:42.656993 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160b547-232f-4869-a0d6-32b19363857c admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:42.657273 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160b547-232f-4869-a0d6-32b19363857c admin admin] PATH_INFO: `/v3/projects/035529e87969457ba21c9e21256fd36b/users/62eae57cd0854b2dba17ae44bbeb41f6/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:42.686691 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160b547-232f-4869-a0d6-32b19363857c admin admin] RBAC: Authorizing `identity:create_grant(project_id=035529e87969457ba21c9e21256fd36b, user_id=62eae57cd0854b2dba17ae44bbeb41f6, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:42.690146 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160b547-232f-4869-a0d6-32b19363857c admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:42.711546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1019/2023] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:42 2022] PUT /identity/v3/projects/035529e87969457ba21c9e21256fd36b/users/62eae57cd0854b2dba17ae44bbeb41f6/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:42.721885 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9579c9-1c0e-4ea7-b4a8-65efd8d8cd5a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:42.722235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9579c9-1c0e-4ea7-b4a8-65efd8d8cd5a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:42.722500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9579c9-1c0e-4ea7-b4a8-65efd8d8cd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:42.775886 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9b9579c9-1c0e-4ea7-b4a8-65efd8d8cd5a None None] MFA Rules not processed for user `62eae57cd0854b2dba17ae44bbeb41f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:42.777638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9b9579c9-1c0e-4ea7-b4a8-65efd8d8cd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:42.859693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1005/2024] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:42.863914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160b547-232f-4869-a0d6-32b19363857c admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:42.931697 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:42.938856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160b547-232f-4869-a0d6-32b19363857c admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:42.945088 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b6ce6-0323-41dc-bec4-432ddeba8721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:42.945948 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b6ce6-0323-41dc-bec4-432ddeba8721 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:42.946418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b6ce6-0323-41dc-bec4-432ddeba8721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:42.946715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b6ce6-0323-41dc-bec4-432ddeba8721 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:42.947430 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b6ce6-0323-41dc-bec4-432ddeba8721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:42.949393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b6ce6-0323-41dc-bec4-432ddeba8721 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:42.990864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1020/2025] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:42 2022] POST /identity/v3/projects => generated 407 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:18:42.994553 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9579c9-1c0e-4ea7-b4a8-65efd8d8cd5a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:43.010974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9579c9-1c0e-4ea7-b4a8-65efd8d8cd5a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:43.053194 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b6ce6-0323-41dc-bec4-432ddeba8721 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:43.055343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e46b6ce6-0323-41dc-bec4-432ddeba8721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:43.100439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:43.115320 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614ed6d-38c8-4d36-a295-535fc1bf0aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:43.115320 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614ed6d-38c8-4d36-a295-535fc1bf0aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.115320 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614ed6d-38c8-4d36-a295-535fc1bf0aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.115320 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614ed6d-38c8-4d36-a295-535fc1bf0aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.116795 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614ed6d-38c8-4d36-a295-535fc1bf0aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:43.119290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614ed6d-38c8-4d36-a295-535fc1bf0aa2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:43.146273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1006/2026] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:42 2022] POST /identity/v3/users => generated 310 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:18:43.147209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614ed6d-38c8-4d36-a295-535fc1bf0aa2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:43.148937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c614ed6d-38c8-4d36-a295-535fc1bf0aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:43.161706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614ed6d-38c8-4d36-a295-535fc1bf0aa2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:43.167446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950f6f8-dbd0-46a4-a0d9-db10e591376d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:43.168463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950f6f8-dbd0-46a4-a0d9-db10e591376d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.168857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950f6f8-dbd0-46a4-a0d9-db10e591376d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.169186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950f6f8-dbd0-46a4-a0d9-db10e591376d admin admin] PATH_INFO: `/v3/users/ddf8aba12a6e43fe8486eba137834ff9` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.171505 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950f6f8-dbd0-46a4-a0d9-db10e591376d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf8aba12a6e43fe8486eba137834ff9)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:43.173532 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950f6f8-dbd0-46a4-a0d9-db10e591376d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:43.183370 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b6ce6-0323-41dc-bec4-432ddeba8721 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:43.191889 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa741cf9-a45b-488e-bbe6-80eb5cdbf7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:43.192813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa741cf9-a45b-488e-bbe6-80eb5cdbf7b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.193098 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa741cf9-a45b-488e-bbe6-80eb5cdbf7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.193377 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa741cf9-a45b-488e-bbe6-80eb5cdbf7b7 admin admin] PATH_INFO: `/v3/projects/031438f5d9ec4019b619c859913c1402` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.194616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa741cf9-a45b-488e-bbe6-80eb5cdbf7b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=031438f5d9ec4019b619c859913c1402)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:43.196544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa741cf9-a45b-488e-bbe6-80eb5cdbf7b7 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:43.233647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2950f6f8-dbd0-46a4-a0d9-db10e591376d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf8aba12a6e43fe8486eba137834ff9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:43.245127 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2950f6f8-dbd0-46a4-a0d9-db10e591376d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf8aba12a6e43fe8486eba137834ff9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:43.245900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2950f6f8-dbd0-46a4-a0d9-db10e591376d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf8aba12a6e43fe8486eba137834ff9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:43.253687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-aa741cf9-a45b-488e-bbe6-80eb5cdbf7b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031438f5d9ec4019b619c859913c1402', 'request_id': 'req-aa741cf9-a45b-488e-bbe6-80eb5cdbf7b7'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:43.260166 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2950f6f8-dbd0-46a4-a0d9-db10e591376d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf8aba12a6e43fe8486eba137834ff9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:43.261140 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-aa741cf9-a45b-488e-bbe6-80eb5cdbf7b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031438f5d9ec4019b619c859913c1402', 'request_id': 'req-aa741cf9-a45b-488e-bbe6-80eb5cdbf7b7'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:43.268984 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-aa741cf9-a45b-488e-bbe6-80eb5cdbf7b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031438f5d9ec4019b619c859913c1402', 'request_id': 'req-aa741cf9-a45b-488e-bbe6-80eb5cdbf7b7'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:43.270797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2950f6f8-dbd0-46a4-a0d9-db10e591376d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf8aba12a6e43fe8486eba137834ff9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:43.279118 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1007/2027] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:43 2022] DELETE /identity/v3/users/ddf8aba12a6e43fe8486eba137834ff9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:43.282285 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950f6f8-dbd0-46a4-a0d9-db10e591376d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:43.283539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2950f6f8-dbd0-46a4-a0d9-db10e591376d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:43.289404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-aa741cf9-a45b-488e-bbe6-80eb5cdbf7b7 admin admin] The token cache is being invalidate because project 031438f5d9ec4019b619c859913c1402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:43.290339 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-aa741cf9-a45b-488e-bbe6-80eb5cdbf7b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:43.291475 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-aa741cf9-a45b-488e-bbe6-80eb5cdbf7b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:43.297090 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1021/2028] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:43 2022] DELETE /identity/v3/projects/031438f5d9ec4019b619c859913c1402 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:43.297090 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d68ae2-2c52-44ee-a053-264c0af85f8f None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.297090 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d68ae2-2c52-44ee-a053-264c0af85f8f None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.297090 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d68ae2-2c52-44ee-a053-264c0af85f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.318971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-35d68ae2-2c52-44ee-a053-264c0af85f8f None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:43.320966 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-35d68ae2-2c52-44ee-a053-264c0af85f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:43.350726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950f6f8-dbd0-46a4-a0d9-db10e591376d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:43.355662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32771547-30bc-441c-ae0f-db8101832a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:43.356595 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32771547-30bc-441c-ae0f-db8101832a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.356976 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32771547-30bc-441c-ae0f-db8101832a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.357612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32771547-30bc-441c-ae0f-db8101832a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.358527 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32771547-30bc-441c-ae0f-db8101832a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:43.360236 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32771547-30bc-441c-ae0f-db8101832a12 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:43.371880 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1008/2029] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:43.376179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac15a6-9609-4805-b9a8-a75d22d3439b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.376715 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac15a6-9609-4805-b9a8-a75d22d3439b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.377194 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac15a6-9609-4805-b9a8-a75d22d3439b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.395012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1022/2030] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:43.395858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d68ae2-2c52-44ee-a053-264c0af85f8f None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:43.397264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-35d68ae2-2c52-44ee-a053-264c0af85f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:43.404917 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-60ac15a6-9609-4805-b9a8-a75d22d3439b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:43.406489 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-60ac15a6-9609-4805-b9a8-a75d22d3439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:43.409698 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d68ae2-2c52-44ee-a053-264c0af85f8f None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:43.414422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f65661-a274-4f7b-bfa9-50d9225a28bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:43.421674 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1009/2031] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:43.421857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f65661-a274-4f7b-bfa9-50d9225a28bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.421857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f65661-a274-4f7b-bfa9-50d9225a28bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.421857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f65661-a274-4f7b-bfa9-50d9225a28bd admin admin] PATH_INFO: `/v3/projects/d1bf76f07f774e6692a48cc61c248114/users/2e1333f2f5794fab94737779bb9cce28/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.422132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac15a6-9609-4805-b9a8-a75d22d3439b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:43.422132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-60ac15a6-9609-4805-b9a8-a75d22d3439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:43.435689 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:43.446826 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f65661-a274-4f7b-bfa9-50d9225a28bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1bf76f07f774e6692a48cc61c248114, user_id=2e1333f2f5794fab94737779bb9cce28, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:43.449539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f65661-a274-4f7b-bfa9-50d9225a28bd admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:43.470654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1023/2032] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:43 2022] PUT /identity/v3/projects/d1bf76f07f774e6692a48cc61c248114/users/2e1333f2f5794fab94737779bb9cce28/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:43.473615 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba66d58-4e0b-40fb-8ea0-12551bbfe5a8 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.473615 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba66d58-4e0b-40fb-8ea0-12551bbfe5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.473615 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba66d58-4e0b-40fb-8ea0-12551bbfe5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.502071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-4ba66d58-4e0b-40fb-8ea0-12551bbfe5a8 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:43.504068 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-4ba66d58-4e0b-40fb-8ea0-12551bbfe5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:43.540171 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:43.564356 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac15a6-9609-4805-b9a8-a75d22d3439b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:43.601698 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1024/2033] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:43.601698 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba66d58-4e0b-40fb-8ea0-12551bbfe5a8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:43.609706 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba66d58-4e0b-40fb-8ea0-12551bbfe5a8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:43.615371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081abf83-8bd8-4960-ab3d-5e830d8c0574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:43.616053 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081abf83-8bd8-4960-ab3d-5e830d8c0574 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.616380 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081abf83-8bd8-4960-ab3d-5e830d8c0574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.616774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081abf83-8bd8-4960-ab3d-5e830d8c0574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.617532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081abf83-8bd8-4960-ab3d-5e830d8c0574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:43.619299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081abf83-8bd8-4960-ab3d-5e830d8c0574 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:43.624550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde9d55-33ca-4b89-80b8-c843674a70c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:43.625219 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde9d55-33ca-4b89-80b8-c843674a70c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.625573 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde9d55-33ca-4b89-80b8-c843674a70c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.625915 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde9d55-33ca-4b89-80b8-c843674a70c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.634480 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1025/2034] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:43.634480 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081abf83-8bd8-4960-ab3d-5e830d8c0574 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:43.639721 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde9d55-33ca-4b89-80b8-c843674a70c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:43.641355 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde9d55-33ca-4b89-80b8-c843674a70c8 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:43.643321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081abf83-8bd8-4960-ab3d-5e830d8c0574 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:43.652893 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce639c-5475-4add-85a7-47e8ecc0f564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:43.653983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce639c-5475-4add-85a7-47e8ecc0f564 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.654116 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1010/2035] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:43.654215 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce639c-5475-4add-85a7-47e8ecc0f564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.654313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce639c-5475-4add-85a7-47e8ecc0f564 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.655744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce639c-5475-4add-85a7-47e8ecc0f564 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:43.655880 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde9d55-33ca-4b89-80b8-c843674a70c8 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:43.655986 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce639c-5475-4add-85a7-47e8ecc0f564 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:43.657032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce639c-5475-4add-85a7-47e8ecc0f564 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:43.668372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde9d55-33ca-4b89-80b8-c843674a70c8 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:43.671547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1026/2036] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:43.676538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce639c-5475-4add-85a7-47e8ecc0f564 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:43.679115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95d738-dfe5-4f16-b447-8b15cc6ee509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:43.680086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95d738-dfe5-4f16-b447-8b15cc6ee509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.680340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95d738-dfe5-4f16-b447-8b15cc6ee509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.680630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95d738-dfe5-4f16-b447-8b15cc6ee509 admin admin] PATH_INFO: `/v3/projects/d1bf76f07f774e6692a48cc61c248114/users/2e1333f2f5794fab94737779bb9cce28/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.684839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95d738-dfe5-4f16-b447-8b15cc6ee509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1bf76f07f774e6692a48cc61c248114, user_id=2e1333f2f5794fab94737779bb9cce28, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:43.687357 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95d738-dfe5-4f16-b447-8b15cc6ee509 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:43.697922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce639c-5475-4add-85a7-47e8ecc0f564 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:43.706780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1011/2037] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:43 2022] PUT /identity/v3/projects/d1bf76f07f774e6692a48cc61c248114/users/2e1333f2f5794fab94737779bb9cce28/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:43.709899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95d738-dfe5-4f16-b447-8b15cc6ee509 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:43.712040 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fd95d738-dfe5-4f16-b447-8b15cc6ee509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:43.780910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07bc48-cac0-418d-81d8-9d056866cc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:43.781646 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07bc48-cac0-418d-81d8-9d056866cc07 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.781939 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07bc48-cac0-418d-81d8-9d056866cc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.782338 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07bc48-cac0-418d-81d8-9d056866cc07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.783348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07bc48-cac0-418d-81d8-9d056866cc07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:43.786817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07bc48-cac0-418d-81d8-9d056866cc07 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:43.834123 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95d738-dfe5-4f16-b447-8b15cc6ee509 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:43.843131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1027/2038] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:43 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:43.844288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c86ce-76ec-4644-bf81-3569b7ea69ae None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.844583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c86ce-76ec-4644-bf81-3569b7ea69ae None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.844870 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c86ce-76ec-4644-bf81-3569b7ea69ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.846951 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c285129-2d1f-4459-8499-27818e4b5d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:43.848210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c285129-2d1f-4459-8499-27818e4b5d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.848643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c285129-2d1f-4459-8499-27818e4b5d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.849065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c285129-2d1f-4459-8499-27818e4b5d11 admin admin] PATH_INFO: `/v3/users/1913ed7d5af1404cb2a09114fda8ab06` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:43.850590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c285129-2d1f-4459-8499-27818e4b5d11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1913ed7d5af1404cb2a09114fda8ab06)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:43.852765 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c285129-2d1f-4459-8499-27818e4b5d11 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:43.893322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-522c86ce-76ec-4644-bf81-3569b7ea69ae None None] MFA Rules not processed for user `2e1333f2f5794fab94737779bb9cce28`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:43.894935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-522c86ce-76ec-4644-bf81-3569b7ea69ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:43.914654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6c285129-2d1f-4459-8499-27818e4b5d11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1913ed7d5af1404cb2a09114fda8ab06'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:43.927593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6c285129-2d1f-4459-8499-27818e4b5d11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1913ed7d5af1404cb2a09114fda8ab06'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:43.928592 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6c285129-2d1f-4459-8499-27818e4b5d11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1913ed7d5af1404cb2a09114fda8ab06'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:43.946869 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6c285129-2d1f-4459-8499-27818e4b5d11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1913ed7d5af1404cb2a09114fda8ab06'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:43.951143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:43.954820 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-6c285129-2d1f-4459-8499-27818e4b5d11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1913ed7d5af1404cb2a09114fda8ab06'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:43.961580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1012/2039] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:43 2022] DELETE /identity/v3/users/1913ed7d5af1404cb2a09114fda8ab06 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:43.965216 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c285129-2d1f-4459-8499-27818e4b5d11 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:43.966956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6c285129-2d1f-4459-8499-27818e4b5d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:43.979050 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:43.988957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1028/2040] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:43 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:43.992538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43550a-bb3f-4cf1-8a12-956314c8addd None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:43.992538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43550a-bb3f-4cf1-8a12-956314c8addd None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:43.992538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43550a-bb3f-4cf1-8a12-956314c8addd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:44.013520 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-5e43550a-bb3f-4cf1-8a12-956314c8addd None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:44.015349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5e43550a-bb3f-4cf1-8a12-956314c8addd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:44.056187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c285129-2d1f-4459-8499-27818e4b5d11 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:44.063445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450af9cc-0c9f-4f23-9d0c-a40480c15093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:44.064258 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450af9cc-0c9f-4f23-9d0c-a40480c15093 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:44.064646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450af9cc-0c9f-4f23-9d0c-a40480c15093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:44.065460 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450af9cc-0c9f-4f23-9d0c-a40480c15093 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:44.066281 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450af9cc-0c9f-4f23-9d0c-a40480c15093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:44.069734 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450af9cc-0c9f-4f23-9d0c-a40480c15093 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:44.098850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1013/2041] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:43 2022] POST /identity/v3/users => generated 291 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:44.103824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450af9cc-0c9f-4f23-9d0c-a40480c15093 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:44.103824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-450af9cc-0c9f-4f23-9d0c-a40480c15093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:44.129220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1029/2042] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:44.130143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43550a-bb3f-4cf1-8a12-956314c8addd None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:44.161522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43550a-bb3f-4cf1-8a12-956314c8addd None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:44.179677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74d0a5-dce0-41ed-8d63-3b4568243e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:44.182573 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74d0a5-dce0-41ed-8d63-3b4568243e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:44.183042 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74d0a5-dce0-41ed-8d63-3b4568243e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:44.184191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74d0a5-dce0-41ed-8d63-3b4568243e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:44.186294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74d0a5-dce0-41ed-8d63-3b4568243e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:44.190558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74d0a5-dce0-41ed-8d63-3b4568243e49 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:44.213239 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450af9cc-0c9f-4f23-9d0c-a40480c15093 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:44.217297 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fd8a2-ce0e-40c1-82e2-fbe06404a90a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:44.218041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fd8a2-ce0e-40c1-82e2-fbe06404a90a service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:44.218324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fd8a2-ce0e-40c1-82e2-fbe06404a90a service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:44.218629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fd8a2-ce0e-40c1-82e2-fbe06404a90a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:44.221185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1030/2043] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:44.222475 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74d0a5-dce0-41ed-8d63-3b4568243e49 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:44.224712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5e74d0a5-dce0-41ed-8d63-3b4568243e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:44.308069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fd8a2-ce0e-40c1-82e2-fbe06404a90a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:44.309567 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fd8a2-ce0e-40c1-82e2-fbe06404a90a service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:44.315919 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74d0a5-dce0-41ed-8d63-3b4568243e49 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:44.319518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12b331-0a99-4b8f-b704-f852085da249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:44.320087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1014/2044] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:44 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:44.320372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fd8a2-ce0e-40c1-82e2-fbe06404a90a service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:44.321639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3e5fd8a2-ce0e-40c1-82e2-fbe06404a90a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:44.322004 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12b331-0a99-4b8f-b704-f852085da249 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:44.322294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12b331-0a99-4b8f-b704-f852085da249 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:44.322612 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12b331-0a99-4b8f-b704-f852085da249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:44.334496 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12b331-0a99-4b8f-b704-f852085da249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:44.335946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12b331-0a99-4b8f-b704-f852085da249 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:44.336532 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fd8a2-ce0e-40c1-82e2-fbe06404a90a service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:44.341240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3188fe-ef93-4eed-8b16-e8036706a9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:44.342204 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3188fe-ef93-4eed-8b16-e8036706a9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:44.342775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3188fe-ef93-4eed-8b16-e8036706a9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:44.342910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3188fe-ef93-4eed-8b16-e8036706a9b4 admin admin] PATH_INFO: `/v3/projects/62f4b4582b2b49f997c66e678fdc22c1` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:44.344026 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3188fe-ef93-4eed-8b16-e8036706a9b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62f4b4582b2b49f997c66e678fdc22c1)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:44.345937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3188fe-ef93-4eed-8b16-e8036706a9b4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:44.347892 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1031/2045] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:44.348533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12b331-0a99-4b8f-b704-f852085da249 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:44.360444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12b331-0a99-4b8f-b704-f852085da249 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:44.371419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b77bd6-6d0f-481a-a01c-eb03e9f282e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:44.372167 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b77bd6-6d0f-481a-a01c-eb03e9f282e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:44.372450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b77bd6-6d0f-481a-a01c-eb03e9f282e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:44.373031 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b77bd6-6d0f-481a-a01c-eb03e9f282e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:44.373770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b77bd6-6d0f-481a-a01c-eb03e9f282e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:44.375458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b77bd6-6d0f-481a-a01c-eb03e9f282e9 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:44.387997 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1032/2046] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:44.392401 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b77bd6-6d0f-481a-a01c-eb03e9f282e9 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:44.404812 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b77bd6-6d0f-481a-a01c-eb03e9f282e9 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:44.418695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:44.424650 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-db3188fe-ef93-4eed-8b16-e8036706a9b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62f4b4582b2b49f997c66e678fdc22c1', 'request_id': 'req-db3188fe-ef93-4eed-8b16-e8036706a9b4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:44.435941 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-db3188fe-ef93-4eed-8b16-e8036706a9b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62f4b4582b2b49f997c66e678fdc22c1', 'request_id': 'req-db3188fe-ef93-4eed-8b16-e8036706a9b4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:44.448049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-db3188fe-ef93-4eed-8b16-e8036706a9b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62f4b4582b2b49f997c66e678fdc22c1', 'request_id': 'req-db3188fe-ef93-4eed-8b16-e8036706a9b4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:44.468386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-db3188fe-ef93-4eed-8b16-e8036706a9b4 admin admin] The token cache is being invalidate because project 62f4b4582b2b49f997c66e678fdc22c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:44.468687 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-db3188fe-ef93-4eed-8b16-e8036706a9b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:44.469412 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-db3188fe-ef93-4eed-8b16-e8036706a9b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:44.469920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:44.472071 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1015/2047] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:44 2022] DELETE /identity/v3/projects/62f4b4582b2b49f997c66e678fdc22c1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:44.477828 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3188fe-ef93-4eed-8b16-e8036706a9b4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:44.481137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-db3188fe-ef93-4eed-8b16-e8036706a9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:44.482176 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9c251-0b24-492f-afd1-9f808750467e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:44.483393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c251-0b24-492f-afd1-9f808750467e admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:44.483695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c251-0b24-492f-afd1-9f808750467e admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:44.483956 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c251-0b24-492f-afd1-9f808750467e admin admin] PATH_INFO: `/v3/projects/84c89d45423448c09a19d6c9f5d90ff5/users/0bb2e74598e4466eb6d06f3db39c87fa/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:44.499130 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3188fe-ef93-4eed-8b16-e8036706a9b4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:44.504179 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9c251-0b24-492f-afd1-9f808750467e admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c89d45423448c09a19d6c9f5d90ff5, user_id=0bb2e74598e4466eb6d06f3db39c87fa, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:44.506976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9c251-0b24-492f-afd1-9f808750467e admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:44.527271 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dad8d-2608-4724-b26c-5f0fab92712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:44.529439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dad8d-2608-4724-b26c-5f0fab92712a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:44.530225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dad8d-2608-4724-b26c-5f0fab92712a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:44.531358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dad8d-2608-4724-b26c-5f0fab92712a admin admin] PATH_INFO: `/v3/users/936cd988d8484c4a9e9bcae44cef6b5c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:44.533406 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dad8d-2608-4724-b26c-5f0fab92712a admin admin] RBAC: Authorizing `identity:delete_user(user_id=936cd988d8484c4a9e9bcae44cef6b5c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:44.537068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dad8d-2608-4724-b26c-5f0fab92712a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:44.538066 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1033/2048] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:44 2022] PUT /identity/v3/projects/84c89d45423448c09a19d6c9f5d90ff5/users/0bb2e74598e4466eb6d06f3db39c87fa/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:44.539786 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeef80-a598-45f6-851f-91e86f082cb8 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:44.540079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeef80-a598-45f6-851f-91e86f082cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:44.540471 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdeef80-a598-45f6-851f-91e86f082cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:44.585949 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-3cdeef80-a598-45f6-851f-91e86f082cb8 None None] MFA Rules not processed for user `0bb2e74598e4466eb6d06f3db39c87fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:44.587872 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3cdeef80-a598-45f6-851f-91e86f082cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:44.613567 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2a7dad8d-2608-4724-b26c-5f0fab92712a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936cd988d8484c4a9e9bcae44cef6b5c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:44.625613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2a7dad8d-2608-4724-b26c-5f0fab92712a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936cd988d8484c4a9e9bcae44cef6b5c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:44.631926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2a7dad8d-2608-4724-b26c-5f0fab92712a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936cd988d8484c4a9e9bcae44cef6b5c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:44.656965 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2a7dad8d-2608-4724-b26c-5f0fab92712a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936cd988d8484c4a9e9bcae44cef6b5c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:44.668519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1034/2049] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:44.669712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdeef80-a598-45f6-851f-91e86f082cb8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:44.671919 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3cdeef80-a598-45f6-851f-91e86f082cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:44.681833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2a7dad8d-2608-4724-b26c-5f0fab92712a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936cd988d8484c4a9e9bcae44cef6b5c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:44.690835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1016/2050] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:44 2022] DELETE /identity/v3/users/936cd988d8484c4a9e9bcae44cef6b5c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:44.694789 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dad8d-2608-4724-b26c-5f0fab92712a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:44.696312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2a7dad8d-2608-4724-b26c-5f0fab92712a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:44.756002 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdeef80-a598-45f6-851f-91e86f082cb8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:44.784418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dad8d-2608-4724-b26c-5f0fab92712a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:44.790016 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14461f26-ada8-4da9-a542-fbd347b52179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:44.790915 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14461f26-ada8-4da9-a542-fbd347b52179 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:44.791198 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14461f26-ada8-4da9-a542-fbd347b52179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:44.791478 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14461f26-ada8-4da9-a542-fbd347b52179 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:44.792183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14461f26-ada8-4da9-a542-fbd347b52179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:44.794148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14461f26-ada8-4da9-a542-fbd347b52179 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:44.826827 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fddcf-346d-4f90-bf29-02bd86cf3ed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:44.827492 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fddcf-346d-4f90-bf29-02bd86cf3ed8 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:44.827773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fddcf-346d-4f90-bf29-02bd86cf3ed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:44.828097 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fddcf-346d-4f90-bf29-02bd86cf3ed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:44.829425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1017/2051] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:44 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:44.830547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14461f26-ada8-4da9-a542-fbd347b52179 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:44.833133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-14461f26-ada8-4da9-a542-fbd347b52179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:44.833283 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-278fddcf-346d-4f90-bf29-02bd86cf3ed8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:44.878508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:44.881139 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:44.909788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fddcf-346d-4f90-bf29-02bd86cf3ed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:44.911539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fddcf-346d-4f90-bf29-02bd86cf3ed8 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:44.929689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14461f26-ada8-4da9-a542-fbd347b52179 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:44.937405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91f2b0-732f-48b8-82ce-33e166f008a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:44.939191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1035/2052] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:44 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:44.939471 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91f2b0-732f-48b8-82ce-33e166f008a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:44.939856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91f2b0-732f-48b8-82ce-33e166f008a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:44.940230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91f2b0-732f-48b8-82ce-33e166f008a9 admin admin] PATH_INFO: `/v3/projects/3be75e9d85d44544aa99c6071861f53f` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:44.940458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fddcf-346d-4f90-bf29-02bd86cf3ed8 service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:44.941697 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91f2b0-732f-48b8-82ce-33e166f008a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3be75e9d85d44544aa99c6071861f53f)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:44.943840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91f2b0-732f-48b8-82ce-33e166f008a9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:44.955350 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fddcf-346d-4f90-bf29-02bd86cf3ed8 service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:44.960901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bcf69-787f-4a51-b920-6e9b6335bf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:44.961592 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bcf69-787f-4a51-b920-6e9b6335bf5c admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:44.961922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bcf69-787f-4a51-b920-6e9b6335bf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:44.962249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bcf69-787f-4a51-b920-6e9b6335bf5c admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:44.962977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bcf69-787f-4a51-b920-6e9b6335bf5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:44.965230 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bcf69-787f-4a51-b920-6e9b6335bf5c admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:44.996827 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1036/2053] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:44 2022] POST /identity/v3/users => generated 297 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:44.998625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bcf69-787f-4a51-b920-6e9b6335bf5c admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:45.009701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bcf69-787f-4a51-b920-6e9b6335bf5c admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:45.023727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-da91f2b0-732f-48b8-82ce-33e166f008a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3be75e9d85d44544aa99c6071861f53f', 'request_id': 'req-da91f2b0-732f-48b8-82ce-33e166f008a9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.034043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-da91f2b0-732f-48b8-82ce-33e166f008a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3be75e9d85d44544aa99c6071861f53f', 'request_id': 'req-da91f2b0-732f-48b8-82ce-33e166f008a9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.042955 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-da91f2b0-732f-48b8-82ce-33e166f008a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3be75e9d85d44544aa99c6071861f53f', 'request_id': 'req-da91f2b0-732f-48b8-82ce-33e166f008a9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.086683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-da91f2b0-732f-48b8-82ce-33e166f008a9 admin admin] The token cache is being invalidate because project 3be75e9d85d44544aa99c6071861f53f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:45.087462 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-da91f2b0-732f-48b8-82ce-33e166f008a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.088583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-da91f2b0-732f-48b8-82ce-33e166f008a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.097494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1018/2054] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:44 2022] DELETE /identity/v3/projects/3be75e9d85d44544aa99c6071861f53f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:45.102183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91f2b0-732f-48b8-82ce-33e166f008a9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:45.105128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-da91f2b0-732f-48b8-82ce-33e166f008a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:45.107337 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0aac9c-7bb5-42ed-af1b-f813e20b658d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:45.108217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0aac9c-7bb5-42ed-af1b-f813e20b658d admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:45.108598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0aac9c-7bb5-42ed-af1b-f813e20b658d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:45.109032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0aac9c-7bb5-42ed-af1b-f813e20b658d admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:45.109889 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0aac9c-7bb5-42ed-af1b-f813e20b658d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:45.113583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0aac9c-7bb5-42ed-af1b-f813e20b658d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:45.147206 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1037/2055] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:45.152996 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0aac9c-7bb5-42ed-af1b-f813e20b658d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:45.154470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91f2b0-732f-48b8-82ce-33e166f008a9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:45.161541 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-dc0aac9c-7bb5-42ed-af1b-f813e20b658d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:45.171612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9723e-f4e5-4387-a57b-44466fce9bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:45.172717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9723e-f4e5-4387-a57b-44466fce9bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:45.173172 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9723e-f4e5-4387-a57b-44466fce9bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:45.173595 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9723e-f4e5-4387-a57b-44466fce9bdb admin admin] PATH_INFO: `/v3/users/ff49bb924a5c4c149f51809a964c9d09` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:45.175038 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9723e-f4e5-4387-a57b-44466fce9bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff49bb924a5c4c149f51809a964c9d09)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:45.177451 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9723e-f4e5-4387-a57b-44466fce9bdb admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:45.199196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0aac9c-7bb5-42ed-af1b-f813e20b658d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:45.207507 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f5adf-4a8b-42e1-b9d1-5af7c5d0e0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:45.208730 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f5adf-4a8b-42e1-b9d1-5af7c5d0e0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:45.209115 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f5adf-4a8b-42e1-b9d1-5af7c5d0e0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:45.209560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f5adf-4a8b-42e1-b9d1-5af7c5d0e0bc admin admin] PATH_INFO: `/v3/projects/809625c621cb4735943d3e5916301e33/users/7d39f57f9b234ba58af7796bdc98defa/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:45.240133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f5adf-4a8b-42e1-b9d1-5af7c5d0e0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=809625c621cb4735943d3e5916301e33, user_id=7d39f57f9b234ba58af7796bdc98defa, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:45.243719 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f5adf-4a8b-42e1-b9d1-5af7c5d0e0bc admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:45.252765 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-04a9723e-f4e5-4387-a57b-44466fce9bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff49bb924a5c4c149f51809a964c9d09'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.263105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1038/2056] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:45 2022] PUT /identity/v3/projects/809625c621cb4735943d3e5916301e33/users/7d39f57f9b234ba58af7796bdc98defa/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:45.263105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f5adf-4a8b-42e1-b9d1-5af7c5d0e0bc admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:45.263105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ef6f5adf-4a8b-42e1-b9d1-5af7c5d0e0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:45.267317 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-04a9723e-f4e5-4387-a57b-44466fce9bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff49bb924a5c4c149f51809a964c9d09'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.268917 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-04a9723e-f4e5-4387-a57b-44466fce9bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff49bb924a5c4c149f51809a964c9d09'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.289835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-04a9723e-f4e5-4387-a57b-44466fce9bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff49bb924a5c4c149f51809a964c9d09'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.299056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-04a9723e-f4e5-4387-a57b-44466fce9bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff49bb924a5c4c149f51809a964c9d09'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.306289 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1019/2057] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:45 2022] DELETE /identity/v3/users/ff49bb924a5c4c149f51809a964c9d09 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:45.307398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9723e-f4e5-4387-a57b-44466fce9bdb admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:45.323236 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-04a9723e-f4e5-4387-a57b-44466fce9bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:45.393621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:45.401884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f5adf-4a8b-42e1-b9d1-5af7c5d0e0bc admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:45.457634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9723e-f4e5-4387-a57b-44466fce9bdb admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:45.469320 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33165426-0c09-4fd1-9ee3-06ad4295f31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:45.471248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33165426-0c09-4fd1-9ee3-06ad4295f31f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:45.472060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33165426-0c09-4fd1-9ee3-06ad4295f31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:45.473427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33165426-0c09-4fd1-9ee3-06ad4295f31f admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:45.474330 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33165426-0c09-4fd1-9ee3-06ad4295f31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:45.477498 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33165426-0c09-4fd1-9ee3-06ad4295f31f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:45.478252 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:45.499018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1020/2058] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:45.509356 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33165426-0c09-4fd1-9ee3-06ad4295f31f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:45.517272 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178b3ff-37c8-44cd-9cdc-0af8934be713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:45.518835 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178b3ff-37c8-44cd-9cdc-0af8934be713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:45.519198 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178b3ff-37c8-44cd-9cdc-0af8934be713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:45.520395 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178b3ff-37c8-44cd-9cdc-0af8934be713 admin admin] PATH_INFO: `/v3/projects/ef24a1aeb0a54dd6a41ac2ad771b724f` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:45.521710 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178b3ff-37c8-44cd-9cdc-0af8934be713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef24a1aeb0a54dd6a41ac2ad771b724f)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:45.525310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178b3ff-37c8-44cd-9cdc-0af8934be713 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:45.532671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33165426-0c09-4fd1-9ee3-06ad4295f31f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:45.545380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93ad32-297e-41d9-b41a-6570f5a33ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:45.547988 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93ad32-297e-41d9-b41a-6570f5a33ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:45.548253 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93ad32-297e-41d9-b41a-6570f5a33ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:45.548556 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93ad32-297e-41d9-b41a-6570f5a33ffe admin admin] PATH_INFO: `/v3/projects/809625c621cb4735943d3e5916301e33/users/7d39f57f9b234ba58af7796bdc98defa/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:45.554932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93ad32-297e-41d9-b41a-6570f5a33ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=809625c621cb4735943d3e5916301e33, user_id=7d39f57f9b234ba58af7796bdc98defa, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:45.560736 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93ad32-297e-41d9-b41a-6570f5a33ffe admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:45.574035 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1021/2059] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:45 2022] PUT /identity/v3/projects/809625c621cb4735943d3e5916301e33/users/7d39f57f9b234ba58af7796bdc98defa/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:45.584183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd72e8f-799b-40f0-98f5-6963244a0d03 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:45.584487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd72e8f-799b-40f0-98f5-6963244a0d03 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:45.584736 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd72e8f-799b-40f0-98f5-6963244a0d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:45.587741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3178b3ff-37c8-44cd-9cdc-0af8934be713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef24a1aeb0a54dd6a41ac2ad771b724f', 'request_id': 'req-3178b3ff-37c8-44cd-9cdc-0af8934be713'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.594276 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3178b3ff-37c8-44cd-9cdc-0af8934be713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef24a1aeb0a54dd6a41ac2ad771b724f', 'request_id': 'req-3178b3ff-37c8-44cd-9cdc-0af8934be713'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.601133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3178b3ff-37c8-44cd-9cdc-0af8934be713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef24a1aeb0a54dd6a41ac2ad771b724f', 'request_id': 'req-3178b3ff-37c8-44cd-9cdc-0af8934be713'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.618570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3178b3ff-37c8-44cd-9cdc-0af8934be713 admin admin] The token cache is being invalidate because project ef24a1aeb0a54dd6a41ac2ad771b724f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:45.619452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3178b3ff-37c8-44cd-9cdc-0af8934be713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.620770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3178b3ff-37c8-44cd-9cdc-0af8934be713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.624558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1039/2060] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:45 2022] DELETE /identity/v3/projects/ef24a1aeb0a54dd6a41ac2ad771b724f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:45.629513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178b3ff-37c8-44cd-9cdc-0af8934be713 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:45.634113 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8bd72e8f-799b-40f0-98f5-6963244a0d03 None None] MFA Rules not processed for user `7d39f57f9b234ba58af7796bdc98defa`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:45.635106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8bd72e8f-799b-40f0-98f5-6963244a0d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:45.635385 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3178b3ff-37c8-44cd-9cdc-0af8934be713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:45.728126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178b3ff-37c8-44cd-9cdc-0af8934be713 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:45.732203 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1022/2061] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:45.733354 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b676c-1d25-4475-9ae6-6f86efd5ef12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:45.734473 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b676c-1d25-4475-9ae6-6f86efd5ef12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:45.734581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b676c-1d25-4475-9ae6-6f86efd5ef12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:45.734827 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b676c-1d25-4475-9ae6-6f86efd5ef12 admin admin] PATH_INFO: `/v3/users/38efb962f62c4f7ea21c337df0b5f6d5` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:45.736107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b676c-1d25-4475-9ae6-6f86efd5ef12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38efb962f62c4f7ea21c337df0b5f6d5)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:45.738051 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b676c-1d25-4475-9ae6-6f86efd5ef12 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:45.744863 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd72e8f-799b-40f0-98f5-6963244a0d03 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:45.747257 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8bd72e8f-799b-40f0-98f5-6963244a0d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:45.800505 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-165b676c-1d25-4475-9ae6-6f86efd5ef12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38efb962f62c4f7ea21c337df0b5f6d5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.813299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-165b676c-1d25-4475-9ae6-6f86efd5ef12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38efb962f62c4f7ea21c337df0b5f6d5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.814317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-165b676c-1d25-4475-9ae6-6f86efd5ef12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38efb962f62c4f7ea21c337df0b5f6d5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.818909 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd72e8f-799b-40f0-98f5-6963244a0d03 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:45.823482 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a529a30-70df-451d-a869-175d555d416a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:45.824275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a529a30-70df-451d-a869-175d555d416a service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:45.825024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a529a30-70df-451d-a869-175d555d416a service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:45.825024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a529a30-70df-451d-a869-175d555d416a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:45.827610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0a529a30-70df-451d-a869-175d555d416a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:45.834496 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-165b676c-1d25-4475-9ae6-6f86efd5ef12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38efb962f62c4f7ea21c337df0b5f6d5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.835900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:45.840342 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a529a30-70df-451d-a869-175d555d416a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:45.841933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a529a30-70df-451d-a869-175d555d416a service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:45.846752 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-165b676c-1d25-4475-9ae6-6f86efd5ef12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38efb962f62c4f7ea21c337df0b5f6d5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:45.853056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1023/2062] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:45.857723 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1040/2063] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:45 2022] DELETE /identity/v3/users/38efb962f62c4f7ea21c337df0b5f6d5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:45.949292 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a529a30-70df-451d-a869-175d555d416a service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:45.954764 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0a529a30-70df-451d-a869-175d555d416a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:45.956845 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b676c-1d25-4475-9ae6-6f86efd5ef12 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:45.959190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-165b676c-1d25-4475-9ae6-6f86efd5ef12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:45.968744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a529a30-70df-451d-a869-175d555d416a service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:46.046618 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:46.072755 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f32eda-fe25-403d-b089-6095c956014e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:46.073426 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f32eda-fe25-403d-b089-6095c956014e service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:46.073713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f32eda-fe25-403d-b089-6095c956014e service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:46.074167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f32eda-fe25-403d-b089-6095c956014e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:46.076279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-67f32eda-fe25-403d-b089-6095c956014e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:46.076406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b676c-1d25-4475-9ae6-6f86efd5ef12 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:46.082087 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c2f0b-bf5a-45fd-a25c-b69b84db57d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:46.083188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c2f0b-bf5a-45fd-a25c-b69b84db57d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:46.083579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c2f0b-bf5a-45fd-a25c-b69b84db57d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:46.084417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c2f0b-bf5a-45fd-a25c-b69b84db57d1 admin admin] PATH_INFO: `/v3/projects/749e6e206f6f4c038f9603c04cd544ce` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:46.085574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c2f0b-bf5a-45fd-a25c-b69b84db57d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=749e6e206f6f4c038f9603c04cd544ce)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:46.087826 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c2f0b-bf5a-45fd-a25c-b69b84db57d1 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:46.141229 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f32eda-fe25-403d-b089-6095c956014e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:46.143224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f32eda-fe25-403d-b089-6095c956014e service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:46.153624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1024/2064] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:46.155145 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-bf3c2f0b-bf5a-45fd-a25c-b69b84db57d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '749e6e206f6f4c038f9603c04cd544ce', 'request_id': 'req-bf3c2f0b-bf5a-45fd-a25c-b69b84db57d1'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:46.163658 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-bf3c2f0b-bf5a-45fd-a25c-b69b84db57d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '749e6e206f6f4c038f9603c04cd544ce', 'request_id': 'req-bf3c2f0b-bf5a-45fd-a25c-b69b84db57d1'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:46.186242 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-bf3c2f0b-bf5a-45fd-a25c-b69b84db57d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '749e6e206f6f4c038f9603c04cd544ce', 'request_id': 'req-bf3c2f0b-bf5a-45fd-a25c-b69b84db57d1'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:46.197879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f32eda-fe25-403d-b089-6095c956014e service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:46.199387 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-67f32eda-fe25-403d-b089-6095c956014e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:46.217398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-bf3c2f0b-bf5a-45fd-a25c-b69b84db57d1 admin admin] The token cache is being invalidate because project 749e6e206f6f4c038f9603c04cd544ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:46.217939 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-bf3c2f0b-bf5a-45fd-a25c-b69b84db57d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:46.219091 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-bf3c2f0b-bf5a-45fd-a25c-b69b84db57d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:46.221316 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1041/2065] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:45 2022] DELETE /identity/v3/projects/749e6e206f6f4c038f9603c04cd544ce => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:46.225836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d414f-5b17-446d-8f26-d2afe0b511ce None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:46.226719 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d414f-5b17-446d-8f26-d2afe0b511ce None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:46.227034 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d414f-5b17-446d-8f26-d2afe0b511ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:46.229129 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f32eda-fe25-403d-b089-6095c956014e service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:46.250754 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-dc0d414f-5b17-446d-8f26-d2afe0b511ce None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:46.251760 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-dc0d414f-5b17-446d-8f26-d2afe0b511ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:46.327242 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7744f1-49db-4259-962e-e00d76fbd308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:46.328265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7744f1-49db-4259-962e-e00d76fbd308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:46.328617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7744f1-49db-4259-962e-e00d76fbd308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:46.329389 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7744f1-49db-4259-962e-e00d76fbd308 admin admin] PATH_INFO: `/v3/projects/7397632bb6324b4f874505b11c7e06ba` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:46.332230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7744f1-49db-4259-962e-e00d76fbd308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7397632bb6324b4f874505b11c7e06ba)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:46.333622 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7744f1-49db-4259-962e-e00d76fbd308 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:46.340449 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1042/2066] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:46.348135 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec370cf-7adf-4ebe-90a0-38415f1c58d7 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:46.348590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec370cf-7adf-4ebe-90a0-38415f1c58d7 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:46.348878 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec370cf-7adf-4ebe-90a0-38415f1c58d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:46.381883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-dec370cf-7adf-4ebe-90a0-38415f1c58d7 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:46.383123 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-dec370cf-7adf-4ebe-90a0-38415f1c58d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:46.397513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1043/2067] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:46.398611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec370cf-7adf-4ebe-90a0-38415f1c58d7 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:46.409386 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec370cf-7adf-4ebe-90a0-38415f1c58d7 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:46.419625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:46.425014 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ce7744f1-49db-4259-962e-e00d76fbd308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7397632bb6324b4f874505b11c7e06ba', 'request_id': 'req-ce7744f1-49db-4259-962e-e00d76fbd308'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:46.434558 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ce7744f1-49db-4259-962e-e00d76fbd308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7397632bb6324b4f874505b11c7e06ba', 'request_id': 'req-ce7744f1-49db-4259-962e-e00d76fbd308'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:46.441892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ce7744f1-49db-4259-962e-e00d76fbd308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7397632bb6324b4f874505b11c7e06ba', 'request_id': 'req-ce7744f1-49db-4259-962e-e00d76fbd308'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:46.460100 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ce7744f1-49db-4259-962e-e00d76fbd308 admin admin] The token cache is being invalidate because project 7397632bb6324b4f874505b11c7e06ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:46.460850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ce7744f1-49db-4259-962e-e00d76fbd308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:46.462368 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ce7744f1-49db-4259-962e-e00d76fbd308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:46.470938 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1025/2068] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:46 2022] DELETE /identity/v3/projects/7397632bb6324b4f874505b11c7e06ba => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:46.472584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22107db-4928-4ac9-bd0c-040e528e2748 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:46.472874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22107db-4928-4ac9-bd0c-040e528e2748 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:46.473156 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22107db-4928-4ac9-bd0c-040e528e2748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:46.502606 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c22107db-4928-4ac9-bd0c-040e528e2748 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:46.505625 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c22107db-4928-4ac9-bd0c-040e528e2748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:46.510626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15fcbb-b783-41c3-9377-63020e461e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:46.511702 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15fcbb-b783-41c3-9377-63020e461e18 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:46.512100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15fcbb-b783-41c3-9377-63020e461e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:46.514199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15fcbb-b783-41c3-9377-63020e461e18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:46.514711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15fcbb-b783-41c3-9377-63020e461e18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:46.515079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15fcbb-b783-41c3-9377-63020e461e18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:46.518657 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15fcbb-b783-41c3-9377-63020e461e18 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:46.531926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1026/2069] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:46.539901 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96248aa7-b830-4690-b1b4-fadc688d867e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:46.540414 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96248aa7-b830-4690-b1b4-fadc688d867e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:46.541005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96248aa7-b830-4690-b1b4-fadc688d867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:46.542518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1044/2070] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:18:46.548536 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15fcbb-b783-41c3-9377-63020e461e18 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:46.551459 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ae15fcbb-b783-41c3-9377-63020e461e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:46.566420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-96248aa7-b830-4690-b1b4-fadc688d867e None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:46.566626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15fcbb-b783-41c3-9377-63020e461e18 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:46.566726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-96248aa7-b830-4690-b1b4-fadc688d867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:46.575529 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1027/2071] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:46.576648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96248aa7-b830-4690-b1b4-fadc688d867e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:46.578197 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-96248aa7-b830-4690-b1b4-fadc688d867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:46.591685 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96248aa7-b830-4690-b1b4-fadc688d867e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:46.596851 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf9f30-6e30-44f2-8a43-1749cca79370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:46.597947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf9f30-6e30-44f2-8a43-1749cca79370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:46.598231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf9f30-6e30-44f2-8a43-1749cca79370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:46.598630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf9f30-6e30-44f2-8a43-1749cca79370 admin admin] PATH_INFO: `/v3/users/0bb2e74598e4466eb6d06f3db39c87fa` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:46.600177 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf9f30-6e30-44f2-8a43-1749cca79370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb2e74598e4466eb6d06f3db39c87fa)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:46.602243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf9f30-6e30-44f2-8a43-1749cca79370 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:46.613069 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cc185-13fd-4ca2-9170-e3d9f3a541e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:46.613759 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cc185-13fd-4ca2-9170-e3d9f3a541e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:46.614045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cc185-13fd-4ca2-9170-e3d9f3a541e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:46.614333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cc185-13fd-4ca2-9170-e3d9f3a541e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:46.618698 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cc185-13fd-4ca2-9170-e3d9f3a541e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:46.622128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:46.624864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161cc185-13fd-4ca2-9170-e3d9f3a541e1 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:46.678426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1045/2072] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:46 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:18:46.679408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cc185-13fd-4ca2-9170-e3d9f3a541e1 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:46.736896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-90cf9f30-6e30-44f2-8a43-1749cca79370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb2e74598e4466eb6d06f3db39c87fa'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:46.754769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-90cf9f30-6e30-44f2-8a43-1749cca79370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb2e74598e4466eb6d06f3db39c87fa'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:46.755877 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-90cf9f30-6e30-44f2-8a43-1749cca79370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb2e74598e4466eb6d06f3db39c87fa'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:46.786949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-90cf9f30-6e30-44f2-8a43-1749cca79370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb2e74598e4466eb6d06f3db39c87fa'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:46.805632 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-90cf9f30-6e30-44f2-8a43-1749cca79370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb2e74598e4466eb6d06f3db39c87fa'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:46.807998 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cc185-13fd-4ca2-9170-e3d9f3a541e1 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:46.815891 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971e194-3a25-4aab-a463-b60cfa3bc612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:46.818457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1028/2073] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:46 2022] DELETE /identity/v3/users/0bb2e74598e4466eb6d06f3db39c87fa => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:46.818598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e194-3a25-4aab-a463-b60cfa3bc612 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:46.818598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e194-3a25-4aab-a463-b60cfa3bc612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:46.818769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf9f30-6e30-44f2-8a43-1749cca79370 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:46.819442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e194-3a25-4aab-a463-b60cfa3bc612 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:46.820207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971e194-3a25-4aab-a463-b60cfa3bc612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:46.820519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971e194-3a25-4aab-a463-b60cfa3bc612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:46.822310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971e194-3a25-4aab-a463-b60cfa3bc612 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:46.825185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-90cf9f30-6e30-44f2-8a43-1749cca79370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:46.873250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1046/2074] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:46.881541 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeef9a-5858-4d99-8ff9-2f3c05bab14d None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:46.881832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeef9a-5858-4d99-8ff9-2f3c05bab14d None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:46.882112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeef9a-5858-4d99-8ff9-2f3c05bab14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:46.929411 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-c6aeef9a-5858-4d99-8ff9-2f3c05bab14d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:46.933019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c6aeef9a-5858-4d99-8ff9-2f3c05bab14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:46.984102 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf9f30-6e30-44f2-8a43-1749cca79370 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:46.989964 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38cfba-08f1-4357-a9b0-cd29697d32ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:46.990690 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38cfba-08f1-4357-a9b0-cd29697d32ed admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:46.991153 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38cfba-08f1-4357-a9b0-cd29697d32ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:46.991260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38cfba-08f1-4357-a9b0-cd29697d32ed admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:46.991960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38cfba-08f1-4357-a9b0-cd29697d32ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:46.994296 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38cfba-08f1-4357-a9b0-cd29697d32ed admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:47.034850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1029/2075] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:46 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:47.034850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38cfba-08f1-4357-a9b0-cd29697d32ed admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:47.036162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-da38cfba-08f1-4357-a9b0-cd29697d32ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:47.038676 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1047/2076] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:47.040641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeef9a-5858-4d99-8ff9-2f3c05bab14d None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:47.057063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeef9a-5858-4d99-8ff9-2f3c05bab14d None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:47.057599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38cfba-08f1-4357-a9b0-cd29697d32ed admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:47.062608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021e034-7cd3-4ea1-ba98-07d2068a6707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:47.063323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021e034-7cd3-4ea1-ba98-07d2068a6707 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:47.063612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021e034-7cd3-4ea1-ba98-07d2068a6707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:47.063887 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021e034-7cd3-4ea1-ba98-07d2068a6707 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:47.064139 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24729db-3dc1-4bf4-b013-cc2856bf1ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:47.064589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021e034-7cd3-4ea1-ba98-07d2068a6707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:47.065353 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24729db-3dc1-4bf4-b013-cc2856bf1ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:47.065981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24729db-3dc1-4bf4-b013-cc2856bf1ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:47.066409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24729db-3dc1-4bf4-b013-cc2856bf1ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:47.066840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021e034-7cd3-4ea1-ba98-07d2068a6707 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:47.067470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24729db-3dc1-4bf4-b013-cc2856bf1ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:47.069711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24729db-3dc1-4bf4-b013-cc2856bf1ce9 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:47.086267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1048/2077] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:47.087256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24729db-3dc1-4bf4-b013-cc2856bf1ce9 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:47.089096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f24729db-3dc1-4bf4-b013-cc2856bf1ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:47.103572 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:47.113484 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1030/2078] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:47 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:47.113484 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021e034-7cd3-4ea1-ba98-07d2068a6707 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:47.198544 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:47.214683 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021e034-7cd3-4ea1-ba98-07d2068a6707 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:47.224814 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24729db-3dc1-4bf4-b013-cc2856bf1ce9 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:47.227871 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b984867-2201-4bff-9243-3a9dc7e330d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:47.228562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b984867-2201-4bff-9243-3a9dc7e330d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:47.228846 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b984867-2201-4bff-9243-3a9dc7e330d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:47.229125 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b984867-2201-4bff-9243-3a9dc7e330d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:47.230285 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b984867-2201-4bff-9243-3a9dc7e330d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:47.234241 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b984867-2201-4bff-9243-3a9dc7e330d1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:47.252419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1031/2079] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:47.254251 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b984867-2201-4bff-9243-3a9dc7e330d1 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:47.273720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b984867-2201-4bff-9243-3a9dc7e330d1 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:47.286293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209940-6bf9-4378-872c-61ce87337379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:47.287293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209940-6bf9-4378-872c-61ce87337379 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:47.287658 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209940-6bf9-4378-872c-61ce87337379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:47.288034 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209940-6bf9-4378-872c-61ce87337379 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:47.288843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209940-6bf9-4378-872c-61ce87337379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:47.290945 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209940-6bf9-4378-872c-61ce87337379 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:47.303803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d1c24-00fc-43fb-875a-ffd888a1e732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:47.304491 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d1c24-00fc-43fb-875a-ffd888a1e732 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:47.304926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d1c24-00fc-43fb-875a-ffd888a1e732 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:47.305197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d1c24-00fc-43fb-875a-ffd888a1e732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:47.314508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1032/2080] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:47 2022] POST /identity/v3/users => generated 287 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:47.315302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209940-6bf9-4378-872c-61ce87337379 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:47.315990 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d1c24-00fc-43fb-875a-ffd888a1e732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:47.317641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d1c24-00fc-43fb-875a-ffd888a1e732 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:47.325698 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209940-6bf9-4378-872c-61ce87337379 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:47.328906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1049/2081] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:47.331926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8eb2a-c6e9-41db-bd86-0312f0eca0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:47.333006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8eb2a-c6e9-41db-bd86-0312f0eca0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:47.333382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8eb2a-c6e9-41db-bd86-0312f0eca0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:47.333754 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8eb2a-c6e9-41db-bd86-0312f0eca0d7 admin admin] PATH_INFO: `/v3/projects/403106167c5749d29f525a4357f7467d/users/880bd64d64de48caa88e711be4c4e30d/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:47.335594 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d1c24-00fc-43fb-875a-ffd888a1e732 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:47.347497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d1c24-00fc-43fb-875a-ffd888a1e732 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:47.354199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a12a1a-6009-48be-9054-aeb2b44378d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:47.355116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a12a1a-6009-48be-9054-aeb2b44378d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:47.355551 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a12a1a-6009-48be-9054-aeb2b44378d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:47.356099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a12a1a-6009-48be-9054-aeb2b44378d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:47.357811 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a12a1a-6009-48be-9054-aeb2b44378d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:47.360085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a12a1a-6009-48be-9054-aeb2b44378d3 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:47.373182 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8eb2a-c6e9-41db-bd86-0312f0eca0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403106167c5749d29f525a4357f7467d, user_id=880bd64d64de48caa88e711be4c4e30d, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:47.376622 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1050/2082] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:47.380245 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8eb2a-c6e9-41db-bd86-0312f0eca0d7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:47.381816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a12a1a-6009-48be-9054-aeb2b44378d3 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:47.409187 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a12a1a-6009-48be-9054-aeb2b44378d3 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:47.420298 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1033/2083] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:47 2022] PUT /identity/v3/projects/403106167c5749d29f525a4357f7467d/users/880bd64d64de48caa88e711be4c4e30d/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:47.426216 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310bd1f-36d6-4c2a-b916-56cfb0ed573d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:47.426216 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310bd1f-36d6-4c2a-b916-56cfb0ed573d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:47.426216 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310bd1f-36d6-4c2a-b916-56cfb0ed573d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:47.494724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5310bd1f-36d6-4c2a-b916-56cfb0ed573d None None] MFA Rules not processed for user `880bd64d64de48caa88e711be4c4e30d`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:47.495976 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5310bd1f-36d6-4c2a-b916-56cfb0ed573d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:47.507172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73605d1-8021-45b9-9d33-7c068e3afbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:47.507961 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73605d1-8021-45b9-9d33-7c068e3afbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:47.508318 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73605d1-8021-45b9-9d33-7c068e3afbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:47.508666 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73605d1-8021-45b9-9d33-7c068e3afbc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:47.510623 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73605d1-8021-45b9-9d33-7c068e3afbc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:47.512858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73605d1-8021-45b9-9d33-7c068e3afbc1 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:47.530764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1051/2084] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:47.532011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73605d1-8021-45b9-9d33-7c068e3afbc1 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:47.546079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73605d1-8021-45b9-9d33-7c068e3afbc1 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:47.552597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92957fd5-cb44-4ca8-9437-b436a8c369b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:47.554312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92957fd5-cb44-4ca8-9437-b436a8c369b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:47.554634 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92957fd5-cb44-4ca8-9437-b436a8c369b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:47.554920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92957fd5-cb44-4ca8-9437-b436a8c369b7 admin admin] PATH_INFO: `/v3/projects/c2eb2b15c268473a855ca705ccb55d7e/users/4b0d8f37078c46098e7ada2696e382b5/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:47.574991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92957fd5-cb44-4ca8-9437-b436a8c369b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2eb2b15c268473a855ca705ccb55d7e, user_id=4b0d8f37078c46098e7ada2696e382b5, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:47.578185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92957fd5-cb44-4ca8-9437-b436a8c369b7 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:47.608912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1052/2085] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:47 2022] PUT /identity/v3/projects/c2eb2b15c268473a855ca705ccb55d7e/users/4b0d8f37078c46098e7ada2696e382b5/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:47.609346 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1034/2086] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:47.611807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02f9d0-d750-4df6-8346-edbce489ed89 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:47.612228 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02f9d0-d750-4df6-8346-edbce489ed89 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:47.612576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02f9d0-d750-4df6-8346-edbce489ed89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:47.616836 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310bd1f-36d6-4c2a-b916-56cfb0ed573d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:47.618554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5310bd1f-36d6-4c2a-b916-56cfb0ed573d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:47.658970 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-2f02f9d0-d750-4df6-8346-edbce489ed89 None None] MFA Rules not processed for user `4b0d8f37078c46098e7ada2696e382b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:47.660264 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2f02f9d0-d750-4df6-8346-edbce489ed89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:47.695617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:47.712737 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310bd1f-36d6-4c2a-b916-56cfb0ed573d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:47.785121 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86dfd2-36d1-4592-a1e4-b75753b88930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:47.785893 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86dfd2-36d1-4592-a1e4-b75753b88930 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:47.786433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86dfd2-36d1-4592-a1e4-b75753b88930 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:47.786688 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86dfd2-36d1-4592-a1e4-b75753b88930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:47.788130 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1053/2087] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:47.794888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:47.803232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02f9d0-d750-4df6-8346-edbce489ed89 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:47.805207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2f02f9d0-d750-4df6-8346-edbce489ed89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:47.820252 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02f9d0-d750-4df6-8346-edbce489ed89 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:47.825031 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdeaa2-1bdb-4a41-9023-c0cb4c479967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:47.826615 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdeaa2-1bdb-4a41-9023-c0cb4c479967 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:47.826615 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdeaa2-1bdb-4a41-9023-c0cb4c479967 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:47.827454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdeaa2-1bdb-4a41-9023-c0cb4c479967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:47.840638 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdeaa2-1bdb-4a41-9023-c0cb4c479967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:47.842694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdeaa2-1bdb-4a41-9023-c0cb4c479967 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:47.858711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1054/2088] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:47.861092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86dfd2-36d1-4592-a1e4-b75753b88930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:47.862765 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86dfd2-36d1-4592-a1e4-b75753b88930 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:47.875241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdeaa2-1bdb-4a41-9023-c0cb4c479967 service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:47.893073 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1035/2089] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:47.910443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86dfd2-36d1-4592-a1e4-b75753b88930 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:47.964113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdeaa2-1bdb-4a41-9023-c0cb4c479967 service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:47.972045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed820ba5-9bc0-49ff-a058-b297ef7bf793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:47.973651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed820ba5-9bc0-49ff-a058-b297ef7bf793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:47.973938 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed820ba5-9bc0-49ff-a058-b297ef7bf793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:47.975384 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed820ba5-9bc0-49ff-a058-b297ef7bf793 admin admin] PATH_INFO: `/v3/users/4b0d8f37078c46098e7ada2696e382b5` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:47.976885 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed820ba5-9bc0-49ff-a058-b297ef7bf793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b0d8f37078c46098e7ada2696e382b5)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:47.980440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed820ba5-9bc0-49ff-a058-b297ef7bf793 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:48.007422 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86dfd2-36d1-4592-a1e4-b75753b88930 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:48.016314 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6caaa9e-b59a-44b3-bab9-5a1b3a9a7aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:48.017421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caaa9e-b59a-44b3-bab9-5a1b3a9a7aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:48.017660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caaa9e-b59a-44b3-bab9-5a1b3a9a7aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:48.018017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6caaa9e-b59a-44b3-bab9-5a1b3a9a7aca admin admin] PATH_INFO: `/v3/users/880bd64d64de48caa88e711be4c4e30d` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:48.019348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caaa9e-b59a-44b3-bab9-5a1b3a9a7aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=880bd64d64de48caa88e711be4c4e30d)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:48.021567 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6caaa9e-b59a-44b3-bab9-5a1b3a9a7aca admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:48.054174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-ed820ba5-9bc0-49ff-a058-b297ef7bf793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b0d8f37078c46098e7ada2696e382b5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.094046 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-ed820ba5-9bc0-49ff-a058-b297ef7bf793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b0d8f37078c46098e7ada2696e382b5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.098693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-ed820ba5-9bc0-49ff-a058-b297ef7bf793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b0d8f37078c46098e7ada2696e382b5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.115160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e6caaa9e-b59a-44b3-bab9-5a1b3a9a7aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880bd64d64de48caa88e711be4c4e30d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.129837 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e6caaa9e-b59a-44b3-bab9-5a1b3a9a7aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880bd64d64de48caa88e711be4c4e30d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.131257 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e6caaa9e-b59a-44b3-bab9-5a1b3a9a7aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880bd64d64de48caa88e711be4c4e30d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.148333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-ed820ba5-9bc0-49ff-a058-b297ef7bf793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b0d8f37078c46098e7ada2696e382b5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.157531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e6caaa9e-b59a-44b3-bab9-5a1b3a9a7aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880bd64d64de48caa88e711be4c4e30d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.159584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-ed820ba5-9bc0-49ff-a058-b297ef7bf793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b0d8f37078c46098e7ada2696e382b5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.169218 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1055/2090] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:47 2022] DELETE /identity/v3/users/4b0d8f37078c46098e7ada2696e382b5 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:48.172600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e6caaa9e-b59a-44b3-bab9-5a1b3a9a7aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880bd64d64de48caa88e711be4c4e30d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.174026 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efe5a7-6743-4f65-b80d-34fc3b81e06b None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:48.174701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efe5a7-6743-4f65-b80d-34fc3b81e06b None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:48.175715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efe5a7-6743-4f65-b80d-34fc3b81e06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:48.180417 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1036/2091] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:47 2022] DELETE /identity/v3/users/880bd64d64de48caa88e711be4c4e30d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:48.187012 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b20d8b-b487-4671-b8e7-9ac3b75fd024 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:48.187451 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b20d8b-b487-4671-b8e7-9ac3b75fd024 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:48.187824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b20d8b-b487-4671-b8e7-9ac3b75fd024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:48.217209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-30efe5a7-6743-4f65-b80d-34fc3b81e06b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:48.217479 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-52b20d8b-b487-4671-b8e7-9ac3b75fd024 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:48.219059 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-52b20d8b-b487-4671-b8e7-9ac3b75fd024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:48.221199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-30efe5a7-6743-4f65-b80d-34fc3b81e06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:48.249602 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:48.270828 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:48.367623 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1037/2092] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:48.377920 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b20d8b-b487-4671-b8e7-9ac3b75fd024 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:48.379793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-52b20d8b-b487-4671-b8e7-9ac3b75fd024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:48.400754 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b20d8b-b487-4671-b8e7-9ac3b75fd024 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:48.407808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1056/2093] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:48.410177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efe5a7-6743-4f65-b80d-34fc3b81e06b None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:48.412969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-30efe5a7-6743-4f65-b80d-34fc3b81e06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:48.423832 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f3044-b8ca-472f-9b7f-55df73c46e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:48.425801 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f3044-b8ca-472f-9b7f-55df73c46e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:48.426181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f3044-b8ca-472f-9b7f-55df73c46e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:48.428015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f3044-b8ca-472f-9b7f-55df73c46e35 admin admin] PATH_INFO: `/v3/projects/84c89d45423448c09a19d6c9f5d90ff5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:48.429563 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f3044-b8ca-472f-9b7f-55df73c46e35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c89d45423448c09a19d6c9f5d90ff5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:48.436801 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f3044-b8ca-472f-9b7f-55df73c46e35 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:48.559944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efe5a7-6743-4f65-b80d-34fc3b81e06b None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:48.567137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-685f3044-b8ca-472f-9b7f-55df73c46e35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c89d45423448c09a19d6c9f5d90ff5', 'request_id': 'req-685f3044-b8ca-472f-9b7f-55df73c46e35'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.575575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-685f3044-b8ca-472f-9b7f-55df73c46e35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c89d45423448c09a19d6c9f5d90ff5', 'request_id': 'req-685f3044-b8ca-472f-9b7f-55df73c46e35'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.586281 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-685f3044-b8ca-472f-9b7f-55df73c46e35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c89d45423448c09a19d6c9f5d90ff5', 'request_id': 'req-685f3044-b8ca-472f-9b7f-55df73c46e35'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.607944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-685f3044-b8ca-472f-9b7f-55df73c46e35 admin admin] The token cache is being invalidate because project 84c89d45423448c09a19d6c9f5d90ff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:48.608722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-685f3044-b8ca-472f-9b7f-55df73c46e35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.609066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-685f3044-b8ca-472f-9b7f-55df73c46e35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.612872 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1038/2094] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:48 2022] DELETE /identity/v3/projects/84c89d45423448c09a19d6c9f5d90ff5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:48.613585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f3044-b8ca-472f-9b7f-55df73c46e35 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:48.616408 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-685f3044-b8ca-472f-9b7f-55df73c46e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:48.624343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c61fa-2e6d-4b08-9135-4f37e4b2e204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:48.625012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c61fa-2e6d-4b08-9135-4f37e4b2e204 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:48.625298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c61fa-2e6d-4b08-9135-4f37e4b2e204 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:48.625577 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c61fa-2e6d-4b08-9135-4f37e4b2e204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:48.627596 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3e7c61fa-2e6d-4b08-9135-4f37e4b2e204 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:48.692684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f3044-b8ca-472f-9b7f-55df73c46e35 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:48.697325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1d169-c98e-46e1-ae80-0f607829b9ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:48.698120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1d169-c98e-46e1-ae80-0f607829b9ed service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:48.698653 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1d169-c98e-46e1-ae80-0f607829b9ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:48.699022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1d169-c98e-46e1-ae80-0f607829b9ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:48.701039 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-68f1d169-c98e-46e1-ae80-0f607829b9ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:48.713945 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c61fa-2e6d-4b08-9135-4f37e4b2e204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:48.715428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c61fa-2e6d-4b08-9135-4f37e4b2e204 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:48.726476 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1057/2095] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:48.727502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c61fa-2e6d-4b08-9135-4f37e4b2e204 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:48.728784 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3e7c61fa-2e6d-4b08-9135-4f37e4b2e204 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:48.743085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c61fa-2e6d-4b08-9135-4f37e4b2e204 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:48.748519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecc43f-04f7-4cd1-8d07-859839eb83db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:48.749605 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecc43f-04f7-4cd1-8d07-859839eb83db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:48.749891 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecc43f-04f7-4cd1-8d07-859839eb83db admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:48.750170 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecc43f-04f7-4cd1-8d07-859839eb83db admin admin] PATH_INFO: `/v3/users/7d39f57f9b234ba58af7796bdc98defa` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:48.751439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecc43f-04f7-4cd1-8d07-859839eb83db admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d39f57f9b234ba58af7796bdc98defa)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:48.753931 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecc43f-04f7-4cd1-8d07-859839eb83db admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:48.784937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1d169-c98e-46e1-ae80-0f607829b9ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:48.786527 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1d169-c98e-46e1-ae80-0f607829b9ed service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:48.792450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:48.793300 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:48.799562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1039/2096] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:48.820140 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-78ecc43f-04f7-4cd1-8d07-859839eb83db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d39f57f9b234ba58af7796bdc98defa'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.829310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-78ecc43f-04f7-4cd1-8d07-859839eb83db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d39f57f9b234ba58af7796bdc98defa'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.829964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-78ecc43f-04f7-4cd1-8d07-859839eb83db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d39f57f9b234ba58af7796bdc98defa'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.846583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-78ecc43f-04f7-4cd1-8d07-859839eb83db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d39f57f9b234ba58af7796bdc98defa'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.855819 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-78ecc43f-04f7-4cd1-8d07-859839eb83db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d39f57f9b234ba58af7796bdc98defa'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:48.864717 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1058/2097] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:48 2022] DELETE /identity/v3/users/7d39f57f9b234ba58af7796bdc98defa => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:49.709173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1d169-c98e-46e1-ae80-0f607829b9ed service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:49.711009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-68f1d169-c98e-46e1-ae80-0f607829b9ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:49.731143 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1d169-c98e-46e1-ae80-0f607829b9ed service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:49.826366 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecc43f-04f7-4cd1-8d07-859839eb83db admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:49.827936 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-78ecc43f-04f7-4cd1-8d07-859839eb83db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:49.928277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dada234-8a85-4b89-abd8-ca0cdaf92687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:49.929667 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada234-8a85-4b89-abd8-ca0cdaf92687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:49.930364 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada234-8a85-4b89-abd8-ca0cdaf92687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:49.930811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada234-8a85-4b89-abd8-ca0cdaf92687 admin admin] PATH_INFO: `/v3/projects/403106167c5749d29f525a4357f7467d` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:49.933708 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dada234-8a85-4b89-abd8-ca0cdaf92687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=403106167c5749d29f525a4357f7467d)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:49.937927 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dada234-8a85-4b89-abd8-ca0cdaf92687 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:49.962086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecc43f-04f7-4cd1-8d07-859839eb83db admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:49.967504 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fc9ce-d1fe-434d-81a1-3ff1ea38c22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:49.968400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fc9ce-d1fe-434d-81a1-3ff1ea38c22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:49.968843 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fc9ce-d1fe-434d-81a1-3ff1ea38c22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:49.969141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fc9ce-d1fe-434d-81a1-3ff1ea38c22b admin admin] PATH_INFO: `/v3/projects/c2eb2b15c268473a855ca705ccb55d7e` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:49.972710 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fc9ce-d1fe-434d-81a1-3ff1ea38c22b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2eb2b15c268473a855ca705ccb55d7e)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:49.975107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fc9ce-d1fe-434d-81a1-3ff1ea38c22b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:50.008875 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2dada234-8a85-4b89-abd8-ca0cdaf92687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403106167c5749d29f525a4357f7467d', 'request_id': 'req-2dada234-8a85-4b89-abd8-ca0cdaf92687'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:50.017666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2dada234-8a85-4b89-abd8-ca0cdaf92687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403106167c5749d29f525a4357f7467d', 'request_id': 'req-2dada234-8a85-4b89-abd8-ca0cdaf92687'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:50.028599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2dada234-8a85-4b89-abd8-ca0cdaf92687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403106167c5749d29f525a4357f7467d', 'request_id': 'req-2dada234-8a85-4b89-abd8-ca0cdaf92687'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:50.039820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-024fc9ce-d1fe-434d-81a1-3ff1ea38c22b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2eb2b15c268473a855ca705ccb55d7e', 'request_id': 'req-024fc9ce-d1fe-434d-81a1-3ff1ea38c22b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:50.048397 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2dada234-8a85-4b89-abd8-ca0cdaf92687 admin admin] The token cache is being invalidate because project 403106167c5749d29f525a4357f7467d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:50.048986 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2dada234-8a85-4b89-abd8-ca0cdaf92687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:50.049752 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-024fc9ce-d1fe-434d-81a1-3ff1ea38c22b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2eb2b15c268473a855ca705ccb55d7e', 'request_id': 'req-024fc9ce-d1fe-434d-81a1-3ff1ea38c22b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:50.051650 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2dada234-8a85-4b89-abd8-ca0cdaf92687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:50.055032 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1040/2098] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:49 2022] DELETE /identity/v3/projects/403106167c5749d29f525a4357f7467d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:50.057558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-024fc9ce-d1fe-434d-81a1-3ff1ea38c22b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2eb2b15c268473a855ca705ccb55d7e', 'request_id': 'req-024fc9ce-d1fe-434d-81a1-3ff1ea38c22b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:50.062699 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939e95d-7117-4af2-add2-bc34430473d1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.063400 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939e95d-7117-4af2-add2-bc34430473d1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.063534 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939e95d-7117-4af2-add2-bc34430473d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.079948 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-024fc9ce-d1fe-434d-81a1-3ff1ea38c22b admin admin] The token cache is being invalidate because project c2eb2b15c268473a855ca705ccb55d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:50.080306 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-024fc9ce-d1fe-434d-81a1-3ff1ea38c22b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:50.082241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-024fc9ce-d1fe-434d-81a1-3ff1ea38c22b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:50.088103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e939e95d-7117-4af2-add2-bc34430473d1 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:50.088103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e939e95d-7117-4af2-add2-bc34430473d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:50.088944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1059/2099] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:49 2022] DELETE /identity/v3/projects/c2eb2b15c268473a855ca705ccb55d7e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:50.091405 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08745eb-d2ab-414f-8b82-8e299879b4a9 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.092508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08745eb-d2ab-414f-8b82-8e299879b4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.093032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08745eb-d2ab-414f-8b82-8e299879b4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.123032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-d08745eb-d2ab-414f-8b82-8e299879b4a9 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:50.126821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d08745eb-d2ab-414f-8b82-8e299879b4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:50.169839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:50.173586 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1041/2100] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:50.186225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf670ae-dbfd-47e9-af42-22d62c6904e2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.186703 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf670ae-dbfd-47e9-af42-22d62c6904e2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.187564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf670ae-dbfd-47e9-af42-22d62c6904e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.223413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1060/2101] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:50.223899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-fdf670ae-dbfd-47e9-af42-22d62c6904e2 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:50.223899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fdf670ae-dbfd-47e9-af42-22d62c6904e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:50.224050 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08745eb-d2ab-414f-8b82-8e299879b4a9 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:50.225816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d08745eb-d2ab-414f-8b82-8e299879b4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:50.230533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1042/2102] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:50.230533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c50ef-516d-4090-85d7-22f03fd518a7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.230533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c50ef-516d-4090-85d7-22f03fd518a7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.230533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c50ef-516d-4090-85d7-22f03fd518a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.255426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08745eb-d2ab-414f-8b82-8e299879b4a9 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:50.261622 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ed8c50ef-516d-4090-85d7-22f03fd518a7 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:50.261725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:50.262793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.263102 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ed8c50ef-516d-4090-85d7-22f03fd518a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:50.263228 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.263673 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829 admin admin] PATH_INFO: `/v3/projects/809625c621cb4735943d3e5916301e33` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.265131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=809625c621cb4735943d3e5916301e33)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:50.267777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:50.274592 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1043/2103] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:50.275375 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c50ef-516d-4090-85d7-22f03fd518a7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:50.290267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c50ef-516d-4090-85d7-22f03fd518a7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:50.302300 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cdb50-d4a2-498b-ad16-0edac961fb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:50.303858 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cdb50-d4a2-498b-ad16-0edac961fb8d admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.303858 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cdb50-d4a2-498b-ad16-0edac961fb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.304355 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cdb50-d4a2-498b-ad16-0edac961fb8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.305205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cdb50-d4a2-498b-ad16-0edac961fb8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:50.305398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cdb50-d4a2-498b-ad16-0edac961fb8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:50.307652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cdb50-d4a2-498b-ad16-0edac961fb8d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:50.328548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1044/2104] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:50.330945 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cdb50-d4a2-498b-ad16-0edac961fb8d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:50.340293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:50.344929 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809625c621cb4735943d3e5916301e33', 'request_id': 'req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:50.346935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cdb50-d4a2-498b-ad16-0edac961fb8d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:50.353178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809625c621cb4735943d3e5916301e33', 'request_id': 'req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:50.359909 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809625c621cb4735943d3e5916301e33', 'request_id': 'req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:50.402621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829 admin admin] The token cache is being invalidate because project 809625c621cb4735943d3e5916301e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:50.403252 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:50.405408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:50.409423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1061/2105] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:50 2022] DELETE /identity/v3/projects/809625c621cb4735943d3e5916301e33 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:50.414653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:50.417336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:50.468168 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc3462-284e-499b-8591-19da0f1c28a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:50.469497 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc3462-284e-499b-8591-19da0f1c28a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.469893 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc3462-284e-499b-8591-19da0f1c28a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.470357 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc3462-284e-499b-8591-19da0f1c28a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.471244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc3462-284e-499b-8591-19da0f1c28a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:50.471662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc3462-284e-499b-8591-19da0f1c28a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:50.474221 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc3462-284e-499b-8591-19da0f1c28a6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:50.505436 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1045/2106] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:50.508366 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64afd1b-4ab1-4748-b29c-377edfa9e397 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.508827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64afd1b-4ab1-4748-b29c-377edfa9e397 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.510193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64afd1b-4ab1-4748-b29c-377edfa9e397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.531681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a64afd1b-4ab1-4748-b29c-377edfa9e397 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:50.532907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a64afd1b-4ab1-4748-b29c-377edfa9e397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:50.542056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1046/2107] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:50.543045 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64afd1b-4ab1-4748-b29c-377edfa9e397 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:50.544411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a64afd1b-4ab1-4748-b29c-377edfa9e397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:50.549356 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c669f5b-8ab5-44ed-ad07-4f9a23e32829 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:50.554090 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b927db7-85a6-4dec-bfd4-f21d32572eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:50.555083 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b927db7-85a6-4dec-bfd4-f21d32572eda admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.555374 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b927db7-85a6-4dec-bfd4-f21d32572eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.555644 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b927db7-85a6-4dec-bfd4-f21d32572eda admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.556350 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b927db7-85a6-4dec-bfd4-f21d32572eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:50.557089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64afd1b-4ab1-4748-b29c-377edfa9e397 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:50.558480 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b927db7-85a6-4dec-bfd4-f21d32572eda admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:50.563181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073557e-9cc5-4f51-9327-a4cab4817d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:50.563948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073557e-9cc5-4f51-9327-a4cab4817d49 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.564300 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073557e-9cc5-4f51-9327-a4cab4817d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.564641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073557e-9cc5-4f51-9327-a4cab4817d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.565381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073557e-9cc5-4f51-9327-a4cab4817d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:50.567522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073557e-9cc5-4f51-9327-a4cab4817d49 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:50.597058 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1062/2108] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:50 2022] POST /identity/v3/projects => generated 359 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:50.597058 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359389a3-4712-4dff-af3a-71c71ae755a0 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.597058 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359389a3-4712-4dff-af3a-71c71ae755a0 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.597058 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359389a3-4712-4dff-af3a-71c71ae755a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.609605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1047/2109] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:50 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:50.609605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073557e-9cc5-4f51-9327-a4cab4817d49 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:50.618261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-359389a3-4712-4dff-af3a-71c71ae755a0 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:50.619564 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-359389a3-4712-4dff-af3a-71c71ae755a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:50.663447 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:50.701900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1063/2110] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:50.702984 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359389a3-4712-4dff-af3a-71c71ae755a0 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:50.718247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359389a3-4712-4dff-af3a-71c71ae755a0 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:50.723223 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86255f3c-31d3-43cd-a29d-537f297edc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:50.724069 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86255f3c-31d3-43cd-a29d-537f297edc40 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.724442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86255f3c-31d3-43cd-a29d-537f297edc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.724796 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86255f3c-31d3-43cd-a29d-537f297edc40 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.725597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86255f3c-31d3-43cd-a29d-537f297edc40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:50.727906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073557e-9cc5-4f51-9327-a4cab4817d49 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:50.728770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86255f3c-31d3-43cd-a29d-537f297edc40 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:50.733234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961bf90-3e72-4eb8-ba49-b25de05b6ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:50.733932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961bf90-3e72-4eb8-ba49-b25de05b6ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.734374 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961bf90-3e72-4eb8-ba49-b25de05b6ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.734690 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961bf90-3e72-4eb8-ba49-b25de05b6ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.735393 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961bf90-3e72-4eb8-ba49-b25de05b6ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:50.738213 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961bf90-3e72-4eb8-ba49-b25de05b6ea0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:50.766750 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1064/2111] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:50 2022] POST /identity/v3/users => generated 287 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:50.768414 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86255f3c-31d3-43cd-a29d-537f297edc40 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:50.776266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1048/2112] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:50 2022] POST /identity/v3/users => generated 280 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:50.777688 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961bf90-3e72-4eb8-ba49-b25de05b6ea0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:50.779882 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86255f3c-31d3-43cd-a29d-537f297edc40 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:50.784852 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca708b13-726a-4c9e-b07e-e55c0a3e17e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:50.785532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca708b13-726a-4c9e-b07e-e55c0a3e17e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.785816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca708b13-726a-4c9e-b07e-e55c0a3e17e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.786107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca708b13-726a-4c9e-b07e-e55c0a3e17e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.787079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca708b13-726a-4c9e-b07e-e55c0a3e17e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:50.787389 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca708b13-726a-4c9e-b07e-e55c0a3e17e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:50.789734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca708b13-726a-4c9e-b07e-e55c0a3e17e8 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:50.794183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961bf90-3e72-4eb8-ba49-b25de05b6ea0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:50.801000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0807ee-a7ac-4244-a600-37cbf97a01b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:50.801945 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0807ee-a7ac-4244-a600-37cbf97a01b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.802636 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0807ee-a7ac-4244-a600-37cbf97a01b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.803156 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0807ee-a7ac-4244-a600-37cbf97a01b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.804114 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0807ee-a7ac-4244-a600-37cbf97a01b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:50.804541 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1065/2113] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:50.807224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0807ee-a7ac-4244-a600-37cbf97a01b6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:50.808847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca708b13-726a-4c9e-b07e-e55c0a3e17e8 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:50.821277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca708b13-726a-4c9e-b07e-e55c0a3e17e8 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:50.824562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1049/2114] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:50.824562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0807ee-a7ac-4244-a600-37cbf97a01b6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:50.830555 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09450b-df8c-47b3-9cbf-9243af0901af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:50.831274 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09450b-df8c-47b3-9cbf-9243af0901af admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.831565 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09450b-df8c-47b3-9cbf-9243af0901af admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.831843 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09450b-df8c-47b3-9cbf-9243af0901af admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.832582 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09450b-df8c-47b3-9cbf-9243af0901af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:50.834229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09450b-df8c-47b3-9cbf-9243af0901af admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:50.839718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0807ee-a7ac-4244-a600-37cbf97a01b6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:50.845712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d59a0-76b0-43cc-b4e2-86d285c61fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:50.846609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d59a0-76b0-43cc-b4e2-86d285c61fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.847343 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d59a0-76b0-43cc-b4e2-86d285c61fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.847704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d59a0-76b0-43cc-b4e2-86d285c61fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.848827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d59a0-76b0-43cc-b4e2-86d285c61fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:50.851111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d59a0-76b0-43cc-b4e2-86d285c61fa3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:50.854577 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1066/2115] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:50.856394 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09450b-df8c-47b3-9cbf-9243af0901af admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:50.871411 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09450b-df8c-47b3-9cbf-9243af0901af admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:50.881612 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a0619-593d-483d-8921-016d6bfac1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:50.882790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a0619-593d-483d-8921-016d6bfac1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:50.883234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a0619-593d-483d-8921-016d6bfac1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:50.883523 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a0619-593d-483d-8921-016d6bfac1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:50.884647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a0619-593d-483d-8921-016d6bfac1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:50.886061 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a0619-593d-483d-8921-016d6bfac1e2 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:50.890513 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1050/2116] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:50 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:50.890513 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d59a0-76b0-43cc-b4e2-86d285c61fa3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:50.899966 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1067/2117] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:50.900816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a0619-593d-483d-8921-016d6bfac1e2 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:50.944137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:50.944565 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a0619-593d-483d-8921-016d6bfac1e2 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:51.027262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d59a0-76b0-43cc-b4e2-86d285c61fa3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:51.041983 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c782ad-e67d-44cd-8c90-5186632eaadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:51.044874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c782ad-e67d-44cd-8c90-5186632eaadc admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:51.045163 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c782ad-e67d-44cd-8c90-5186632eaadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:51.045443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c782ad-e67d-44cd-8c90-5186632eaadc admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:51.046852 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cd635-d4ef-42a7-8aa0-0fae21ab7e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:51.047617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cd635-d4ef-42a7-8aa0-0fae21ab7e7f admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:51.050039 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c782ad-e67d-44cd-8c90-5186632eaadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:51.050977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cd635-d4ef-42a7-8aa0-0fae21ab7e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:51.052276 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cd635-d4ef-42a7-8aa0-0fae21ab7e7f admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:51.052988 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469cd635-d4ef-42a7-8aa0-0fae21ab7e7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:51.055006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c782ad-e67d-44cd-8c90-5186632eaadc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:51.060023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469cd635-d4ef-42a7-8aa0-0fae21ab7e7f admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:51.083728 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1051/2118] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:51.084878 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c782ad-e67d-44cd-8c90-5186632eaadc admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:51.106726 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1068/2119] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:50 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:51.108160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cd635-d4ef-42a7-8aa0-0fae21ab7e7f admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:51.110231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c782ad-e67d-44cd-8c90-5186632eaadc admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:51.123744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89d8d8-5e79-4d46-bcf8-e30e8bcb3ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:51.125777 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89d8d8-5e79-4d46-bcf8-e30e8bcb3ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:51.127681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89d8d8-5e79-4d46-bcf8-e30e8bcb3ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:51.128053 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89d8d8-5e79-4d46-bcf8-e30e8bcb3ccb admin admin] PATH_INFO: `/v3/projects/5bf07ec14e6548c2b67b173de788a8db/users/aa5111b7f82949f29a21065b0b64016a/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:51.137897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cd635-d4ef-42a7-8aa0-0fae21ab7e7f admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:51.152028 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888e424-b037-43d7-9e8f-261b45f481d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:51.153617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888e424-b037-43d7-9e8f-261b45f481d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:51.153933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888e424-b037-43d7-9e8f-261b45f481d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:51.154291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888e424-b037-43d7-9e8f-261b45f481d7 admin admin] PATH_INFO: `/v3/projects/c906a7c09ba3444ba4e0e5dd41649fde/users/69edc1ad82a74a2d85df35949062f96e/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:51.170247 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89d8d8-5e79-4d46-bcf8-e30e8bcb3ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf07ec14e6548c2b67b173de788a8db, user_id=aa5111b7f82949f29a21065b0b64016a, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:51.173223 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89d8d8-5e79-4d46-bcf8-e30e8bcb3ccb admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:51.182498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888e424-b037-43d7-9e8f-261b45f481d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c906a7c09ba3444ba4e0e5dd41649fde, user_id=69edc1ad82a74a2d85df35949062f96e, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:51.186125 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888e424-b037-43d7-9e8f-261b45f481d7 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:51.213354 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1069/2120] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:51 2022] PUT /identity/v3/projects/c906a7c09ba3444ba4e0e5dd41649fde/users/69edc1ad82a74a2d85df35949062f96e/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:51.213808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1052/2121] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:51 2022] PUT /identity/v3/projects/5bf07ec14e6548c2b67b173de788a8db/users/aa5111b7f82949f29a21065b0b64016a/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:51.213903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888e424-b037-43d7-9e8f-261b45f481d7 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:51.223353 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa1a2a-d375-435a-90d9-08efa8df73a8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:51.223545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa1a2a-d375-435a-90d9-08efa8df73a8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:51.223703 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa1a2a-d375-435a-90d9-08efa8df73a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:51.264495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d2fa1a2a-d375-435a-90d9-08efa8df73a8 None None] MFA Rules not processed for user `69edc1ad82a74a2d85df35949062f96e`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:51.265813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d2fa1a2a-d375-435a-90d9-08efa8df73a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:51.301238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:51.308861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888e424-b037-43d7-9e8f-261b45f481d7 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:51.342167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1053/2122] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:51 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:51.343597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2de85-5f15-43fa-a1cf-d1efadad5963 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:51.343890 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2de85-5f15-43fa-a1cf-d1efadad5963 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:51.344170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2de85-5f15-43fa-a1cf-d1efadad5963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:51.386799 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b3d2de85-5f15-43fa-a1cf-d1efadad5963 None None] MFA Rules not processed for user `aa5111b7f82949f29a21065b0b64016a`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:51.388463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b3d2de85-5f15-43fa-a1cf-d1efadad5963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:51.405754 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9353a-21ce-4c0b-81c6-f86afc2b0488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:51.406344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9353a-21ce-4c0b-81c6-f86afc2b0488 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:51.406668 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9353a-21ce-4c0b-81c6-f86afc2b0488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:51.406934 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9353a-21ce-4c0b-81c6-f86afc2b0488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:51.407702 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9353a-21ce-4c0b-81c6-f86afc2b0488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:51.409308 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9353a-21ce-4c0b-81c6-f86afc2b0488 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:51.421251 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1070/2123] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:51.422298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9353a-21ce-4c0b-81c6-f86afc2b0488 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:51.425589 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2ae9353a-21ce-4c0b-81c6-f86afc2b0488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:51.444537 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9353a-21ce-4c0b-81c6-f86afc2b0488 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:51.450518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399ab64-6df5-49d3-90e1-7b9cac073ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:51.452778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399ab64-6df5-49d3-90e1-7b9cac073ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:51.452778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399ab64-6df5-49d3-90e1-7b9cac073ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:51.452778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399ab64-6df5-49d3-90e1-7b9cac073ee8 admin admin] PATH_INFO: `/v3/users/62eae57cd0854b2dba17ae44bbeb41f6` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:51.453263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399ab64-6df5-49d3-90e1-7b9cac073ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62eae57cd0854b2dba17ae44bbeb41f6)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:51.455334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399ab64-6df5-49d3-90e1-7b9cac073ee8 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:51.469092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1054/2124] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:51.469969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2de85-5f15-43fa-a1cf-d1efadad5963 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:51.471340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b3d2de85-5f15-43fa-a1cf-d1efadad5963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:51.500838 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:51.523518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3399ab64-6df5-49d3-90e1-7b9cac073ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62eae57cd0854b2dba17ae44bbeb41f6'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:51.533819 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3399ab64-6df5-49d3-90e1-7b9cac073ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62eae57cd0854b2dba17ae44bbeb41f6'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:51.534884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3399ab64-6df5-49d3-90e1-7b9cac073ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62eae57cd0854b2dba17ae44bbeb41f6'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:51.556545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2de85-5f15-43fa-a1cf-d1efadad5963 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:51.558376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3399ab64-6df5-49d3-90e1-7b9cac073ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62eae57cd0854b2dba17ae44bbeb41f6'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:51.564177 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cc04a-1d59-4508-8998-f38e29768349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:51.565748 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cc04a-1d59-4508-8998-f38e29768349 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:51.566658 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cc04a-1d59-4508-8998-f38e29768349 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:51.567151 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cc04a-1d59-4508-8998-f38e29768349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:51.569529 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e66cc04a-1d59-4508-8998-f38e29768349 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:51.569660 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3399ab64-6df5-49d3-90e1-7b9cac073ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62eae57cd0854b2dba17ae44bbeb41f6'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:51.576882 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1071/2125] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:51 2022] DELETE /identity/v3/users/62eae57cd0854b2dba17ae44bbeb41f6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:51.581426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399ab64-6df5-49d3-90e1-7b9cac073ee8 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:51.582889 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3399ab64-6df5-49d3-90e1-7b9cac073ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:51.585347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cc04a-1d59-4508-8998-f38e29768349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:51.587302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cc04a-1d59-4508-8998-f38e29768349 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:51.604750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1055/2126] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:51 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:51.605774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cc04a-1d59-4508-8998-f38e29768349 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:51.609266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e66cc04a-1d59-4508-8998-f38e29768349 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:51.623081 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cc04a-1d59-4508-8998-f38e29768349 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:51.695820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399ab64-6df5-49d3-90e1-7b9cac073ee8 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:51.698967 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8cde6-6f49-4678-9553-9a70b36fc6a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:51.700749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8cde6-6f49-4678-9553-9a70b36fc6a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:51.701294 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8cde6-6f49-4678-9553-9a70b36fc6a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:51.701834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8cde6-6f49-4678-9553-9a70b36fc6a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:51.702468 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593c785-4ba5-4a21-81f7-0f21bf1a8afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:51.704601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fce8cde6-6f49-4678-9553-9a70b36fc6a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:51.711991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593c785-4ba5-4a21-81f7-0f21bf1a8afb admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:51.712358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593c785-4ba5-4a21-81f7-0f21bf1a8afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:51.713185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593c785-4ba5-4a21-81f7-0f21bf1a8afb admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:51.714065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593c785-4ba5-4a21-81f7-0f21bf1a8afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:51.716258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593c785-4ba5-4a21-81f7-0f21bf1a8afb admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:51.731328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1072/2127] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:51.731328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082b178-857d-4cce-8de2-c703e86d80f3 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:51.731328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082b178-857d-4cce-8de2-c703e86d80f3 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:51.731328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082b178-857d-4cce-8de2-c703e86d80f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:51.745985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:51.753413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-2082b178-857d-4cce-8de2-c703e86d80f3 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:51.755762 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2082b178-857d-4cce-8de2-c703e86d80f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:51.770144 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1073/2128] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:51.770144 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082b178-857d-4cce-8de2-c703e86d80f3 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:51.770144 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2082b178-857d-4cce-8de2-c703e86d80f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:51.784064 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082b178-857d-4cce-8de2-c703e86d80f3 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:51.789400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327051a6-8caf-4b2b-ade8-4798ff65c574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:51.790273 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327051a6-8caf-4b2b-ade8-4798ff65c574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:51.790596 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327051a6-8caf-4b2b-ade8-4798ff65c574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:51.790881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327051a6-8caf-4b2b-ade8-4798ff65c574 admin admin] PATH_INFO: `/v3/users/69edc1ad82a74a2d85df35949062f96e` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:51.792224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327051a6-8caf-4b2b-ade8-4798ff65c574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69edc1ad82a74a2d85df35949062f96e)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:51.795075 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327051a6-8caf-4b2b-ade8-4798ff65c574 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:51.829326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8cde6-6f49-4678-9553-9a70b36fc6a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:51.832085 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8cde6-6f49-4678-9553-9a70b36fc6a0 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:51.865809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1056/2129] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:51.868221 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8cde6-6f49-4678-9553-9a70b36fc6a0 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:51.910613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8cde6-6f49-4678-9553-9a70b36fc6a0 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:51.915683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-327051a6-8caf-4b2b-ade8-4798ff65c574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69edc1ad82a74a2d85df35949062f96e'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:51.920382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c1879-273e-404f-940d-982708012c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:51.921657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c1879-273e-404f-940d-982708012c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:51.922279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c1879-273e-404f-940d-982708012c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:51.922814 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c1879-273e-404f-940d-982708012c78 admin admin] PATH_INFO: `/v3/projects/27d1fe5541804b0d9865be9f9832a1a3/users/6ac6bb77304d4aae94eea5859871dcab/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:51.931598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-327051a6-8caf-4b2b-ade8-4798ff65c574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69edc1ad82a74a2d85df35949062f96e'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:51.932300 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-327051a6-8caf-4b2b-ade8-4798ff65c574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69edc1ad82a74a2d85df35949062f96e'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:51.945841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c1879-273e-404f-940d-982708012c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d1fe5541804b0d9865be9f9832a1a3, user_id=6ac6bb77304d4aae94eea5859871dcab, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:51.948760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c1879-273e-404f-940d-982708012c78 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:51.956864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-327051a6-8caf-4b2b-ade8-4798ff65c574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69edc1ad82a74a2d85df35949062f96e'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:51.970367 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1057/2130] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:51 2022] PUT /identity/v3/projects/27d1fe5541804b0d9865be9f9832a1a3/users/6ac6bb77304d4aae94eea5859871dcab/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:51.971623 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c1879-273e-404f-940d-982708012c78 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:51.973410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-eb4c1879-273e-404f-940d-982708012c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:51.988171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-327051a6-8caf-4b2b-ade8-4798ff65c574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69edc1ad82a74a2d85df35949062f96e'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:52.007477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1074/2131] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:51 2022] DELETE /identity/v3/users/69edc1ad82a74a2d85df35949062f96e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:52.007477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4247865-e485-464e-86b9-2981fbc1f252 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:52.007477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4247865-e485-464e-86b9-2981fbc1f252 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:52.007477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4247865-e485-464e-86b9-2981fbc1f252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:52.059380 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-b4247865-e485-464e-86b9-2981fbc1f252 None None] MFA Rules not processed for user `6ac6bb77304d4aae94eea5859871dcab`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:52.061032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b4247865-e485-464e-86b9-2981fbc1f252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:52.061969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c1879-273e-404f-940d-982708012c78 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:52.069665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:52.152743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1d1e7-9ebc-4fb7-a601-55f01f687727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:52.153809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1d1e7-9ebc-4fb7-a601-55f01f687727 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:52.154661 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1d1e7-9ebc-4fb7-a601-55f01f687727 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:52.155207 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1d1e7-9ebc-4fb7-a601-55f01f687727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:52.159460 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-37c1d1e7-9ebc-4fb7-a601-55f01f687727 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:52.160236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1075/2132] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:52.161907 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1f063-cd35-4a3c-b423-4cb4030d5713 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:52.162238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1f063-cd35-4a3c-b423-4cb4030d5713 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:52.172297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1f063-cd35-4a3c-b423-4cb4030d5713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:52.198136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-8eb1f063-cd35-4a3c-b423-4cb4030d5713 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:52.199489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8eb1f063-cd35-4a3c-b423-4cb4030d5713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:52.257097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1d1e7-9ebc-4fb7-a601-55f01f687727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:52.258923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1d1e7-9ebc-4fb7-a601-55f01f687727 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:52.271708 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1058/2133] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:52.272704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1d1e7-9ebc-4fb7-a601-55f01f687727 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:52.274338 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-37c1d1e7-9ebc-4fb7-a601-55f01f687727 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:52.282859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1076/2134] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:52.314774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1f063-cd35-4a3c-b423-4cb4030d5713 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:52.319322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:52.327305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1f063-cd35-4a3c-b423-4cb4030d5713 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:52.337745 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808c16b-4bbc-4838-accd-0f6bc4c70645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:52.339142 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808c16b-4bbc-4838-accd-0f6bc4c70645 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:52.340043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808c16b-4bbc-4838-accd-0f6bc4c70645 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:52.340861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808c16b-4bbc-4838-accd-0f6bc4c70645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:52.377256 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1d1e7-9ebc-4fb7-a601-55f01f687727 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:52.390948 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808c16b-4bbc-4838-accd-0f6bc4c70645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:52.396766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808c16b-4bbc-4838-accd-0f6bc4c70645 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:52.398528 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a69cd-18d3-40c8-8205-e9fdd5eff44a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:52.399237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a69cd-18d3-40c8-8205-e9fdd5eff44a service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:52.399538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a69cd-18d3-40c8-8205-e9fdd5eff44a service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:52.399815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a69cd-18d3-40c8-8205-e9fdd5eff44a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:52.419780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a69cd-18d3-40c8-8205-e9fdd5eff44a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:52.421224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a69cd-18d3-40c8-8205-e9fdd5eff44a service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:52.424812 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1077/2135] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:52.453492 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1059/2136] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:52.898348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808c16b-4bbc-4838-accd-0f6bc4c70645 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:52.900294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-4808c16b-4bbc-4838-accd-0f6bc4c70645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:52.926281 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808c16b-4bbc-4838-accd-0f6bc4c70645 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:52.931571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10b72-575f-411b-88dd-055c66c53c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:52.932558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10b72-575f-411b-88dd-055c66c53c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:52.932945 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10b72-575f-411b-88dd-055c66c53c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:52.933327 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10b72-575f-411b-88dd-055c66c53c8e admin admin] PATH_INFO: `/v3/projects/035529e87969457ba21c9e21256fd36b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:52.934746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b10b72-575f-411b-88dd-055c66c53c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=035529e87969457ba21c9e21256fd36b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:52.936745 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b10b72-575f-411b-88dd-055c66c53c8e admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:53.021734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-28b10b72-575f-411b-88dd-055c66c53c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '035529e87969457ba21c9e21256fd36b', 'request_id': 'req-28b10b72-575f-411b-88dd-055c66c53c8e'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.038271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-28b10b72-575f-411b-88dd-055c66c53c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '035529e87969457ba21c9e21256fd36b', 'request_id': 'req-28b10b72-575f-411b-88dd-055c66c53c8e'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.048666 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-28b10b72-575f-411b-88dd-055c66c53c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '035529e87969457ba21c9e21256fd36b', 'request_id': 'req-28b10b72-575f-411b-88dd-055c66c53c8e'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.068309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-28b10b72-575f-411b-88dd-055c66c53c8e admin admin] The token cache is being invalidate because project 035529e87969457ba21c9e21256fd36b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:53.068945 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-28b10b72-575f-411b-88dd-055c66c53c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.071443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-28b10b72-575f-411b-88dd-055c66c53c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.098331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1078/2137] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:52 2022] DELETE /identity/v3/projects/035529e87969457ba21c9e21256fd36b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:53.102246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a69cd-18d3-40c8-8205-e9fdd5eff44a service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:53.119771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a69cd-18d3-40c8-8205-e9fdd5eff44a service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:53.137333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10b72-575f-411b-88dd-055c66c53c8e admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:53.138916 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-28b10b72-575f-411b-88dd-055c66c53c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:53.227643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339e99f-43d1-49c4-93ef-0c07fdcc1437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:53.228647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339e99f-43d1-49c4-93ef-0c07fdcc1437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:53.230659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339e99f-43d1-49c4-93ef-0c07fdcc1437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:53.232187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339e99f-43d1-49c4-93ef-0c07fdcc1437 admin admin] PATH_INFO: `/v3/users/2e1333f2f5794fab94737779bb9cce28` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:53.234988 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339e99f-43d1-49c4-93ef-0c07fdcc1437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1333f2f5794fab94737779bb9cce28)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:53.238883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339e99f-43d1-49c4-93ef-0c07fdcc1437 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:53.240882 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:53.273063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10b72-575f-411b-88dd-055c66c53c8e admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:53.280838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298801c6-6b9b-450c-9d92-b9d6bb271df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:53.281790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298801c6-6b9b-450c-9d92-b9d6bb271df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:53.282276 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298801c6-6b9b-450c-9d92-b9d6bb271df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:53.282595 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298801c6-6b9b-450c-9d92-b9d6bb271df3 admin admin] PATH_INFO: `/v3/projects/c906a7c09ba3444ba4e0e5dd41649fde` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:53.284477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298801c6-6b9b-450c-9d92-b9d6bb271df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c906a7c09ba3444ba4e0e5dd41649fde)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:53.286842 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298801c6-6b9b-450c-9d92-b9d6bb271df3 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:53.324355 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b339e99f-43d1-49c4-93ef-0c07fdcc1437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1333f2f5794fab94737779bb9cce28'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.338334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b339e99f-43d1-49c4-93ef-0c07fdcc1437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1333f2f5794fab94737779bb9cce28'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.339067 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b339e99f-43d1-49c4-93ef-0c07fdcc1437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1333f2f5794fab94737779bb9cce28'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.353963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b339e99f-43d1-49c4-93ef-0c07fdcc1437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1333f2f5794fab94737779bb9cce28'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.361932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b339e99f-43d1-49c4-93ef-0c07fdcc1437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1333f2f5794fab94737779bb9cce28'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.367265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-298801c6-6b9b-450c-9d92-b9d6bb271df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c906a7c09ba3444ba4e0e5dd41649fde', 'request_id': 'req-298801c6-6b9b-450c-9d92-b9d6bb271df3'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.375242 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1060/2138] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:53 2022] DELETE /identity/v3/users/2e1333f2f5794fab94737779bb9cce28 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:53.378358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-298801c6-6b9b-450c-9d92-b9d6bb271df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c906a7c09ba3444ba4e0e5dd41649fde', 'request_id': 'req-298801c6-6b9b-450c-9d92-b9d6bb271df3'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.388418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-298801c6-6b9b-450c-9d92-b9d6bb271df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c906a7c09ba3444ba4e0e5dd41649fde', 'request_id': 'req-298801c6-6b9b-450c-9d92-b9d6bb271df3'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.426366 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-298801c6-6b9b-450c-9d92-b9d6bb271df3 admin admin] The token cache is being invalidate because project c906a7c09ba3444ba4e0e5dd41649fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:53.426680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-298801c6-6b9b-450c-9d92-b9d6bb271df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.427776 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-298801c6-6b9b-450c-9d92-b9d6bb271df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.429538 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1079/2139] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:53 2022] DELETE /identity/v3/projects/c906a7c09ba3444ba4e0e5dd41649fde => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:18:53.725009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339e99f-43d1-49c4-93ef-0c07fdcc1437 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:53.726719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b339e99f-43d1-49c4-93ef-0c07fdcc1437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:53.799805 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339e99f-43d1-49c4-93ef-0c07fdcc1437 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:53.804603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b5376-deab-4fe6-980c-5eb2bc572570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:53.805474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b5376-deab-4fe6-980c-5eb2bc572570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:53.805759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b5376-deab-4fe6-980c-5eb2bc572570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:53.806035 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b5376-deab-4fe6-980c-5eb2bc572570 admin admin] PATH_INFO: `/v3/projects/d1bf76f07f774e6692a48cc61c248114` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:53.807331 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b5376-deab-4fe6-980c-5eb2bc572570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1bf76f07f774e6692a48cc61c248114)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:53.809341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b5376-deab-4fe6-980c-5eb2bc572570 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:53.863560 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-022b5376-deab-4fe6-980c-5eb2bc572570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1bf76f07f774e6692a48cc61c248114', 'request_id': 'req-022b5376-deab-4fe6-980c-5eb2bc572570'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.868659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-022b5376-deab-4fe6-980c-5eb2bc572570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1bf76f07f774e6692a48cc61c248114', 'request_id': 'req-022b5376-deab-4fe6-980c-5eb2bc572570'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.875588 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-022b5376-deab-4fe6-980c-5eb2bc572570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1bf76f07f774e6692a48cc61c248114', 'request_id': 'req-022b5376-deab-4fe6-980c-5eb2bc572570'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.890573 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-022b5376-deab-4fe6-980c-5eb2bc572570 admin admin] The token cache is being invalidate because project d1bf76f07f774e6692a48cc61c248114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:53.890870 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-022b5376-deab-4fe6-980c-5eb2bc572570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.891525 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-022b5376-deab-4fe6-980c-5eb2bc572570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:53.893092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1061/2140] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:53 2022] DELETE /identity/v3/projects/d1bf76f07f774e6692a48cc61c248114 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:53.898154 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8065fb4-a3ac-4582-b6cb-e73d521c2a40 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:53.898564 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8065fb4-a3ac-4582-b6cb-e73d521c2a40 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:53.898907 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8065fb4-a3ac-4582-b6cb-e73d521c2a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:53.905458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:53.927107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-d8065fb4-a3ac-4582-b6cb-e73d521c2a40 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:53.929222 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d8065fb4-a3ac-4582-b6cb-e73d521c2a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:54.001441 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1080/2141] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:54.003410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3ecf1-414e-404c-a7ff-7fd8cdc1180b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:54.003696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3ecf1-414e-404c-a7ff-7fd8cdc1180b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:54.003973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3ecf1-414e-404c-a7ff-7fd8cdc1180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:54.030560 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-28f3ecf1-414e-404c-a7ff-7fd8cdc1180b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:54.031900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-28f3ecf1-414e-404c-a7ff-7fd8cdc1180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:54.042107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1062/2142] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:54.046188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8065fb4-a3ac-4582-b6cb-e73d521c2a40 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:54.061081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8065fb4-a3ac-4582-b6cb-e73d521c2a40 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:54.067410 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5437c-41cd-44f4-9ffa-3e7f38452448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:54.068183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5437c-41cd-44f4-9ffa-3e7f38452448 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:54.068483 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5437c-41cd-44f4-9ffa-3e7f38452448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:54.068805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5437c-41cd-44f4-9ffa-3e7f38452448 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:54.069610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5437c-41cd-44f4-9ffa-3e7f38452448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:54.069920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5437c-41cd-44f4-9ffa-3e7f38452448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:54.071665 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5437c-41cd-44f4-9ffa-3e7f38452448 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:54.085120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1081/2143] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:54.090150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3ecf1-414e-404c-a7ff-7fd8cdc1180b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:54.098359 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:54.104702 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3ecf1-414e-404c-a7ff-7fd8cdc1180b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:54.113857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66128f1d-f7b4-4d57-ac0b-d3505ba4c21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:54.114815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66128f1d-f7b4-4d57-ac0b-d3505ba4c21e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:54.115274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66128f1d-f7b4-4d57-ac0b-d3505ba4c21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:54.115684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66128f1d-f7b4-4d57-ac0b-d3505ba4c21e admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:54.116525 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66128f1d-f7b4-4d57-ac0b-d3505ba4c21e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:54.120124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66128f1d-f7b4-4d57-ac0b-d3505ba4c21e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:54.175521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1063/2144] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:54 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:18:54.176451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5437c-41cd-44f4-9ffa-3e7f38452448 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:54.190101 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5437c-41cd-44f4-9ffa-3e7f38452448 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:54.250572 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653feea9-a331-460d-991f-d1951b9e3560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:54.251155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653feea9-a331-460d-991f-d1951b9e3560 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:54.251439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653feea9-a331-460d-991f-d1951b9e3560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:54.251734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653feea9-a331-460d-991f-d1951b9e3560 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:54.252440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653feea9-a331-460d-991f-d1951b9e3560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:54.254380 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653feea9-a331-460d-991f-d1951b9e3560 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:54.275541 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1082/2145] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:54 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:54.280210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66128f1d-f7b4-4d57-ac0b-d3505ba4c21e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:54.292120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66128f1d-f7b4-4d57-ac0b-d3505ba4c21e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:54.298146 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b1e34-993b-43ce-9b2b-0a31bbbf195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:54.298889 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b1e34-993b-43ce-9b2b-0a31bbbf195f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:54.299197 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b1e34-993b-43ce-9b2b-0a31bbbf195f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:54.299646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b1e34-993b-43ce-9b2b-0a31bbbf195f admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:54.300395 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b1e34-993b-43ce-9b2b-0a31bbbf195f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:54.302013 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b1e34-993b-43ce-9b2b-0a31bbbf195f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:54.314148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1064/2146] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:54.317890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653feea9-a331-460d-991f-d1951b9e3560 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:54.329371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653feea9-a331-460d-991f-d1951b9e3560 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:54.336802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e16889-9762-44d4-bff8-cfdee63b8dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:54.337628 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16889-9762-44d4-bff8-cfdee63b8dbe admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:54.338008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16889-9762-44d4-bff8-cfdee63b8dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:54.338714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16889-9762-44d4-bff8-cfdee63b8dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:54.339370 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e16889-9762-44d4-bff8-cfdee63b8dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:54.341126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e16889-9762-44d4-bff8-cfdee63b8dbe admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:54.353891 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1083/2147] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:54.357955 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b1e34-993b-43ce-9b2b-0a31bbbf195f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:54.370714 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b1e34-993b-43ce-9b2b-0a31bbbf195f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:54.376271 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38836cea-f25e-480e-a4e0-1aff3ddaacc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:54.377223 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38836cea-f25e-480e-a4e0-1aff3ddaacc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:54.377512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38836cea-f25e-480e-a4e0-1aff3ddaacc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:54.377790 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38836cea-f25e-480e-a4e0-1aff3ddaacc7 admin admin] PATH_INFO: `/v3/projects/654f567be51f412e948b67ea674d8239/users/a3d1fee9a01f46da87188b04c4eedc84/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:54.397364 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38836cea-f25e-480e-a4e0-1aff3ddaacc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=654f567be51f412e948b67ea674d8239, user_id=a3d1fee9a01f46da87188b04c4eedc84, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:54.405383 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38836cea-f25e-480e-a4e0-1aff3ddaacc7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:54.426425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1065/2148] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:54 2022] PUT /identity/v3/projects/654f567be51f412e948b67ea674d8239/users/a3d1fee9a01f46da87188b04c4eedc84/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:54.431041 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf042342-8db1-4e85-8ea7-522390a659e8 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:54.431381 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf042342-8db1-4e85-8ea7-522390a659e8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:54.431656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf042342-8db1-4e85-8ea7-522390a659e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:54.460807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-bf042342-8db1-4e85-8ea7-522390a659e8 None None] MFA Rules not processed for user `a3d1fee9a01f46da87188b04c4eedc84`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:54.462032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-bf042342-8db1-4e85-8ea7-522390a659e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:54.533815 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:54.548398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1084/2149] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:54.559776 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38836cea-f25e-480e-a4e0-1aff3ddaacc7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:54.561467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-38836cea-f25e-480e-a4e0-1aff3ddaacc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:54.641448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38836cea-f25e-480e-a4e0-1aff3ddaacc7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:54.645642 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638eb53a-023a-4644-9784-65d0cf5ff10b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:54.646564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638eb53a-023a-4644-9784-65d0cf5ff10b service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:54.646695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638eb53a-023a-4644-9784-65d0cf5ff10b service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:54.646906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638eb53a-023a-4644-9784-65d0cf5ff10b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:54.657990 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638eb53a-023a-4644-9784-65d0cf5ff10b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:54.659858 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638eb53a-023a-4644-9784-65d0cf5ff10b service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:54.670668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1066/2150] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:58.082448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf042342-8db1-4e85-8ea7-522390a659e8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:58.085405 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-bf042342-8db1-4e85-8ea7-522390a659e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:58.179428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf042342-8db1-4e85-8ea7-522390a659e8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:58.185573 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b42d7-0809-4424-bb1d-34db5035ff5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:58.186652 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b42d7-0809-4424-bb1d-34db5035ff5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:58.187332 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b42d7-0809-4424-bb1d-34db5035ff5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:58.187764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b42d7-0809-4424-bb1d-34db5035ff5b admin admin] PATH_INFO: `/v3/users/6ac6bb77304d4aae94eea5859871dcab` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:58.194598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b42d7-0809-4424-bb1d-34db5035ff5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac6bb77304d4aae94eea5859871dcab)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:58.197984 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b42d7-0809-4424-bb1d-34db5035ff5b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:58.276435 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-644b42d7-0809-4424-bb1d-34db5035ff5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac6bb77304d4aae94eea5859871dcab'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:58.286443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-644b42d7-0809-4424-bb1d-34db5035ff5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac6bb77304d4aae94eea5859871dcab'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:58.287110 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-644b42d7-0809-4424-bb1d-34db5035ff5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac6bb77304d4aae94eea5859871dcab'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:58.302798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-644b42d7-0809-4424-bb1d-34db5035ff5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac6bb77304d4aae94eea5859871dcab'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:58.311194 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-644b42d7-0809-4424-bb1d-34db5035ff5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac6bb77304d4aae94eea5859871dcab'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:58.318288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1085/2151] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:58 2022] DELETE /identity/v3/users/6ac6bb77304d4aae94eea5859871dcab => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:58.323202 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cc000-de86-4425-8d51-2ad6dfc5987e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:58.323755 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cc000-de86-4425-8d51-2ad6dfc5987e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:58.323755 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cc000-de86-4425-8d51-2ad6dfc5987e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:58.346282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-177cc000-de86-4425-8d51-2ad6dfc5987e None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:58.347812 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-177cc000-de86-4425-8d51-2ad6dfc5987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:58.417283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1067/2152] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:58.427475 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b42d7-0809-4424-bb1d-34db5035ff5b admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:58.429454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-644b42d7-0809-4424-bb1d-34db5035ff5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:58.502661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b42d7-0809-4424-bb1d-34db5035ff5b admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:58.506570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7f26f-c1db-4bd3-a6b9-bedb2891ed33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:58.507308 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7f26f-c1db-4bd3-a6b9-bedb2891ed33 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:58.507595 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7f26f-c1db-4bd3-a6b9-bedb2891ed33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:58.507882 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7f26f-c1db-4bd3-a6b9-bedb2891ed33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:58.517746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7f26f-c1db-4bd3-a6b9-bedb2891ed33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:58.519221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7f26f-c1db-4bd3-a6b9-bedb2891ed33 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:58.529523 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1086/2153] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:58.808602 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cc000-de86-4425-8d51-2ad6dfc5987e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:58.810217 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-177cc000-de86-4425-8d51-2ad6dfc5987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:58.824689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cc000-de86-4425-8d51-2ad6dfc5987e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:58.830519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbca1c-54a0-411f-9f53-dac445d2a96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:58.831529 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbca1c-54a0-411f-9f53-dac445d2a96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:58.831897 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbca1c-54a0-411f-9f53-dac445d2a96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:58.832378 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbca1c-54a0-411f-9f53-dac445d2a96a admin admin] PATH_INFO: `/v3/projects/27d1fe5541804b0d9865be9f9832a1a3` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:58.833782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbca1c-54a0-411f-9f53-dac445d2a96a admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d1fe5541804b0d9865be9f9832a1a3)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:58.835919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbca1c-54a0-411f-9f53-dac445d2a96a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:58.884343 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:58.888093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fbdbca1c-54a0-411f-9f53-dac445d2a96a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d1fe5541804b0d9865be9f9832a1a3', 'request_id': 'req-fbdbca1c-54a0-411f-9f53-dac445d2a96a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:58.898505 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7f26f-c1db-4bd3-a6b9-bedb2891ed33 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:58.898639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fbdbca1c-54a0-411f-9f53-dac445d2a96a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d1fe5541804b0d9865be9f9832a1a3', 'request_id': 'req-fbdbca1c-54a0-411f-9f53-dac445d2a96a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:58.900240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-49e7f26f-c1db-4bd3-a6b9-bedb2891ed33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:58.905906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fbdbca1c-54a0-411f-9f53-dac445d2a96a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d1fe5541804b0d9865be9f9832a1a3', 'request_id': 'req-fbdbca1c-54a0-411f-9f53-dac445d2a96a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:58.919064 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7f26f-c1db-4bd3-a6b9-bedb2891ed33 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:58.921253 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fbdbca1c-54a0-411f-9f53-dac445d2a96a admin admin] The token cache is being invalidate because project 27d1fe5541804b0d9865be9f9832a1a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:18:58.921486 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fbdbca1c-54a0-411f-9f53-dac445d2a96a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:58.922100 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fbdbca1c-54a0-411f-9f53-dac445d2a96a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:58.923650 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1068/2154] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:58 2022] DELETE /identity/v3/projects/27d1fe5541804b0d9865be9f9832a1a3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:58.928590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcd304-7210-4f1c-a982-b6ddfcb65f0a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:58.928590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcd304-7210-4f1c-a982-b6ddfcb65f0a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:58.928944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcd304-7210-4f1c-a982-b6ddfcb65f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:58.950586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:58.950695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3abcd304-7210-4f1c-a982-b6ddfcb65f0a None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:58.951958 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3abcd304-7210-4f1c-a982-b6ddfcb65f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:59.006908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12e2ccc-1088-4d72-987f-06747d37b5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:59.008182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e2ccc-1088-4d72-987f-06747d37b5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:59.008619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e2ccc-1088-4d72-987f-06747d37b5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:59.008905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12e2ccc-1088-4d72-987f-06747d37b5ca admin admin] PATH_INFO: `/v3/users/a3d1fee9a01f46da87188b04c4eedc84` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:59.010173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e2ccc-1088-4d72-987f-06747d37b5ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d1fee9a01f46da87188b04c4eedc84)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:59.012177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12e2ccc-1088-4d72-987f-06747d37b5ca admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:59.014574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1069/2155] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:59.022973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b114978-3931-4f2b-84a4-6c30e202f0ed None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:59.023314 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b114978-3931-4f2b-84a4-6c30e202f0ed None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:59.023597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b114978-3931-4f2b-84a4-6c30e202f0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:59.056529 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3b114978-3931-4f2b-84a4-6c30e202f0ed None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:59.058576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3b114978-3931-4f2b-84a4-6c30e202f0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:59.066020 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c12e2ccc-1088-4d72-987f-06747d37b5ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d1fee9a01f46da87188b04c4eedc84'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:59.071235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1070/2156] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:59.075796 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c12e2ccc-1088-4d72-987f-06747d37b5ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d1fee9a01f46da87188b04c4eedc84'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:59.076410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b114978-3931-4f2b-84a4-6c30e202f0ed None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:59.076531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c12e2ccc-1088-4d72-987f-06747d37b5ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d1fee9a01f46da87188b04c4eedc84'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:59.087832 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b114978-3931-4f2b-84a4-6c30e202f0ed None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:59.093016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c12e2ccc-1088-4d72-987f-06747d37b5ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d1fee9a01f46da87188b04c4eedc84'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:59.093493 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fd548-07d1-46fa-8d05-8dbcfa2e645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:59.093823 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd548-07d1-46fa-8d05-8dbcfa2e645c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:59.094310 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd548-07d1-46fa-8d05-8dbcfa2e645c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:59.094618 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd548-07d1-46fa-8d05-8dbcfa2e645c admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:59.095629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fd548-07d1-46fa-8d05-8dbcfa2e645c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:18:59.096044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fd548-07d1-46fa-8d05-8dbcfa2e645c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:59.097728 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fd548-07d1-46fa-8d05-8dbcfa2e645c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:59.101611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c12e2ccc-1088-4d72-987f-06747d37b5ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d1fee9a01f46da87188b04c4eedc84'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:18:59.114070 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1087/2157] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:18:58 2022] DELETE /identity/v3/users/a3d1fee9a01f46da87188b04c4eedc84 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:59.114196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1071/2158] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:18:59.115231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fd548-07d1-46fa-8d05-8dbcfa2e645c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:59.116959 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cd9fd548-07d1-46fa-8d05-8dbcfa2e645c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:59.128249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f7d33-e04c-4eb7-b567-086cb3a00c19 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:59.128753 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f7d33-e04c-4eb7-b567-086cb3a00c19 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:59.129979 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f7d33-e04c-4eb7-b567-086cb3a00c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:59.133554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fd548-07d1-46fa-8d05-8dbcfa2e645c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:59.148782 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-e11f7d33-e04c-4eb7-b567-086cb3a00c19 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:59.150128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e11f7d33-e04c-4eb7-b567-086cb3a00c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:59.206849 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c58e3-8533-44bd-87d6-575528a3a6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:59.207817 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c58e3-8533-44bd-87d6-575528a3a6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:59.208096 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c58e3-8533-44bd-87d6-575528a3a6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:59.208386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c58e3-8533-44bd-87d6-575528a3a6e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:59.209214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c58e3-8533-44bd-87d6-575528a3a6e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:59.211251 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c58e3-8533-44bd-87d6-575528a3a6e3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:59.222305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1088/2159] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:18:59.230189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f7d33-e04c-4eb7-b567-086cb3a00c19 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:59.231848 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e11f7d33-e04c-4eb7-b567-086cb3a00c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:59.245817 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1072/2160] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:18:59 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:18:59.250334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c58e3-8533-44bd-87d6-575528a3a6e3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:59.300062 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:59.324129 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f7d33-e04c-4eb7-b567-086cb3a00c19 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:59.337028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:18:59.374278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c58e3-8533-44bd-87d6-575528a3a6e3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:59.380445 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b415a-8a28-47be-9745-d6d6dc723530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:59.381166 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b415a-8a28-47be-9745-d6d6dc723530 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:59.381652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b415a-8a28-47be-9745-d6d6dc723530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:59.382094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b415a-8a28-47be-9745-d6d6dc723530 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:59.383476 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b415a-8a28-47be-9745-d6d6dc723530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:59.385642 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b415a-8a28-47be-9745-d6d6dc723530 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:59.399450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4a7f4-bda2-4c17-8c40-5ef807b11f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:59.400096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4a7f4-bda2-4c17-8c40-5ef807b11f12 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:59.401644 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4a7f4-bda2-4c17-8c40-5ef807b11f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:59.401854 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4a7f4-bda2-4c17-8c40-5ef807b11f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:59.415279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1073/2161] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:18:59 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:18:59.419153 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b415a-8a28-47be-9745-d6d6dc723530 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:59.419552 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4a7f4-bda2-4c17-8c40-5ef807b11f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:59.421511 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4a7f4-bda2-4c17-8c40-5ef807b11f12 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:59.434088 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1089/2162] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:18:59.446208 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b415a-8a28-47be-9745-d6d6dc723530 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:59.451829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f5f88-de67-4782-8fe3-94f8362da302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:59.452547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f5f88-de67-4782-8fe3-94f8362da302 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:59.452837 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f5f88-de67-4782-8fe3-94f8362da302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:59.453114 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f5f88-de67-4782-8fe3-94f8362da302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:59.453857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f5f88-de67-4782-8fe3-94f8362da302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:59.455750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f5f88-de67-4782-8fe3-94f8362da302 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:59.467465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1074/2163] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:18:59.471611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4a7f4-bda2-4c17-8c40-5ef807b11f12 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:59.483653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4a7f4-bda2-4c17-8c40-5ef807b11f12 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:59.490123 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8784b7-a8a0-421a-a6a4-0cdf73347361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:59.490934 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8784b7-a8a0-421a-a6a4-0cdf73347361 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:59.491228 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8784b7-a8a0-421a-a6a4-0cdf73347361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:59.491508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8784b7-a8a0-421a-a6a4-0cdf73347361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:59.492716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8784b7-a8a0-421a-a6a4-0cdf73347361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:59.494525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8784b7-a8a0-421a-a6a4-0cdf73347361 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:59.512360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1090/2164] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:18:59.514755 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f5f88-de67-4782-8fe3-94f8362da302 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:59.530777 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f5f88-de67-4782-8fe3-94f8362da302 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:59.546194 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b63af-ab04-44ed-a325-24c76ec36740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:59.546194 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b63af-ab04-44ed-a325-24c76ec36740 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:59.546194 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b63af-ab04-44ed-a325-24c76ec36740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:59.546194 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b63af-ab04-44ed-a325-24c76ec36740 admin admin] PATH_INFO: `/v3/projects/9c623c6a932940e9a852f84bc270e84b/users/f98083f9b65449d1b5b83fcbe01e782f/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:59.566166 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b63af-ab04-44ed-a325-24c76ec36740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c623c6a932940e9a852f84bc270e84b, user_id=f98083f9b65449d1b5b83fcbe01e782f, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:59.570144 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b63af-ab04-44ed-a325-24c76ec36740 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:59.592059 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1075/2165] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:18:59 2022] PUT /identity/v3/projects/9c623c6a932940e9a852f84bc270e84b/users/f98083f9b65449d1b5b83fcbe01e782f/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:18:59.603584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a686d-9e16-4e8e-963c-cdfa7c04db21 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:59.604207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a686d-9e16-4e8e-963c-cdfa7c04db21 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:59.604493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a686d-9e16-4e8e-963c-cdfa7c04db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:59.653387 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-296a686d-9e16-4e8e-963c-cdfa7c04db21 None None] MFA Rules not processed for user `f98083f9b65449d1b5b83fcbe01e782f`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:18:59.654805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-296a686d-9e16-4e8e-963c-cdfa7c04db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:59.768681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1091/2166] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:18:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:18:59.788756 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b63af-ab04-44ed-a325-24c76ec36740 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:59.789757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ab6b63af-ab04-44ed-a325-24c76ec36740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:59.831530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a686d-9e16-4e8e-963c-cdfa7c04db21 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:18:59.833147 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-296a686d-9e16-4e8e-963c-cdfa7c04db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:18:59.915387 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b63af-ab04-44ed-a325-24c76ec36740 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:59.924109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c22af8-5118-46b7-a31b-3203f735c360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:59.925160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c22af8-5118-46b7-a31b-3203f735c360 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:59.925360 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c22af8-5118-46b7-a31b-3203f735c360 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:59.925639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c22af8-5118-46b7-a31b-3203f735c360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:59.928817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a686d-9e16-4e8e-963c-cdfa7c04db21 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:18:59.934608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699a644-71f0-42de-b1e4-61baec6b5e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:18:59.935536 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699a644-71f0-42de-b1e4-61baec6b5e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:18:59.935937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699a644-71f0-42de-b1e4-61baec6b5e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:18:59.936593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699a644-71f0-42de-b1e4-61baec6b5e98 admin admin] PATH_INFO: `/v3/projects/654f567be51f412e948b67ea674d8239` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:18:59.937236 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c22af8-5118-46b7-a31b-3203f735c360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:59.938747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c22af8-5118-46b7-a31b-3203f735c360 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:59.939076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699a644-71f0-42de-b1e4-61baec6b5e98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=654f567be51f412e948b67ea674d8239)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:18:59.943279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699a644-71f0-42de-b1e4-61baec6b5e98 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:18:59.951243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1076/2167] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:18:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:18:59.979075 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:00.026493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3699a644-71f0-42de-b1e4-61baec6b5e98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '654f567be51f412e948b67ea674d8239', 'request_id': 'req-3699a644-71f0-42de-b1e4-61baec6b5e98'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:00.038134 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3699a644-71f0-42de-b1e4-61baec6b5e98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '654f567be51f412e948b67ea674d8239', 'request_id': 'req-3699a644-71f0-42de-b1e4-61baec6b5e98'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:00.046973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3699a644-71f0-42de-b1e4-61baec6b5e98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '654f567be51f412e948b67ea674d8239', 'request_id': 'req-3699a644-71f0-42de-b1e4-61baec6b5e98'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:00.068651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3699a644-71f0-42de-b1e4-61baec6b5e98 admin admin] The token cache is being invalidate because project 654f567be51f412e948b67ea674d8239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:19:00.069124 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3699a644-71f0-42de-b1e4-61baec6b5e98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:00.070182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-3699a644-71f0-42de-b1e4-61baec6b5e98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:00.072580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1092/2168] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:18:59 2022] DELETE /identity/v3/projects/654f567be51f412e948b67ea674d8239 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:19:00.077432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239cdb0-4449-4be2-b1fa-6370b01381a0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:00.077800 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239cdb0-4449-4be2-b1fa-6370b01381a0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:00.078215 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239cdb0-4449-4be2-b1fa-6370b01381a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:00.101870 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2239cdb0-4449-4be2-b1fa-6370b01381a0 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:00.103180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2239cdb0-4449-4be2-b1fa-6370b01381a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:00.179508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1077/2169] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:19:00.187449 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f609421-2ea7-4cf4-9858-64d3d63accf7 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:00.187987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f609421-2ea7-4cf4-9858-64d3d63accf7 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:00.188080 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f609421-2ea7-4cf4-9858-64d3d63accf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:00.209817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-7f609421-2ea7-4cf4-9858-64d3d63accf7 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:00.211773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-7f609421-2ea7-4cf4-9858-64d3d63accf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:00.220820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1093/2170] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:00.225957 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239cdb0-4449-4be2-b1fa-6370b01381a0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:00.239887 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239cdb0-4449-4be2-b1fa-6370b01381a0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:00.244482 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fab8f6-39b7-4908-b050-6d55329dcde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:00.245543 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fab8f6-39b7-4908-b050-6d55329dcde8 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:00.245856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fab8f6-39b7-4908-b050-6d55329dcde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:00.246120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fab8f6-39b7-4908-b050-6d55329dcde8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:00.247139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fab8f6-39b7-4908-b050-6d55329dcde8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:19:00.247454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fab8f6-39b7-4908-b050-6d55329dcde8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:00.249657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fab8f6-39b7-4908-b050-6d55329dcde8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:00.265568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1078/2171] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:19:00.277305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f609421-2ea7-4cf4-9858-64d3d63accf7 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:00.292629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f609421-2ea7-4cf4-9858-64d3d63accf7 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:00.297715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfd32b-36e8-4d1b-a0d9-b772556b7a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:00.298530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfd32b-36e8-4d1b-a0d9-b772556b7a50 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:00.298881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfd32b-36e8-4d1b-a0d9-b772556b7a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:00.299210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfd32b-36e8-4d1b-a0d9-b772556b7a50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:00.300023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfd32b-36e8-4d1b-a0d9-b772556b7a50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:00.302585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfd32b-36e8-4d1b-a0d9-b772556b7a50 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:00.342521 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1094/2172] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:19:00 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:00.342656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fab8f6-39b7-4908-b050-6d55329dcde8 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:00.354940 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fab8f6-39b7-4908-b050-6d55329dcde8 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:00.389922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:00.436001 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325e894-40a6-41ee-ab5e-628ee7de8642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:00.436692 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325e894-40a6-41ee-ab5e-628ee7de8642 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:00.436965 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325e894-40a6-41ee-ab5e-628ee7de8642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:00.437241 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325e894-40a6-41ee-ab5e-628ee7de8642 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:00.438001 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325e894-40a6-41ee-ab5e-628ee7de8642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:00.439974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325e894-40a6-41ee-ab5e-628ee7de8642 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:00.461599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1079/2173] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:19:00 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:19:00.466083 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfd32b-36e8-4d1b-a0d9-b772556b7a50 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:00.476768 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfd32b-36e8-4d1b-a0d9-b772556b7a50 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:00.481695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548956a5-4e33-40d9-ace2-7ab58fd4ab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:00.482445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548956a5-4e33-40d9-ace2-7ab58fd4ab99 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:00.482737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548956a5-4e33-40d9-ace2-7ab58fd4ab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:00.483018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548956a5-4e33-40d9-ace2-7ab58fd4ab99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:00.483769 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548956a5-4e33-40d9-ace2-7ab58fd4ab99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:00.485451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548956a5-4e33-40d9-ace2-7ab58fd4ab99 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:00.496310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1095/2174] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:00.501056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325e894-40a6-41ee-ab5e-628ee7de8642 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:00.511728 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325e894-40a6-41ee-ab5e-628ee7de8642 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:00.516549 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fd8aa-fc0b-4bd9-8a02-b53a8e7692e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:00.517214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fd8aa-fc0b-4bd9-8a02-b53a8e7692e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:00.517496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fd8aa-fc0b-4bd9-8a02-b53a8e7692e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:00.517768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fd8aa-fc0b-4bd9-8a02-b53a8e7692e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:00.518531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fd8aa-fc0b-4bd9-8a02-b53a8e7692e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:00.520144 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fd8aa-fc0b-4bd9-8a02-b53a8e7692e5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:00.531133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1080/2175] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:00.535830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548956a5-4e33-40d9-ace2-7ab58fd4ab99 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:00.547048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548956a5-4e33-40d9-ace2-7ab58fd4ab99 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:00.552020 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3817107-4973-4e9a-8668-e116d99a25e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:00.552942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3817107-4973-4e9a-8668-e116d99a25e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:00.553227 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3817107-4973-4e9a-8668-e116d99a25e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:00.553505 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3817107-4973-4e9a-8668-e116d99a25e9 admin admin] PATH_INFO: `/v3/projects/3efef144fcbc4874b237a94949111175/users/51e8b1bf96714ef7ad34ee3d8dd194a6/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:00.572004 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3817107-4973-4e9a-8668-e116d99a25e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efef144fcbc4874b237a94949111175, user_id=51e8b1bf96714ef7ad34ee3d8dd194a6, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:00.574982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3817107-4973-4e9a-8668-e116d99a25e9 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:00.596516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1096/2176] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:00 2022] PUT /identity/v3/projects/3efef144fcbc4874b237a94949111175/users/51e8b1bf96714ef7ad34ee3d8dd194a6/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:00.601693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1453f-c647-4dc3-b68e-0d4bbe093f3d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:00.602058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1453f-c647-4dc3-b68e-0d4bbe093f3d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:00.602430 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1453f-c647-4dc3-b68e-0d4bbe093f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:00.621859 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-42d1453f-c647-4dc3-b68e-0d4bbe093f3d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:00.623665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-42d1453f-c647-4dc3-b68e-0d4bbe093f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:00.686712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1081/2177] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:00.697980 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3817107-4973-4e9a-8668-e116d99a25e9 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:00.700251 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b3817107-4973-4e9a-8668-e116d99a25e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:00.763379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3817107-4973-4e9a-8668-e116d99a25e9 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:00.767564 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ccb95-f864-48f2-8ac3-355d3d66e2ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:00.768201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ccb95-f864-48f2-8ac3-355d3d66e2ff service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:00.768494 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ccb95-f864-48f2-8ac3-355d3d66e2ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:00.768771 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ccb95-f864-48f2-8ac3-355d3d66e2ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:00.778901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ccb95-f864-48f2-8ac3-355d3d66e2ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:00.780020 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ccb95-f864-48f2-8ac3-355d3d66e2ff service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:00.789740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1097/2178] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:01.471447 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859f2ef-5d73-4305-86f4-f458454d9239 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:01.472018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859f2ef-5d73-4305-86f4-f458454d9239 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:01.472184 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859f2ef-5d73-4305-86f4-f458454d9239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:01.493152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d859f2ef-5d73-4305-86f4-f458454d9239 None None] MFA Rules not processed for user `f98083f9b65449d1b5b83fcbe01e782f`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:01.494222 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d859f2ef-5d73-4305-86f4-f458454d9239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:01.558496 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358e9ae-1202-47be-be24-4e5e362d4f24 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:01.559042 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358e9ae-1202-47be-be24-4e5e362d4f24 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:01.559042 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358e9ae-1202-47be-be24-4e5e362d4f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:01.602603 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1082/2179] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:01.621162 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-9358e9ae-1202-47be-be24-4e5e362d4f24 None None] MFA Rules not processed for user `51e8b1bf96714ef7ad34ee3d8dd194a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:01.626941 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9358e9ae-1202-47be-be24-4e5e362d4f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:01.757443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:01.835163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1098/2180] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:01.854440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859f2ef-5d73-4305-86f4-f458454d9239 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:01.856157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d859f2ef-5d73-4305-86f4-f458454d9239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:01.925948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:01.949244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859f2ef-5d73-4305-86f4-f458454d9239 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:01.958760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957cfd0-616d-439b-b3f8-652bc772afe3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:01.959873 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957cfd0-616d-439b-b3f8-652bc772afe3 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:01.960284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957cfd0-616d-439b-b3f8-652bc772afe3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:01.960710 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957cfd0-616d-439b-b3f8-652bc772afe3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:01.983576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957cfd0-616d-439b-b3f8-652bc772afe3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:01.985222 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957cfd0-616d-439b-b3f8-652bc772afe3 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:02.005111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1083/2181] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:03.507078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0245c1-99f6-4d82-aaa8-9638fc576a14 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:03.507505 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0245c1-99f6-4d82-aaa8-9638fc576a14 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:03.507605 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0245c1-99f6-4d82-aaa8-9638fc576a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:03.529130 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-8c0245c1-99f6-4d82-aaa8-9638fc576a14 None None] MFA Rules not processed for user `51e8b1bf96714ef7ad34ee3d8dd194a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:03.530435 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8c0245c1-99f6-4d82-aaa8-9638fc576a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:03.539477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1099/2182] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:03.595254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1f508-fe2e-498b-9a21-490205ee9092 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:03.596635 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1f508-fe2e-498b-9a21-490205ee9092 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:03.597180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1f508-fe2e-498b-9a21-490205ee9092 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:03.599614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1084/2183] 10.222.0.99 () {54 vars in 921 bytes} [Mon Jul 18 14:19:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:19:03.617517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0245c1-99f6-4d82-aaa8-9638fc576a14 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:03.620699 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c59e2-9dcd-42ac-9236-3ec9ec91ea17 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:03.620997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c59e2-9dcd-42ac-9236-3ec9ec91ea17 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:03.621309 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c59e2-9dcd-42ac-9236-3ec9ec91ea17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:03.623357 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8c0245c1-99f6-4d82-aaa8-9638fc576a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:03.646769 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0245c1-99f6-4d82-aaa8-9638fc576a14 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:03.654968 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005db9a-3f21-439f-ac6b-ce1155d56d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:03.656136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005db9a-3f21-439f-ac6b-ce1155d56d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:03.656571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005db9a-3f21-439f-ac6b-ce1155d56d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:03.657076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005db9a-3f21-439f-ac6b-ce1155d56d10 admin admin] PATH_INFO: `/v3/users/aa5111b7f82949f29a21065b0b64016a` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:03.658611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005db9a-3f21-439f-ac6b-ce1155d56d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa5111b7f82949f29a21065b0b64016a)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:03.659808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b85c59e2-9dcd-42ac-9236-3ec9ec91ea17 None None] MFA Rules not processed for user `92b73e1a514148b19bb6a1d2a39e32cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:03.661060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b85c59e2-9dcd-42ac-9236-3ec9ec91ea17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:03.661399 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005db9a-3f21-439f-ac6b-ce1155d56d10 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:03.746693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e005db9a-3f21-439f-ac6b-ce1155d56d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa5111b7f82949f29a21065b0b64016a'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:03.772584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e005db9a-3f21-439f-ac6b-ce1155d56d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa5111b7f82949f29a21065b0b64016a'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:03.774755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e005db9a-3f21-439f-ac6b-ce1155d56d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa5111b7f82949f29a21065b0b64016a'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:03.785466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1085/2184] 10.222.0.99 () {58 vars in 1018 bytes} [Mon Jul 18 14:19:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:03.808405 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e005db9a-3f21-439f-ac6b-ce1155d56d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa5111b7f82949f29a21065b0b64016a'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:03.831868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e005db9a-3f21-439f-ac6b-ce1155d56d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa5111b7f82949f29a21065b0b64016a'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:03.839673 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1100/2185] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:19:03 2022] DELETE /identity/v3/users/aa5111b7f82949f29a21065b0b64016a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:03.844021 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af87e3-1540-417a-8756-6fe295d490d6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:03.844317 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af87e3-1540-417a-8756-6fe295d490d6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:03.844599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af87e3-1540-417a-8756-6fe295d490d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:03.875129 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f6af87e3-1540-417a-8756-6fe295d490d6 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:03.876387 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f6af87e3-1540-417a-8756-6fe295d490d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:03.980517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005db9a-3f21-439f-ac6b-ce1155d56d10 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:03.985177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e005db9a-3f21-439f-ac6b-ce1155d56d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:04.008260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1086/2186] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:04.034791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af87e3-1540-417a-8756-6fe295d490d6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:04.036598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f6af87e3-1540-417a-8756-6fe295d490d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:04.133385 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af87e3-1540-417a-8756-6fe295d490d6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:04.137839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c46a9b-8df0-4c00-841e-590122a2e986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:04.138535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46a9b-8df0-4c00-841e-590122a2e986 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:04.138817 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46a9b-8df0-4c00-841e-590122a2e986 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:04.139091 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46a9b-8df0-4c00-841e-590122a2e986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:04.140804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005db9a-3f21-439f-ac6b-ce1155d56d10 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:04.146207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d033cc4-ade7-4f68-80f9-c175a1b61af5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92b73e1a514148b19bb6a1d2a39e32cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:04.146912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d033cc4-ade7-4f68-80f9-c175a1b61af5 service placement] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:04.147199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d033cc4-ade7-4f68-80f9-c175a1b61af5 service placement] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:04.147477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d033cc4-ade7-4f68-80f9-c175a1b61af5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:04.155277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c46a9b-8df0-4c00-841e-590122a2e986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:04.156737 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c46a9b-8df0-4c00-841e-590122a2e986 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:04.159138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d033cc4-ade7-4f68-80f9-c175a1b61af5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:04.160834 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d033cc4-ade7-4f68-80f9-c175a1b61af5 service placement] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:04.167423 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1087/2187] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:19:04.168465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c46a9b-8df0-4c00-841e-590122a2e986 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:04.170425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-49c46a9b-8df0-4c00-841e-590122a2e986 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:04.172115 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1101/2188] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:04.191925 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c46a9b-8df0-4c00-841e-590122a2e986 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:04.196885 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004c66c-2a68-487b-bb44-4209a1b1a8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:04.198468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004c66c-2a68-487b-bb44-4209a1b1a8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:04.198830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004c66c-2a68-487b-bb44-4209a1b1a8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:04.199178 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004c66c-2a68-487b-bb44-4209a1b1a8df admin admin] PATH_INFO: `/v3/users/c205c6af37ca4cbb88cd35e7229a9776` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:04.200836 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004c66c-2a68-487b-bb44-4209a1b1a8df admin admin] RBAC: Authorizing `identity:delete_user(user_id=c205c6af37ca4cbb88cd35e7229a9776)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:04.202926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004c66c-2a68-487b-bb44-4209a1b1a8df admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:04.232313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:04.266141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b004c66c-2a68-487b-bb44-4209a1b1a8df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c205c6af37ca4cbb88cd35e7229a9776'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:04.275034 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b004c66c-2a68-487b-bb44-4209a1b1a8df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c205c6af37ca4cbb88cd35e7229a9776'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:04.275876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b004c66c-2a68-487b-bb44-4209a1b1a8df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c205c6af37ca4cbb88cd35e7229a9776'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:04.289748 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b004c66c-2a68-487b-bb44-4209a1b1a8df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c205c6af37ca4cbb88cd35e7229a9776'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:04.296781 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b004c66c-2a68-487b-bb44-4209a1b1a8df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c205c6af37ca4cbb88cd35e7229a9776'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:04.303320 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1088/2189] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:19:04 2022] DELETE /identity/v3/users/c205c6af37ca4cbb88cd35e7229a9776 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:04.753449 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d033cc4-ade7-4f68-80f9-c175a1b61af5 service placement] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:04.755721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6d033cc4-ade7-4f68-80f9-c175a1b61af5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:04.770465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004c66c-2a68-487b-bb44-4209a1b1a8df admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:04.772415 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b004c66c-2a68-487b-bb44-4209a1b1a8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:04.797890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d033cc4-ade7-4f68-80f9-c175a1b61af5 service placement] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:04.870845 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:04.884939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004c66c-2a68-487b-bb44-4209a1b1a8df admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:04.901510 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3eb77-3d50-4a27-8a11-a18cd5aadc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:04.902408 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3eb77-3d50-4a27-8a11-a18cd5aadc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:04.903041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3eb77-3d50-4a27-8a11-a18cd5aadc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:04.903329 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3eb77-3d50-4a27-8a11-a18cd5aadc6a admin admin] PATH_INFO: `/v3/projects/405181eb72ae40faaa08de93cd366941` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:04.905555 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3eb77-3d50-4a27-8a11-a18cd5aadc6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=405181eb72ae40faaa08de93cd366941)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:04.907693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3eb77-3d50-4a27-8a11-a18cd5aadc6a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:04.957600 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10cc07-6d25-4be9-bb0f-5a34f1b7c0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:04.958721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10cc07-6d25-4be9-bb0f-5a34f1b7c0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:04.959167 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10cc07-6d25-4be9-bb0f-5a34f1b7c0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:04.969650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10cc07-6d25-4be9-bb0f-5a34f1b7c0af admin admin] PATH_INFO: `/v3/projects/5bf07ec14e6548c2b67b173de788a8db` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:04.971764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10cc07-6d25-4be9-bb0f-5a34f1b7c0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf07ec14e6548c2b67b173de788a8db)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:04.973858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10cc07-6d25-4be9-bb0f-5a34f1b7c0af admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:05.033871 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d2f3eb77-3d50-4a27-8a11-a18cd5aadc6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405181eb72ae40faaa08de93cd366941', 'request_id': 'req-d2f3eb77-3d50-4a27-8a11-a18cd5aadc6a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:05.038698 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1b10cc07-6d25-4be9-bb0f-5a34f1b7c0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf07ec14e6548c2b67b173de788a8db', 'request_id': 'req-1b10cc07-6d25-4be9-bb0f-5a34f1b7c0af'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:05.044931 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d2f3eb77-3d50-4a27-8a11-a18cd5aadc6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405181eb72ae40faaa08de93cd366941', 'request_id': 'req-d2f3eb77-3d50-4a27-8a11-a18cd5aadc6a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:05.049181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1b10cc07-6d25-4be9-bb0f-5a34f1b7c0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf07ec14e6548c2b67b173de788a8db', 'request_id': 'req-1b10cc07-6d25-4be9-bb0f-5a34f1b7c0af'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:05.054463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d2f3eb77-3d50-4a27-8a11-a18cd5aadc6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405181eb72ae40faaa08de93cd366941', 'request_id': 'req-d2f3eb77-3d50-4a27-8a11-a18cd5aadc6a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:05.062315 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1b10cc07-6d25-4be9-bb0f-5a34f1b7c0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf07ec14e6548c2b67b173de788a8db', 'request_id': 'req-1b10cc07-6d25-4be9-bb0f-5a34f1b7c0af'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:05.076416 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d2f3eb77-3d50-4a27-8a11-a18cd5aadc6a admin admin] The token cache is being invalidate because project 405181eb72ae40faaa08de93cd366941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:19:05.076785 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d2f3eb77-3d50-4a27-8a11-a18cd5aadc6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:05.081133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d2f3eb77-3d50-4a27-8a11-a18cd5aadc6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:05.084262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1089/2190] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:19:04 2022] DELETE /identity/v3/projects/405181eb72ae40faaa08de93cd366941 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:05.089269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359031e4-a5c9-4a47-8fc6-33db1efc5569 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.090018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359031e4-a5c9-4a47-8fc6-33db1efc5569 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.090448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1b10cc07-6d25-4be9-bb0f-5a34f1b7c0af admin admin] The token cache is being invalidate because project 5bf07ec14e6548c2b67b173de788a8db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:19:05.090733 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359031e4-a5c9-4a47-8fc6-33db1efc5569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.090893 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1b10cc07-6d25-4be9-bb0f-5a34f1b7c0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:05.091856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1b10cc07-6d25-4be9-bb0f-5a34f1b7c0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:05.093950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1102/2191] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:19:04 2022] DELETE /identity/v3/projects/5bf07ec14e6548c2b67b173de788a8db => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:05.101435 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfa91e-cfbd-4982-a484-189a0aa42bc9 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.101785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfa91e-cfbd-4982-a484-189a0aa42bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.102230 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfa91e-cfbd-4982-a484-189a0aa42bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.113467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-359031e4-a5c9-4a47-8fc6-33db1efc5569 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:05.114957 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-359031e4-a5c9-4a47-8fc6-33db1efc5569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:05.139286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-55cfa91e-cfbd-4982-a484-189a0aa42bc9 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:05.141051 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-55cfa91e-cfbd-4982-a484-189a0aa42bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:05.157181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:05.201959 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1090/2192] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:19:05.211575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609be06-80f5-4519-94b8-caa1c192af8c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.211986 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609be06-80f5-4519-94b8-caa1c192af8c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.212286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609be06-80f5-4519-94b8-caa1c192af8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.218076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1103/2193] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:19:05.225688 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47221bf-ece8-46e8-91b8-874c014810f4 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.225979 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47221bf-ece8-46e8-91b8-874c014810f4 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.226263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47221bf-ece8-46e8-91b8-874c014810f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.233105 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e609be06-80f5-4519-94b8-caa1c192af8c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:05.235352 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e609be06-80f5-4519-94b8-caa1c192af8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:05.246891 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-f47221bf-ece8-46e8-91b8-874c014810f4 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:05.247275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1091/2194] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:19:05.248417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f47221bf-ece8-46e8-91b8-874c014810f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:05.251626 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609be06-80f5-4519-94b8-caa1c192af8c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:05.256885 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1104/2195] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:19:05.260746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47221bf-ece8-46e8-91b8-874c014810f4 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:05.270795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47221bf-ece8-46e8-91b8-874c014810f4 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:05.271838 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609be06-80f5-4519-94b8-caa1c192af8c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:05.276652 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e56acc-57b5-4d49-b13b-be84b51e871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:05.277365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e56acc-57b5-4d49-b13b-be84b51e871d admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.277739 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e56acc-57b5-4d49-b13b-be84b51e871d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.278036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e56acc-57b5-4d49-b13b-be84b51e871d admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.278813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e56acc-57b5-4d49-b13b-be84b51e871d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:19:05.279124 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e56acc-57b5-4d49-b13b-be84b51e871d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:05.280692 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8fbf9-89bb-4ada-a9d9-6eafb423583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:05.280834 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e56acc-57b5-4d49-b13b-be84b51e871d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:05.281797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8fbf9-89bb-4ada-a9d9-6eafb423583c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.283659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8fbf9-89bb-4ada-a9d9-6eafb423583c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.283942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8fbf9-89bb-4ada-a9d9-6eafb423583c admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.285956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8fbf9-89bb-4ada-a9d9-6eafb423583c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:19:05.286249 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8fbf9-89bb-4ada-a9d9-6eafb423583c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:05.290647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8fbf9-89bb-4ada-a9d9-6eafb423583c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:05.295144 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1105/2196] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:19:05.300243 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e56acc-57b5-4d49-b13b-be84b51e871d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:05.305751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1092/2197] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:19:05.310256 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8fbf9-89bb-4ada-a9d9-6eafb423583c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:05.315237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e56acc-57b5-4d49-b13b-be84b51e871d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:05.320341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be1c05-5e50-4d22-ad1e-4ea4db8fbb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:05.321102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be1c05-5e50-4d22-ad1e-4ea4db8fbb6f admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.321459 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be1c05-5e50-4d22-ad1e-4ea4db8fbb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.321816 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be1c05-5e50-4d22-ad1e-4ea4db8fbb6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.321913 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8fbf9-89bb-4ada-a9d9-6eafb423583c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:05.322621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be1c05-5e50-4d22-ad1e-4ea4db8fbb6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:05.324651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be1c05-5e50-4d22-ad1e-4ea4db8fbb6f admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:05.327720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955b483-5b23-4f6d-be16-0a9fb42f84fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:05.328377 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b483-5b23-4f6d-be16-0a9fb42f84fd admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.328657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b483-5b23-4f6d-be16-0a9fb42f84fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.328927 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b483-5b23-4f6d-be16-0a9fb42f84fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.330059 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955b483-5b23-4f6d-be16-0a9fb42f84fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:05.332754 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955b483-5b23-4f6d-be16-0a9fb42f84fd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:05.367010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1106/2198] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:19:05 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:05.368048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be1c05-5e50-4d22-ad1e-4ea4db8fbb6f admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:05.369324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1093/2199] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:19:05 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:05.374126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955b483-5b23-4f6d-be16-0a9fb42f84fd admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:05.391503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:05.446044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be1c05-5e50-4d22-ad1e-4ea4db8fbb6f admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:05.453035 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c66c7-77ea-4d00-a1a5-99bfa6f64b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:05.454648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c66c7-77ea-4d00-a1a5-99bfa6f64b12 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.454942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c66c7-77ea-4d00-a1a5-99bfa6f64b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.455228 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c66c7-77ea-4d00-a1a5-99bfa6f64b12 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.455739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955b483-5b23-4f6d-be16-0a9fb42f84fd admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:05.455933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c66c7-77ea-4d00-a1a5-99bfa6f64b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:05.458155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c66c7-77ea-4d00-a1a5-99bfa6f64b12 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:05.462949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386275c9-df90-4a1e-a3f6-b472f5335f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:05.464973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386275c9-df90-4a1e-a3f6-b472f5335f18 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.465502 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386275c9-df90-4a1e-a3f6-b472f5335f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.465945 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386275c9-df90-4a1e-a3f6-b472f5335f18 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.466854 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386275c9-df90-4a1e-a3f6-b472f5335f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:05.468954 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386275c9-df90-4a1e-a3f6-b472f5335f18 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:05.491089 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1107/2200] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:19:05 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:05.495584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c66c7-77ea-4d00-a1a5-99bfa6f64b12 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:05.502918 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1094/2201] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:19:05 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:05.505474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386275c9-df90-4a1e-a3f6-b472f5335f18 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:05.516404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c66c7-77ea-4d00-a1a5-99bfa6f64b12 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:05.520820 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386275c9-df90-4a1e-a3f6-b472f5335f18 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:05.527165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b278e-a7f6-4346-8ea8-31f84cce175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:05.528400 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b278e-a7f6-4346-8ea8-31f84cce175d admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.528694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34810b7a-3f2a-48cf-9ba5-d7997d8467b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:05.528818 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b278e-a7f6-4346-8ea8-31f84cce175d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.528992 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b278e-a7f6-4346-8ea8-31f84cce175d admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.529573 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34810b7a-3f2a-48cf-9ba5-d7997d8467b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.529914 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b278e-a7f6-4346-8ea8-31f84cce175d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:05.530056 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34810b7a-3f2a-48cf-9ba5-d7997d8467b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.530232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34810b7a-3f2a-48cf-9ba5-d7997d8467b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.531231 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34810b7a-3f2a-48cf-9ba5-d7997d8467b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:05.532920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34810b7a-3f2a-48cf-9ba5-d7997d8467b1 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:05.544111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b278e-a7f6-4346-8ea8-31f84cce175d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:05.546042 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1108/2202] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:05.550116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34810b7a-3f2a-48cf-9ba5-d7997d8467b1 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:05.559498 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1095/2203] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:05.561377 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34810b7a-3f2a-48cf-9ba5-d7997d8467b1 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:05.563547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b278e-a7f6-4346-8ea8-31f84cce175d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:05.566813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed1377-7d9c-45ee-96dd-7f7aa8de1c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:05.567498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed1377-7d9c-45ee-96dd-7f7aa8de1c37 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.567784 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed1377-7d9c-45ee-96dd-7f7aa8de1c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.568191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed1377-7d9c-45ee-96dd-7f7aa8de1c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.568781 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed1377-7d9c-45ee-96dd-7f7aa8de1c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:05.571333 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed1377-7d9c-45ee-96dd-7f7aa8de1c37 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:05.580181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b278e-a7f6-4346-8ea8-31f84cce175d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:05.590783 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1109/2204] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:19:05.591090 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15b6dc-f6c3-4fdb-9c7e-c02912d37a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:05.591730 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed1377-7d9c-45ee-96dd-7f7aa8de1c37 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:05.591916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15b6dc-f6c3-4fdb-9c7e-c02912d37a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.592315 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15b6dc-f6c3-4fdb-9c7e-c02912d37a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.592598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15b6dc-f6c3-4fdb-9c7e-c02912d37a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.593407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15b6dc-f6c3-4fdb-9c7e-c02912d37a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:05.595257 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15b6dc-f6c3-4fdb-9c7e-c02912d37a6f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:05.603853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed1377-7d9c-45ee-96dd-7f7aa8de1c37 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:05.610569 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1096/2205] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:19:05.613878 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64509e64-2a62-4336-a154-9af5766e0d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:05.614741 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15b6dc-f6c3-4fdb-9c7e-c02912d37a6f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:05.615250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64509e64-2a62-4336-a154-9af5766e0d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.615751 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64509e64-2a62-4336-a154-9af5766e0d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.616177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64509e64-2a62-4336-a154-9af5766e0d7b admin admin] PATH_INFO: `/v3/projects/d3ab5b8368ea459a98a891d3680d8afe/users/7caa4c7290254e358d9e7b0e64c17b0e/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.627640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15b6dc-f6c3-4fdb-9c7e-c02912d37a6f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:05.635512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f049a-f5fb-425d-a92c-20840e9adc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:05.636524 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f049a-f5fb-425d-a92c-20840e9adc2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.636995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f049a-f5fb-425d-a92c-20840e9adc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.637360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64509e64-2a62-4336-a154-9af5766e0d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ab5b8368ea459a98a891d3680d8afe, user_id=7caa4c7290254e358d9e7b0e64c17b0e, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:05.637481 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f049a-f5fb-425d-a92c-20840e9adc2b admin admin] PATH_INFO: `/v3/projects/e1502c1b4a964477a87db6c4812db5ad/users/e1852b1ef9cf4d168d0d1ebd3d65b7be/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.641196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64509e64-2a62-4336-a154-9af5766e0d7b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:05.657009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f049a-f5fb-425d-a92c-20840e9adc2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1502c1b4a964477a87db6c4812db5ad, user_id=e1852b1ef9cf4d168d0d1ebd3d65b7be, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:05.659134 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1110/2206] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:05 2022] PUT /identity/v3/projects/d3ab5b8368ea459a98a891d3680d8afe/users/7caa4c7290254e358d9e7b0e64c17b0e/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:05.661609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f049a-f5fb-425d-a92c-20840e9adc2b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:05.664093 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f39b9-8c78-42f8-b330-303fe6bf5cc8 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.664774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f39b9-8c78-42f8-b330-303fe6bf5cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.665285 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f39b9-8c78-42f8-b330-303fe6bf5cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.682365 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1097/2207] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:05 2022] PUT /identity/v3/projects/e1502c1b4a964477a87db6c4812db5ad/users/e1852b1ef9cf4d168d0d1ebd3d65b7be/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:19:05.684109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31967a-d580-4bd1-9106-7b47996ea57b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.684395 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31967a-d580-4bd1-9106-7b47996ea57b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.684775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31967a-d580-4bd1-9106-7b47996ea57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.685555 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-875f39b9-8c78-42f8-b330-303fe6bf5cc8 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:05.686972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-875f39b9-8c78-42f8-b330-303fe6bf5cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:05.718715 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9b31967a-d580-4bd1-9106-7b47996ea57b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:05.718715 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9b31967a-d580-4bd1-9106-7b47996ea57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:05.757430 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:05.766588 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1111/2208] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:05.777452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f39b9-8c78-42f8-b330-303fe6bf5cc8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:05.788381 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-875f39b9-8c78-42f8-b330-303fe6bf5cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:05.807000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1098/2209] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:05.833632 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31967a-d580-4bd1-9106-7b47996ea57b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:05.835212 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9b31967a-d580-4bd1-9106-7b47996ea57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:05.870717 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f39b9-8c78-42f8-b330-303fe6bf5cc8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:05.887759 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05499b-5339-439a-8863-6f308dd40b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:05.888802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05499b-5339-439a-8863-6f308dd40b06 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.889152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05499b-5339-439a-8863-6f308dd40b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.889437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05499b-5339-439a-8863-6f308dd40b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.899989 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05499b-5339-439a-8863-6f308dd40b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:05.901504 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05499b-5339-439a-8863-6f308dd40b06 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:05.902119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31967a-d580-4bd1-9106-7b47996ea57b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:05.905684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86f046-3122-4af0-b4dc-7c1e929bcf55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:05.906344 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86f046-3122-4af0-b4dc-7c1e929bcf55 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:05.906659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86f046-3122-4af0-b4dc-7c1e929bcf55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:05.906936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86f046-3122-4af0-b4dc-7c1e929bcf55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:05.914315 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1112/2210] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:19:05.927778 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86f046-3122-4af0-b4dc-7c1e929bcf55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:05.929692 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86f046-3122-4af0-b4dc-7c1e929bcf55 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:05.945294 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1099/2211] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:19:13.189730 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1488dd-42f0-4ee1-ae8b-85c20ab3cde5 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:13.190270 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1488dd-42f0-4ee1-ae8b-85c20ab3cde5 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:13.190270 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1488dd-42f0-4ee1-ae8b-85c20ab3cde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:13.223564 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:13.254265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-5a1488dd-42f0-4ee1-ae8b-85c20ab3cde5 None None] MFA Rules not processed for user `7caa4c7290254e358d9e7b0e64c17b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:13.256548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5a1488dd-42f0-4ee1-ae8b-85c20ab3cde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:13.445482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1113/2212] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:13.450057 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86f046-3122-4af0-b4dc-7c1e929bcf55 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:13.462959 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86f046-3122-4af0-b4dc-7c1e929bcf55 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:13.475848 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df0209-0ea8-45a9-9717-9713a5d43232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:13.492453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df0209-0ea8-45a9-9717-9713a5d43232 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:13.496536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df0209-0ea8-45a9-9717-9713a5d43232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:13.496982 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df0209-0ea8-45a9-9717-9713a5d43232 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:13.500723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df0209-0ea8-45a9-9717-9713a5d43232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:13.510455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df0209-0ea8-45a9-9717-9713a5d43232 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:13.562094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1100/2213] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:19:13 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:19:13.566334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1488dd-42f0-4ee1-ae8b-85c20ab3cde5 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:13.587026 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1488dd-42f0-4ee1-ae8b-85c20ab3cde5 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:13.773525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616354f-c73a-4ec3-aec5-ef0d2e901e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:13.774645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616354f-c73a-4ec3-aec5-ef0d2e901e89 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:13.776310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616354f-c73a-4ec3-aec5-ef0d2e901e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:13.779423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616354f-c73a-4ec3-aec5-ef0d2e901e89 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:13.783196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616354f-c73a-4ec3-aec5-ef0d2e901e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:13.791410 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616354f-c73a-4ec3-aec5-ef0d2e901e89 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:13.839361 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1114/2214] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:19:13 2022] POST /identity/v3/users => generated 299 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:19:13.841248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df0209-0ea8-45a9-9717-9713a5d43232 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:13.857719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df0209-0ea8-45a9-9717-9713a5d43232 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:13.876541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a9b1c-c29a-45a1-87e7-27ef943bb675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:13.876541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a9b1c-c29a-45a1-87e7-27ef943bb675 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:13.876541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a9b1c-c29a-45a1-87e7-27ef943bb675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:13.876541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a9b1c-c29a-45a1-87e7-27ef943bb675 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:13.876949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a9b1c-c29a-45a1-87e7-27ef943bb675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:13.876949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a9b1c-c29a-45a1-87e7-27ef943bb675 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:13.902876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1101/2215] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:19:13.907179 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616354f-c73a-4ec3-aec5-ef0d2e901e89 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:13.938016 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616354f-c73a-4ec3-aec5-ef0d2e901e89 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:13.962416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77da452-ca05-48d0-b39b-dd82d8f01df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:13.966666 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77da452-ca05-48d0-b39b-dd82d8f01df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:13.967106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77da452-ca05-48d0-b39b-dd82d8f01df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:13.968089 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77da452-ca05-48d0-b39b-dd82d8f01df5 admin admin] PATH_INFO: `/v3/projects/4cb211f5cdec41cea3e96e36ce8a5925/users/994c7c3d21c6491c85a741ffa29254a8/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:14.002080 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77da452-ca05-48d0-b39b-dd82d8f01df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb211f5cdec41cea3e96e36ce8a5925, user_id=994c7c3d21c6491c85a741ffa29254a8, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:14.005654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77da452-ca05-48d0-b39b-dd82d8f01df5 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:14.040004 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1115/2216] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:13 2022] PUT /identity/v3/projects/4cb211f5cdec41cea3e96e36ce8a5925/users/994c7c3d21c6491c85a741ffa29254a8/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:14.044060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a9b1c-c29a-45a1-87e7-27ef943bb675 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:14.058270 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a9b1c-c29a-45a1-87e7-27ef943bb675 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:14.208474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668145d1-61c4-4cfd-add3-9e801902e548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:14.209162 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668145d1-61c4-4cfd-add3-9e801902e548 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:14.209448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668145d1-61c4-4cfd-add3-9e801902e548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:14.209724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668145d1-61c4-4cfd-add3-9e801902e548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:14.210783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668145d1-61c4-4cfd-add3-9e801902e548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:14.212427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668145d1-61c4-4cfd-add3-9e801902e548 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:14.224892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1102/2217] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:19:14.229069 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77da452-ca05-48d0-b39b-dd82d8f01df5 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:14.254499 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77da452-ca05-48d0-b39b-dd82d8f01df5 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:14.265034 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eba10-98b3-43cb-b2d0-64ae76bf789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:14.267601 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eba10-98b3-43cb-b2d0-64ae76bf789a admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:14.268095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eba10-98b3-43cb-b2d0-64ae76bf789a admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:14.268611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eba10-98b3-43cb-b2d0-64ae76bf789a admin admin] PATH_INFO: `/v3/projects/4cb211f5cdec41cea3e96e36ce8a5925/users/994c7c3d21c6491c85a741ffa29254a8/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:14.272076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854eba10-98b3-43cb-b2d0-64ae76bf789a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb211f5cdec41cea3e96e36ce8a5925, user_id=994c7c3d21c6491c85a741ffa29254a8, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:14.276648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854eba10-98b3-43cb-b2d0-64ae76bf789a admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:14.295973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1116/2218] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:19:14 2022] PUT /identity/v3/projects/4cb211f5cdec41cea3e96e36ce8a5925/users/994c7c3d21c6491c85a741ffa29254a8/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:15.593611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3805ee6-486f-431f-8ad3-24accef2f0c7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:15.594101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3805ee6-486f-431f-8ad3-24accef2f0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:15.594186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3805ee6-486f-431f-8ad3-24accef2f0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:15.651515 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c3805ee6-486f-431f-8ad3-24accef2f0c7 None None] MFA Rules not processed for user `e1852b1ef9cf4d168d0d1ebd3d65b7be`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:15.653740 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c3805ee6-486f-431f-8ad3-24accef2f0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:15.694189 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:15.749941 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1103/2219] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:15.765829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eba10-98b3-43cb-b2d0-64ae76bf789a admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:15.768097 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-854eba10-98b3-43cb-b2d0-64ae76bf789a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:15.875839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:15.914787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eba10-98b3-43cb-b2d0-64ae76bf789a admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:15.932138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cefda-f04f-482b-b673-6a6aea720a53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:15.932138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cefda-f04f-482b-b673-6a6aea720a53 service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:15.932138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cefda-f04f-482b-b673-6a6aea720a53 service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:15.932138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cefda-f04f-482b-b673-6a6aea720a53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:15.942245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cefda-f04f-482b-b673-6a6aea720a53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:15.945345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cefda-f04f-482b-b673-6a6aea720a53 service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:15.956801 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1117/2220] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:19.046868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddc139-54f9-485b-b674-1a62d49a4447 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:19.047456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddc139-54f9-485b-b674-1a62d49a4447 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:19.047456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddc139-54f9-485b-b674-1a62d49a4447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:19.095140 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-48ddc139-54f9-485b-b674-1a62d49a4447 None None] MFA Rules not processed for user `e1852b1ef9cf4d168d0d1ebd3d65b7be`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:19.096383 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-48ddc139-54f9-485b-b674-1a62d49a4447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:19.121679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1104/2221] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:22.053116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0543b15-21b3-44b4-8785-ccfc65e6a39b None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:22.053760 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0543b15-21b3-44b4-8785-ccfc65e6a39b None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:22.054108 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0543b15-21b3-44b4-8785-ccfc65e6a39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:22.098339 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-d0543b15-21b3-44b4-8785-ccfc65e6a39b None None] MFA Rules not processed for user `994c7c3d21c6491c85a741ffa29254a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:22.099757 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d0543b15-21b3-44b4-8785-ccfc65e6a39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:22.184890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1118/2222] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:22.197638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddc139-54f9-485b-b674-1a62d49a4447 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:22.199319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-48ddc139-54f9-485b-b674-1a62d49a4447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:22.303843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddc139-54f9-485b-b674-1a62d49a4447 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:22.307543 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02cf83-658c-48a3-9e3f-4fa73f91d186 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '927543219de847b88b97fbe4f343d2be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:22.308203 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02cf83-658c-48a3-9e3f-4fa73f91d186 service glance] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:22.308528 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02cf83-658c-48a3-9e3f-4fa73f91d186 service glance] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:22.308805 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02cf83-658c-48a3-9e3f-4fa73f91d186 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:22.381145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02cf83-658c-48a3-9e3f-4fa73f91d186 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:22.382778 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02cf83-658c-48a3-9e3f-4fa73f91d186 service glance] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:22.401640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1105/2223] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:22.573874 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff842a9-7732-42cf-9096-521d4cc052ca None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:22.574258 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff842a9-7732-42cf-9096-521d4cc052ca None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:22.574652 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff842a9-7732-42cf-9096-521d4cc052ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:22.596842 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-5ff842a9-7732-42cf-9096-521d4cc052ca None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:22.598196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5ff842a9-7732-42cf-9096-521d4cc052ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:22.668150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1119/2224] 10.222.0.99 () {58 vars in 1009 bytes} [Mon Jul 18 14:19:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:22.715185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02cf83-658c-48a3-9e3f-4fa73f91d186 service glance] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:22.716709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7f02cf83-658c-48a3-9e3f-4fa73f91d186 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:22.791340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:22.813775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02cf83-658c-48a3-9e3f-4fa73f91d186 service glance] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:22.837274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17bb1e-3c49-41aa-9cd0-53dfe4f94b48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:22.838136 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17bb1e-3c49-41aa-9cd0-53dfe4f94b48 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:22.838585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17bb1e-3c49-41aa-9cd0-53dfe4f94b48 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:22.839000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17bb1e-3c49-41aa-9cd0-53dfe4f94b48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:22.861267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17bb1e-3c49-41aa-9cd0-53dfe4f94b48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:22.863277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17bb1e-3c49-41aa-9cd0-53dfe4f94b48 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:22.877513 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1106/2225] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:19:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:30.033885 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a484d0-3367-4ca6-9438-1e30e0710e74 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:30.034437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a484d0-3367-4ca6-9438-1e30e0710e74 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:30.034631 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a484d0-3367-4ca6-9438-1e30e0710e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:30.082532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-51a484d0-3367-4ca6-9438-1e30e0710e74 None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:30.083840 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-51a484d0-3367-4ca6-9438-1e30e0710e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:30.118812 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1120/2226] 10.222.0.99 () {58 vars in 1009 bytes} [Mon Jul 18 14:19:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:30.147209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17bb1e-3c49-41aa-9cd0-53dfe4f94b48 service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:30.160680 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17bb1e-3c49-41aa-9cd0-53dfe4f94b48 service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:30.173485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988e676-9107-4350-bd53-82c6f0e9a678 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:30.175106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988e676-9107-4350-bd53-82c6f0e9a678 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:30.176293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988e676-9107-4350-bd53-82c6f0e9a678 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:30.177407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988e676-9107-4350-bd53-82c6f0e9a678 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:30.210950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988e676-9107-4350-bd53-82c6f0e9a678 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:30.212591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988e676-9107-4350-bd53-82c6f0e9a678 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:30.242919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1107/2227] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:19:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:31.578014 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39ee1c-a9ae-44c8-825a-9bcb3e6cf7ce None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:31.579045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39ee1c-a9ae-44c8-825a-9bcb3e6cf7ce None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:31.579536 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39ee1c-a9ae-44c8-825a-9bcb3e6cf7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:31.621018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-4b39ee1c-a9ae-44c8-825a-9bcb3e6cf7ce None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:31.623224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-4b39ee1c-a9ae-44c8-825a-9bcb3e6cf7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:31.642895 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1121/2228] 10.222.0.99 () {58 vars in 967 bytes} [Mon Jul 18 14:19:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:31.669929 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988e676-9107-4350-bd53-82c6f0e9a678 service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:31.689386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988e676-9107-4350-bd53-82c6f0e9a678 service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:31.698119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a7c35-0e1a-4148-b945-b72526391509 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:31.699045 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a7c35-0e1a-4148-b945-b72526391509 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:31.703019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a7c35-0e1a-4148-b945-b72526391509 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:31.709065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a7c35-0e1a-4148-b945-b72526391509 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:31.755523 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a7c35-0e1a-4148-b945-b72526391509 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:31.759041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a7c35-0e1a-4148-b945-b72526391509 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:31.789908 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1108/2229] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:19:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:32.201634 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796ce08-12cc-475e-8c94-e8e1449b21dd None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:32.202225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796ce08-12cc-475e-8c94-e8e1449b21dd None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:32.202854 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796ce08-12cc-475e-8c94-e8e1449b21dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:32.240647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-5796ce08-12cc-475e-8c94-e8e1449b21dd None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:32.242253 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5796ce08-12cc-475e-8c94-e8e1449b21dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:32.270473 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1122/2230] 10.222.0.99 () {58 vars in 1009 bytes} [Mon Jul 18 14:19:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:32.292856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a7c35-0e1a-4148-b945-b72526391509 service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:32.304612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a7c35-0e1a-4148-b945-b72526391509 service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:32.317993 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd331ea-9675-4b02-98a1-4a2a976845d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:32.318696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd331ea-9675-4b02-98a1-4a2a976845d5 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:32.318976 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd331ea-9675-4b02-98a1-4a2a976845d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:32.319257 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd331ea-9675-4b02-98a1-4a2a976845d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:32.339036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd331ea-9675-4b02-98a1-4a2a976845d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:32.340891 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd331ea-9675-4b02-98a1-4a2a976845d5 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:32.351349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1109/2231] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:19:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:33.067470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d637be-3c41-4d71-871b-ba9a3bd43ef2 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:33.068355 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d637be-3c41-4d71-871b-ba9a3bd43ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:33.068690 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d637be-3c41-4d71-871b-ba9a3bd43ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:33.098014 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-b2d637be-3c41-4d71-871b-ba9a3bd43ef2 None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:33.099341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b2d637be-3c41-4d71-871b-ba9a3bd43ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:33.107292 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1123/2232] 10.222.0.99 () {58 vars in 967 bytes} [Mon Jul 18 14:19:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:33.125914 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd331ea-9675-4b02-98a1-4a2a976845d5 service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:33.137068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd331ea-9675-4b02-98a1-4a2a976845d5 service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:33.148479 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64c924-78e7-4461-8424-c4a6699d4cbc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:33.149433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64c924-78e7-4461-8424-c4a6699d4cbc service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:33.153283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64c924-78e7-4461-8424-c4a6699d4cbc service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:33.153853 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64c924-78e7-4461-8424-c4a6699d4cbc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:33.165392 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64c924-78e7-4461-8424-c4a6699d4cbc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:33.167179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64c924-78e7-4461-8424-c4a6699d4cbc service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:33.178894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1110/2233] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:19:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:35.574163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d637be-3c41-4d71-871b-ba9a3bd43ef2 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:35.575722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b2d637be-3c41-4d71-871b-ba9a3bd43ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:35.623207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:35.654956 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d637be-3c41-4d71-871b-ba9a3bd43ef2 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:35.660366 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690009c-cbae-4e54-9f3a-6e3a627b0f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:35.661272 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690009c-cbae-4e54-9f3a-6e3a627b0f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:35.661544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690009c-cbae-4e54-9f3a-6e3a627b0f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:35.661818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690009c-cbae-4e54-9f3a-6e3a627b0f7b admin admin] PATH_INFO: `/v3/users/f98083f9b65449d1b5b83fcbe01e782f` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:35.663087 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690009c-cbae-4e54-9f3a-6e3a627b0f7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98083f9b65449d1b5b83fcbe01e782f)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:35.665071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690009c-cbae-4e54-9f3a-6e3a627b0f7b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:35.750773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2690009c-cbae-4e54-9f3a-6e3a627b0f7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98083f9b65449d1b5b83fcbe01e782f'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:35.760433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2690009c-cbae-4e54-9f3a-6e3a627b0f7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98083f9b65449d1b5b83fcbe01e782f'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:35.761205 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2690009c-cbae-4e54-9f3a-6e3a627b0f7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98083f9b65449d1b5b83fcbe01e782f'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:35.779686 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2690009c-cbae-4e54-9f3a-6e3a627b0f7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98083f9b65449d1b5b83fcbe01e782f'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:35.786872 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2690009c-cbae-4e54-9f3a-6e3a627b0f7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98083f9b65449d1b5b83fcbe01e782f'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:35.794585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1124/2234] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:19:35 2022] DELETE /identity/v3/users/f98083f9b65449d1b5b83fcbe01e782f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:19:35.800011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614962e-9c5d-4c42-856c-5ce4e6cfc11d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:35.800588 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614962e-9c5d-4c42-856c-5ce4e6cfc11d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:35.800981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614962e-9c5d-4c42-856c-5ce4e6cfc11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:35.836747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3614962e-9c5d-4c42-856c-5ce4e6cfc11d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:35.838221 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3614962e-9c5d-4c42-856c-5ce4e6cfc11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:35.883708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b652-5b32-4a82-874c-b56615787ad8 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:35.883989 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b652-5b32-4a82-874c-b56615787ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:35.884271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b652-5b32-4a82-874c-b56615787ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:35.911742 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-8064b652-5b32-4a82-874c-b56615787ad8 None None] MFA Rules not processed for user `7caa4c7290254e358d9e7b0e64c17b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:35.913242 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8064b652-5b32-4a82-874c-b56615787ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:35.933834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1111/2235] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:35.945993 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614962e-9c5d-4c42-856c-5ce4e6cfc11d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:35.947915 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3614962e-9c5d-4c42-856c-5ce4e6cfc11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:35.972681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1125/2236] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:19:36.007489 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614962e-9c5d-4c42-856c-5ce4e6cfc11d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:36.011500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65795b-38a6-4bcd-8e4a-68834aca099d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:36.012163 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65795b-38a6-4bcd-8e4a-68834aca099d service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:36.012452 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65795b-38a6-4bcd-8e4a-68834aca099d service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:36.012717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65795b-38a6-4bcd-8e4a-68834aca099d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:36.023641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65795b-38a6-4bcd-8e4a-68834aca099d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:36.025095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65795b-38a6-4bcd-8e4a-68834aca099d service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:36.036483 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1112/2237] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:19:36.376376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064b652-5b32-4a82-874c-b56615787ad8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:36.377905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8064b652-5b32-4a82-874c-b56615787ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:36.413407 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064b652-5b32-4a82-874c-b56615787ad8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:36.420890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17520f-6d0d-4c3e-ba4b-3c8e52eef1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:36.421847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17520f-6d0d-4c3e-ba4b-3c8e52eef1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:36.422188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17520f-6d0d-4c3e-ba4b-3c8e52eef1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:36.422564 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17520f-6d0d-4c3e-ba4b-3c8e52eef1b3 admin admin] PATH_INFO: `/v3/projects/9c623c6a932940e9a852f84bc270e84b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:36.423822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17520f-6d0d-4c3e-ba4b-3c8e52eef1b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c623c6a932940e9a852f84bc270e84b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:36.425877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17520f-6d0d-4c3e-ba4b-3c8e52eef1b3 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:36.476922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fb17520f-6d0d-4c3e-ba4b-3c8e52eef1b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c623c6a932940e9a852f84bc270e84b', 'request_id': 'req-fb17520f-6d0d-4c3e-ba4b-3c8e52eef1b3'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:36.482625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:36.484526 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fb17520f-6d0d-4c3e-ba4b-3c8e52eef1b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c623c6a932940e9a852f84bc270e84b', 'request_id': 'req-fb17520f-6d0d-4c3e-ba4b-3c8e52eef1b3'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:36.493629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fb17520f-6d0d-4c3e-ba4b-3c8e52eef1b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c623c6a932940e9a852f84bc270e84b', 'request_id': 'req-fb17520f-6d0d-4c3e-ba4b-3c8e52eef1b3'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:36.508018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fb17520f-6d0d-4c3e-ba4b-3c8e52eef1b3 admin admin] The token cache is being invalidate because project 9c623c6a932940e9a852f84bc270e84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:19:36.508337 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fb17520f-6d0d-4c3e-ba4b-3c8e52eef1b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:36.508935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fb17520f-6d0d-4c3e-ba4b-3c8e52eef1b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:19:36.510893 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1126/2238] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:19:36 2022] DELETE /identity/v3/projects/9c623c6a932940e9a852f84bc270e84b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:19:37.009024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ae58-4257-487a-962f-844c61993551 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:37.009511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ae58-4257-487a-962f-844c61993551 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:37.009614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ae58-4257-487a-962f-844c61993551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:37.028327 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-eec5ae58-4257-487a-962f-844c61993551 None None] MFA Rules not processed for user `51e8b1bf96714ef7ad34ee3d8dd194a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:37.029561 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-eec5ae58-4257-487a-962f-844c61993551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:37.069704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:37.093011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1113/2239] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:19:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:38.827583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93b716-cd43-4b10-9a05-32d605b355cf None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:38.828086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93b716-cd43-4b10-9a05-32d605b355cf None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:38.828309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93b716-cd43-4b10-9a05-32d605b355cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:38.849470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-3f93b716-cd43-4b10-9a05-32d605b355cf None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:19:38.851282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3f93b716-cd43-4b10-9a05-32d605b355cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:38.919144 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1127/2240] 10.222.0.99 () {58 vars in 1009 bytes} [Mon Jul 18 14:19:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:19:38.933982 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ae58-4257-487a-962f-844c61993551 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:19:38.935270 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-eec5ae58-4257-487a-962f-844c61993551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:19:39.017113 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ae58-4257-487a-962f-844c61993551 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:19:39.023462 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfb024-6e35-4be2-9b2a-8f7461455255 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:19:39.023653 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfb024-6e35-4be2-9b2a-8f7461455255 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:19:39.023881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfb024-6e35-4be2-9b2a-8f7461455255 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:19:39.024384 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfb024-6e35-4be2-9b2a-8f7461455255 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:19:39.033275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfb024-6e35-4be2-9b2a-8f7461455255 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:19:39.035242 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfb024-6e35-4be2-9b2a-8f7461455255 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:19:39.043691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1114/2241] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:19:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:48.909076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=30,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:49.040114 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=40 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:13.867316 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb644900-0628-4328-815a-07e78f2ecd28 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:13.867801 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb644900-0628-4328-815a-07e78f2ecd28 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:13.867896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb644900-0628-4328-815a-07e78f2ecd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:13.886072 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-bb644900-0628-4328-815a-07e78f2ecd28 None None] MFA Rules not processed for user `c8a38997f7094d019157ab969487da12`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:20:13.887331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-bb644900-0628-4328-815a-07e78f2ecd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:13.945068 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1128/2242] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:20:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:20:19.084616 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfb024-6e35-4be2-9b2a-8f7461455255 service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:19.086116 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-32cfb024-6e35-4be2-9b2a-8f7461455255 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:19.153254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfb024-6e35-4be2-9b2a-8f7461455255 service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:19.157004 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd38c1-cfa7-47c0-8e25-1ee73398418a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:19.157729 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd38c1-cfa7-47c0-8e25-1ee73398418a service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:19.158080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd38c1-cfa7-47c0-8e25-1ee73398418a service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:19.158517 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd38c1-cfa7-47c0-8e25-1ee73398418a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:19.160465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1bfd38c1-cfa7-47c0-8e25-1ee73398418a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:19.234176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd38c1-cfa7-47c0-8e25-1ee73398418a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:19.235670 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd38c1-cfa7-47c0-8e25-1ee73398418a service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:19.246138 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1115/2243] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:20:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:20:22.490765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3042b2-41f5-423d-b9ca-3c2cda253e07 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:22.492856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3042b2-41f5-423d-b9ca-3c2cda253e07 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:22.492856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3042b2-41f5-423d-b9ca-3c2cda253e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:22.510475 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-1c3042b2-41f5-423d-b9ca-3c2cda253e07 None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:20:22.511775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1c3042b2-41f5-423d-b9ca-3c2cda253e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:22.519051 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1129/2244] 10.222.0.99 () {58 vars in 1009 bytes} [Mon Jul 18 14:20:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:20:22.542921 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd38c1-cfa7-47c0-8e25-1ee73398418a service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:22.559286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd38c1-cfa7-47c0-8e25-1ee73398418a service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:22.564442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576b61b-b138-46e8-8437-ed5a9a263592 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:22.565265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576b61b-b138-46e8-8437-ed5a9a263592 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:22.565609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576b61b-b138-46e8-8437-ed5a9a263592 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:22.565966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576b61b-b138-46e8-8437-ed5a9a263592 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:22.574883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576b61b-b138-46e8-8437-ed5a9a263592 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:22.576556 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576b61b-b138-46e8-8437-ed5a9a263592 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:22.584791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1116/2245] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:20:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:20:32.504865 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=28 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:32.583337 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=56 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:36.797135 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e898c-df30-49dd-bcad-227e565c0a8d None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:36.798185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e898c-df30-49dd-bcad-227e565c0a8d None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:36.798770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e898c-df30-49dd-bcad-227e565c0a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:36.821473 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-d13e898c-df30-49dd-bcad-227e565c0a8d None None] MFA Rules not processed for user `a19eb1f3c9e74f3c92755186a7a44ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:20:36.823516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d13e898c-df30-49dd-bcad-227e565c0a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:36.902244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1130/2246] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:20:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:20:39.997774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14360823-be0a-4fa8-8ca2-3e09f2f6a779 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:39.998417 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14360823-be0a-4fa8-8ca2-3e09f2f6a779 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:39.998417 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14360823-be0a-4fa8-8ca2-3e09f2f6a779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:40.017138 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-14360823-be0a-4fa8-8ca2-3e09f2f6a779 None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:20:40.018351 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-14360823-be0a-4fa8-8ca2-3e09f2f6a779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:40.025952 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1117/2247] 10.222.0.99 () {58 vars in 967 bytes} [Mon Jul 18 14:20:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:20:40.038716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e898c-df30-49dd-bcad-227e565c0a8d None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:40.051633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e898c-df30-49dd-bcad-227e565c0a8d None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:40.057752 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af98f4-b914-4efd-bcb5-52ae9edd50cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:40.058521 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af98f4-b914-4efd-bcb5-52ae9edd50cf service swift] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:40.058772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af98f4-b914-4efd-bcb5-52ae9edd50cf service swift] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:40.058991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af98f4-b914-4efd-bcb5-52ae9edd50cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:40.069205 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af98f4-b914-4efd-bcb5-52ae9edd50cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:40.070859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af98f4-b914-4efd-bcb5-52ae9edd50cf service swift] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:40.079429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1131/2248] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:20:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:20:42.322915 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14360823-be0a-4fa8-8ca2-3e09f2f6a779 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:42.324382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-14360823-be0a-4fa8-8ca2-3e09f2f6a779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:42.408689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14360823-be0a-4fa8-8ca2-3e09f2f6a779 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:42.414146 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2606c4d-3e1b-4d90-bc1f-a69914f08ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:42.414888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2606c4d-3e1b-4d90-bc1f-a69914f08ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:42.415176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2606c4d-3e1b-4d90-bc1f-a69914f08ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:42.417505 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2606c4d-3e1b-4d90-bc1f-a69914f08ad6 admin admin] PATH_INFO: `/v3/users/51e8b1bf96714ef7ad34ee3d8dd194a6` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:42.419071 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2606c4d-3e1b-4d90-bc1f-a69914f08ad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e8b1bf96714ef7ad34ee3d8dd194a6)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:42.421081 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2606c4d-3e1b-4d90-bc1f-a69914f08ad6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:42.503022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a2606c4d-3e1b-4d90-bc1f-a69914f08ad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e8b1bf96714ef7ad34ee3d8dd194a6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:42.513421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a2606c4d-3e1b-4d90-bc1f-a69914f08ad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e8b1bf96714ef7ad34ee3d8dd194a6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:42.514225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a2606c4d-3e1b-4d90-bc1f-a69914f08ad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e8b1bf96714ef7ad34ee3d8dd194a6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:42.530551 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a2606c4d-3e1b-4d90-bc1f-a69914f08ad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e8b1bf96714ef7ad34ee3d8dd194a6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:42.539403 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a2606c4d-3e1b-4d90-bc1f-a69914f08ad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e8b1bf96714ef7ad34ee3d8dd194a6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:42.546193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1118/2249] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:20:42 2022] DELETE /identity/v3/users/51e8b1bf96714ef7ad34ee3d8dd194a6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:20:42.753772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af98f4-b914-4efd-bcb5-52ae9edd50cf service swift] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:42.765405 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af98f4-b914-4efd-bcb5-52ae9edd50cf service swift] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:42.829086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d36ec4-126e-4a72-9ed1-658ae9ab74c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:42.829559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d36ec4-126e-4a72-9ed1-658ae9ab74c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:42.829908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d36ec4-126e-4a72-9ed1-658ae9ab74c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:42.830404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d36ec4-126e-4a72-9ed1-658ae9ab74c5 admin admin] PATH_INFO: `/v3/projects/3efef144fcbc4874b237a94949111175` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:42.831776 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d36ec4-126e-4a72-9ed1-658ae9ab74c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3efef144fcbc4874b237a94949111175)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:42.833867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d36ec4-126e-4a72-9ed1-658ae9ab74c5 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:42.885241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e4d36ec4-126e-4a72-9ed1-658ae9ab74c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3efef144fcbc4874b237a94949111175', 'request_id': 'req-e4d36ec4-126e-4a72-9ed1-658ae9ab74c5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:42.891999 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e4d36ec4-126e-4a72-9ed1-658ae9ab74c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3efef144fcbc4874b237a94949111175', 'request_id': 'req-e4d36ec4-126e-4a72-9ed1-658ae9ab74c5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:42.898235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e4d36ec4-126e-4a72-9ed1-658ae9ab74c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3efef144fcbc4874b237a94949111175', 'request_id': 'req-e4d36ec4-126e-4a72-9ed1-658ae9ab74c5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:42.911382 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e4d36ec4-126e-4a72-9ed1-658ae9ab74c5 admin admin] The token cache is being invalidate because project 3efef144fcbc4874b237a94949111175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:20:42.911655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e4d36ec4-126e-4a72-9ed1-658ae9ab74c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:42.912279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e4d36ec4-126e-4a72-9ed1-658ae9ab74c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:20:42.913833 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1132/2250] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:20:42 2022] DELETE /identity/v3/projects/3efef144fcbc4874b237a94949111175 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:20:42.918850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5c8a5-2c8c-4979-bc84-768f78b168b7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:42.919134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5c8a5-2c8c-4979-bc84-768f78b168b7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:42.919409 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5c8a5-2c8c-4979-bc84-768f78b168b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:42.939029 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a0e5c8a5-2c8c-4979-bc84-768f78b168b7 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:20:42.940244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a0e5c8a5-2c8c-4979-bc84-768f78b168b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:43.010650 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1119/2251] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:20:43.076326 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc0e9a-7fe3-4781-83ae-a41c330c7db7 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:43.076597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc0e9a-7fe3-4781-83ae-a41c330c7db7 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:43.076899 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc0e9a-7fe3-4781-83ae-a41c330c7db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:43.095574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-3bbc0e9a-7fe3-4781-83ae-a41c330c7db7 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:20:43.096790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3bbc0e9a-7fe3-4781-83ae-a41c330c7db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:43.105580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1133/2252] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:20:43.109934 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5c8a5-2c8c-4979-bc84-768f78b168b7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:43.120220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5c8a5-2c8c-4979-bc84-768f78b168b7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:43.125762 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75470a2-8f54-4dc6-8ff3-d4ea87e873a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:43.126463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75470a2-8f54-4dc6-8ff3-d4ea87e873a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:43.126751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75470a2-8f54-4dc6-8ff3-d4ea87e873a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:43.127027 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75470a2-8f54-4dc6-8ff3-d4ea87e873a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:43.127798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75470a2-8f54-4dc6-8ff3-d4ea87e873a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:20:43.128107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75470a2-8f54-4dc6-8ff3-d4ea87e873a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:43.129747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75470a2-8f54-4dc6-8ff3-d4ea87e873a4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:43.139435 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:43.147727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc0e9a-7fe3-4781-83ae-a41c330c7db7 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:43.150720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1120/2253] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:20:43.158723 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc0e9a-7fe3-4781-83ae-a41c330c7db7 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:43.164331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0625c-d1e2-4664-a3e8-21558da64b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:43.165005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0625c-d1e2-4664-a3e8-21558da64b48 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:43.165294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0625c-d1e2-4664-a3e8-21558da64b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:43.165569 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0625c-d1e2-4664-a3e8-21558da64b48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:43.166286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0625c-d1e2-4664-a3e8-21558da64b48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:43.168278 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0625c-d1e2-4664-a3e8-21558da64b48 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:43.184102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:43.202857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1134/2254] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:20:43 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:20:43.207150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75470a2-8f54-4dc6-8ff3-d4ea87e873a4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:43.217299 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75470a2-8f54-4dc6-8ff3-d4ea87e873a4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:43.274112 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a23cb3-7f50-4646-88f8-4f7dbafcadaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:43.274717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a23cb3-7f50-4646-88f8-4f7dbafcadaf admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:43.275046 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a23cb3-7f50-4646-88f8-4f7dbafcadaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:43.275401 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a23cb3-7f50-4646-88f8-4f7dbafcadaf admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:43.276021 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a23cb3-7f50-4646-88f8-4f7dbafcadaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:43.277942 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a23cb3-7f50-4646-88f8-4f7dbafcadaf admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:43.299223 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1121/2255] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:20:43 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:20:43.303428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0625c-d1e2-4664-a3e8-21558da64b48 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:43.315977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0625c-d1e2-4664-a3e8-21558da64b48 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:43.321197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2cd63-4224-4245-ad37-0911b6f3175e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:43.321904 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2cd63-4224-4245-ad37-0911b6f3175e admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:43.322356 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2cd63-4224-4245-ad37-0911b6f3175e admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:43.322668 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2cd63-4224-4245-ad37-0911b6f3175e admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:43.323446 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2cd63-4224-4245-ad37-0911b6f3175e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:43.325038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2cd63-4224-4245-ad37-0911b6f3175e admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:43.339526 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1135/2256] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:20:43.340924 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a23cb3-7f50-4646-88f8-4f7dbafcadaf admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:43.354184 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a23cb3-7f50-4646-88f8-4f7dbafcadaf admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:43.359291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c05d6-ea92-43a1-bb96-4d09ccd849c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:43.359969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c05d6-ea92-43a1-bb96-4d09ccd849c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:43.360253 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c05d6-ea92-43a1-bb96-4d09ccd849c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:43.360550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c05d6-ea92-43a1-bb96-4d09ccd849c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:43.361289 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c05d6-ea92-43a1-bb96-4d09ccd849c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:43.362950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c05d6-ea92-43a1-bb96-4d09ccd849c0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:43.378251 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1122/2257] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:20:43.379422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2cd63-4224-4245-ad37-0911b6f3175e admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:43.390035 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2cd63-4224-4245-ad37-0911b6f3175e admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:43.395685 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030b2d8-5b2a-468f-ac73-9d85447ebbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:43.396576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030b2d8-5b2a-468f-ac73-9d85447ebbe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:43.396853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030b2d8-5b2a-468f-ac73-9d85447ebbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:43.397122 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030b2d8-5b2a-468f-ac73-9d85447ebbe3 admin admin] PATH_INFO: `/v3/projects/2b0ea1d706374b4b89a1168b8db360be/users/40db637c12544cdc901942a97e3495dd/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:43.412980 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030b2d8-5b2a-468f-ac73-9d85447ebbe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0ea1d706374b4b89a1168b8db360be, user_id=40db637c12544cdc901942a97e3495dd, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:43.415744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030b2d8-5b2a-468f-ac73-9d85447ebbe3 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:43.430257 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1136/2258] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:20:43 2022] PUT /identity/v3/projects/2b0ea1d706374b4b89a1168b8db360be/users/40db637c12544cdc901942a97e3495dd/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:20:43.441855 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30a0da-3f1c-44d8-bbf4-e7b9f71438d1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:43.442145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30a0da-3f1c-44d8-bbf4-e7b9f71438d1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:43.442448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30a0da-3f1c-44d8-bbf4-e7b9f71438d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:43.469745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-fa30a0da-3f1c-44d8-bbf4-e7b9f71438d1 None None] MFA Rules not processed for user `40db637c12544cdc901942a97e3495dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:20:43.470980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fa30a0da-3f1c-44d8-bbf4-e7b9f71438d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:43.538366 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1123/2259] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:20:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:20:43.550267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030b2d8-5b2a-468f-ac73-9d85447ebbe3 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:20:43.552417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8030b2d8-5b2a-468f-ac73-9d85447ebbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:20:43.611648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030b2d8-5b2a-468f-ac73-9d85447ebbe3 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:20:43.615726 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06675083-b12a-442c-832b-c73fca4adfcb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '927543219de847b88b97fbe4f343d2be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:20:43.616374 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06675083-b12a-442c-832b-c73fca4adfcb service glance] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:20:43.616659 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06675083-b12a-442c-832b-c73fca4adfcb service glance] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:20:43.616939 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06675083-b12a-442c-832b-c73fca4adfcb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:20:43.626080 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06675083-b12a-442c-832b-c73fca4adfcb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:20:43.627571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06675083-b12a-442c-832b-c73fca4adfcb service glance] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:20:43.636711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1137/2260] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:20:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:20:53.535341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:53.632438 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:06.459644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493580e7-ccdb-466b-9013-9ba1419e7f3c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:06.460200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493580e7-ccdb-466b-9013-9ba1419e7f3c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:06.460200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493580e7-ccdb-466b-9013-9ba1419e7f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:06.479129 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-493580e7-ccdb-466b-9013-9ba1419e7f3c None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:21:06.480349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-493580e7-ccdb-466b-9013-9ba1419e7f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:06.543650 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1124/2261] 10.222.0.99 () {58 vars in 1009 bytes} [Mon Jul 18 14:21:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:21:06.555889 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06675083-b12a-442c-832b-c73fca4adfcb service glance] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:21:06.557367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-06675083-b12a-442c-832b-c73fca4adfcb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:06.639153 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06675083-b12a-442c-832b-c73fca4adfcb service glance] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:21:06.645946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b83de-4afd-4fa6-8c3e-72fe56006e0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:21:06.646650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b83de-4afd-4fa6-8c3e-72fe56006e0f service swift] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:06.646936 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b83de-4afd-4fa6-8c3e-72fe56006e0f service swift] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:06.647213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b83de-4afd-4fa6-8c3e-72fe56006e0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:06.656284 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b83de-4afd-4fa6-8c3e-72fe56006e0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:21:06.657920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b83de-4afd-4fa6-8c3e-72fe56006e0f service swift] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:21:06.665964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1138/2262] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:21:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:21:16.536424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=25 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:16.663052 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=32 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:18.227638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493580e7-ccdb-466b-9013-9ba1419e7f3c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:21:18.296806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493580e7-ccdb-466b-9013-9ba1419e7f3c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:21:18.302328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62300c-0e3d-4047-9b6d-67d4218fae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:21:18.303245 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62300c-0e3d-4047-9b6d-67d4218fae52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:18.303527 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62300c-0e3d-4047-9b6d-67d4218fae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:18.303809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff62300c-0e3d-4047-9b6d-67d4218fae52 admin admin] PATH_INFO: `/v3/users/40db637c12544cdc901942a97e3495dd` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:18.305133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62300c-0e3d-4047-9b6d-67d4218fae52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40db637c12544cdc901942a97e3495dd)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:21:18.307167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff62300c-0e3d-4047-9b6d-67d4218fae52 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:21:18.356312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ff62300c-0e3d-4047-9b6d-67d4218fae52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40db637c12544cdc901942a97e3495dd'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:21:18.364040 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ff62300c-0e3d-4047-9b6d-67d4218fae52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40db637c12544cdc901942a97e3495dd'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:21:18.364813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ff62300c-0e3d-4047-9b6d-67d4218fae52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40db637c12544cdc901942a97e3495dd'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:21:18.377563 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ff62300c-0e3d-4047-9b6d-67d4218fae52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40db637c12544cdc901942a97e3495dd'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:21:18.384433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ff62300c-0e3d-4047-9b6d-67d4218fae52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40db637c12544cdc901942a97e3495dd'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:21:18.390857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1125/2263] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:21:18 2022] DELETE /identity/v3/users/40db637c12544cdc901942a97e3495dd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:21:18.395471 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fdf4d-3b84-4c23-ad22-01f7d5d1ab26 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:18.395993 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fdf4d-3b84-4c23-ad22-01f7d5d1ab26 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:18.396091 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fdf4d-3b84-4c23-ad22-01f7d5d1ab26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:18.415299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-fe5fdf4d-3b84-4c23-ad22-01f7d5d1ab26 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:21:18.416275 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-fe5fdf4d-3b84-4c23-ad22-01f7d5d1ab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:18.476890 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1139/2264] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:21:18.486995 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62300c-0e3d-4047-9b6d-67d4218fae52 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:21:18.488671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ff62300c-0e3d-4047-9b6d-67d4218fae52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:18.546107 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff62300c-0e3d-4047-9b6d-67d4218fae52 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:21:18.550343 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45566c-3bd2-451d-8546-dbebb1f21eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:21:18.551036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45566c-3bd2-451d-8546-dbebb1f21eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:18.551320 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45566c-3bd2-451d-8546-dbebb1f21eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:18.551594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45566c-3bd2-451d-8546-dbebb1f21eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:18.561654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45566c-3bd2-451d-8546-dbebb1f21eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:21:18.563454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45566c-3bd2-451d-8546-dbebb1f21eb1 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:21:18.576035 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1126/2265] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:21:18.881473 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fdf4d-3b84-4c23-ad22-01f7d5d1ab26 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:21:18.883023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-fe5fdf4d-3b84-4c23-ad22-01f7d5d1ab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:18.898312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fdf4d-3b84-4c23-ad22-01f7d5d1ab26 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:21:18.903951 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76923c3d-83a2-4512-9ef8-23189c9bb8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:21:18.904851 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76923c3d-83a2-4512-9ef8-23189c9bb8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:18.905131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76923c3d-83a2-4512-9ef8-23189c9bb8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:18.905409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76923c3d-83a2-4512-9ef8-23189c9bb8a0 admin admin] PATH_INFO: `/v3/projects/2b0ea1d706374b4b89a1168b8db360be` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:18.907012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76923c3d-83a2-4512-9ef8-23189c9bb8a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0ea1d706374b4b89a1168b8db360be)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:21:18.908964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76923c3d-83a2-4512-9ef8-23189c9bb8a0 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:21:18.968547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-76923c3d-83a2-4512-9ef8-23189c9bb8a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0ea1d706374b4b89a1168b8db360be', 'request_id': 'req-76923c3d-83a2-4512-9ef8-23189c9bb8a0'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:21:18.975009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-76923c3d-83a2-4512-9ef8-23189c9bb8a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0ea1d706374b4b89a1168b8db360be', 'request_id': 'req-76923c3d-83a2-4512-9ef8-23189c9bb8a0'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:21:18.981925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-76923c3d-83a2-4512-9ef8-23189c9bb8a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0ea1d706374b4b89a1168b8db360be', 'request_id': 'req-76923c3d-83a2-4512-9ef8-23189c9bb8a0'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:21:19.000716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-76923c3d-83a2-4512-9ef8-23189c9bb8a0 admin admin] The token cache is being invalidate because project 2b0ea1d706374b4b89a1168b8db360be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:21:19.001010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-76923c3d-83a2-4512-9ef8-23189c9bb8a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:21:19.001682 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-76923c3d-83a2-4512-9ef8-23189c9bb8a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:21:19.003319 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1140/2266] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:21:18 2022] DELETE /identity/v3/projects/2b0ea1d706374b4b89a1168b8db360be => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:21:19.371324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45566c-3bd2-451d-8546-dbebb1f21eb1 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:21:19.373595 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5f45566c-3bd2-451d-8546-dbebb1f21eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:19.417228 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:19.471474 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45566c-3bd2-451d-8546-dbebb1f21eb1 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:21:19.539773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1356a3-c82f-49c0-bbaf-78283c7293a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92b73e1a514148b19bb6a1d2a39e32cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:21:19.540331 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1356a3-c82f-49c0-bbaf-78283c7293a8 service placement] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:19.540614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1356a3-c82f-49c0-bbaf-78283c7293a8 service placement] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:19.540890 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1356a3-c82f-49c0-bbaf-78283c7293a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:19.543180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5c1356a3-c82f-49c0-bbaf-78283c7293a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:19.554955 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1356a3-c82f-49c0-bbaf-78283c7293a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:21:19.558021 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1356a3-c82f-49c0-bbaf-78283c7293a8 service placement] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:21:19.569138 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1127/2267] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:21:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:21:21.113577 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d047de-a807-4bfd-b590-c5162db84b78 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:21.114157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d047de-a807-4bfd-b590-c5162db84b78 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:21.114157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d047de-a807-4bfd-b590-c5162db84b78 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:21.115587 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1141/2268] 10.222.0.99 () {54 vars in 921 bytes} [Mon Jul 18 14:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:21:21.122069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cd464-4206-42d5-8530-2693bc692793 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:21.122587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cd464-4206-42d5-8530-2693bc692793 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:21.122789 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cd464-4206-42d5-8530-2693bc692793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:21.143525 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-da5cd464-4206-42d5-8530-2693bc692793 None None] MFA Rules not processed for user `b1b66b55e0374152828913910c4002f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:21:21.146167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-da5cd464-4206-42d5-8530-2693bc692793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:21.221012 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1128/2269] 10.222.0.99 () {58 vars in 1018 bytes} [Mon Jul 18 14:21:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:21:21.232802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d047de-a807-4bfd-b590-c5162db84b78 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:21:21.234657 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a0d047de-a807-4bfd-b590-c5162db84b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:21.307049 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d047de-a807-4bfd-b590-c5162db84b78 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:21:21.310739 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712775f8-c744-488b-aa08-e357cbaea5d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '927543219de847b88b97fbe4f343d2be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:21:21.311396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712775f8-c744-488b-aa08-e357cbaea5d8 service glance] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:21.311741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712775f8-c744-488b-aa08-e357cbaea5d8 service glance] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:21.312021 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712775f8-c744-488b-aa08-e357cbaea5d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:21.323184 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712775f8-c744-488b-aa08-e357cbaea5d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:21:21.324626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712775f8-c744-488b-aa08-e357cbaea5d8 service glance] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:21:21.335996 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1142/2270] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:21:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:21:21.415906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a189eb8-6a75-4c85-af76-c94aa14fc069 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:21.416318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a189eb8-6a75-4c85-af76-c94aa14fc069 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:21.416665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a189eb8-6a75-4c85-af76-c94aa14fc069 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:21.418120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1129/2271] 10.222.0.99 () {54 vars in 921 bytes} [Mon Jul 18 14:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:21:21.424289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a06aa-31d9-4e85-a565-adb281cb4c57 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:21.424578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a06aa-31d9-4e85-a565-adb281cb4c57 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:21.424955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a06aa-31d9-4e85-a565-adb281cb4c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:21.444232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-972a06aa-31d9-4e85-a565-adb281cb4c57 None None] MFA Rules not processed for user `abc51e98d0054609b6ce10723f70bf49`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:21:21.445529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-972a06aa-31d9-4e85-a565-adb281cb4c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:21.468213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:21.502735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1143/2272] 10.222.0.99 () {58 vars in 1018 bytes} [Mon Jul 18 14:21:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:21:21.514975 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a189eb8-6a75-4c85-af76-c94aa14fc069 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:21:21.516826 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5a189eb8-6a75-4c85-af76-c94aa14fc069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:21.530843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a189eb8-6a75-4c85-af76-c94aa14fc069 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:21:21.534726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d61d7-e08d-4ec3-b16b-895f0b3d529a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:21:21.535383 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d61d7-e08d-4ec3-b16b-895f0b3d529a service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:21.535664 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d61d7-e08d-4ec3-b16b-895f0b3d529a service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:21.535939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d61d7-e08d-4ec3-b16b-895f0b3d529a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:21.543317 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d61d7-e08d-4ec3-b16b-895f0b3d529a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:21:21.544810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d61d7-e08d-4ec3-b16b-895f0b3d529a service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:21:21.553278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1130/2273] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:21:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:21:21.652776 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeff962-0f55-4ac3-84f7-82f6074f0259 None None] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:21.653062 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeff962-0f55-4ac3-84f7-82f6074f0259 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:21.653337 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeff962-0f55-4ac3-84f7-82f6074f0259 None None] PATH_INFO: `/` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:21.654774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1144/2274] 10.222.0.99 () {54 vars in 921 bytes} [Mon Jul 18 14:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 14:21:21.662428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd886654-d72b-4e65-8ea0-ed42c6eb0da4 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:21.662746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd886654-d72b-4e65-8ea0-ed42c6eb0da4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:21.663026 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd886654-d72b-4e65-8ea0-ed42c6eb0da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:21.682947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-bd886654-d72b-4e65-8ea0-ed42c6eb0da4 None None] MFA Rules not processed for user `b1b66b55e0374152828913910c4002f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:21:21.684156 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bd886654-d72b-4e65-8ea0-ed42c6eb0da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:21.694237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1131/2275] 10.222.0.99 () {58 vars in 1018 bytes} [Mon Jul 18 14:21:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:21:21.705212 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeff962-0f55-4ac3-84f7-82f6074f0259 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:21:21.717586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeff962-0f55-4ac3-84f7-82f6074f0259 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:21:21.721861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dabfb4-f834-4366-9b94-988e2bd5b021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:21:21.722528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dabfb4-f834-4366-9b94-988e2bd5b021 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:21.722807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dabfb4-f834-4366-9b94-988e2bd5b021 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:21.723078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dabfb4-f834-4366-9b94-988e2bd5b021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:21.733861 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dabfb4-f834-4366-9b94-988e2bd5b021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:21:21.735317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dabfb4-f834-4366-9b94-988e2bd5b021 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:21:21.746228 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1145/2276] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:21:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:21:24.080877 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e7df6-b467-48b7-ab52-fc2ec39e7c05 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:24.081427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e7df6-b467-48b7-ab52-fc2ec39e7c05 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:24.081427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e7df6-b467-48b7-ab52-fc2ec39e7c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:24.099632 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-313e7df6-b467-48b7-ab52-fc2ec39e7c05 None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:21:24.100828 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-313e7df6-b467-48b7-ab52-fc2ec39e7c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:24.128879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:24.163348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1132/2277] 10.222.0.99 () {58 vars in 1009 bytes} [Mon Jul 18 14:21:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:21:24.196068 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dabfb4-f834-4366-9b94-988e2bd5b021 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:21:24.198475 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f3dabfb4-f834-4366-9b94-988e2bd5b021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:24.277334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dabfb4-f834-4366-9b94-988e2bd5b021 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:21:24.283004 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abc072-268a-47fa-a2a5-6c7ba5011e91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:21:24.283672 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abc072-268a-47fa-a2a5-6c7ba5011e91 service swift] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:24.283964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abc072-268a-47fa-a2a5-6c7ba5011e91 service swift] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:24.284237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abc072-268a-47fa-a2a5-6c7ba5011e91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:24.292878 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abc072-268a-47fa-a2a5-6c7ba5011e91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:21:24.294581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abc072-268a-47fa-a2a5-6c7ba5011e91 service swift] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:21:24.302787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1146/2278] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:21:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:21:34.155236 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=13 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:34.299627 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=49 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:49.334655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026533-5d44-4ada-89d0-fa909fd2c340 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:49.335520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026533-5d44-4ada-89d0-fa909fd2c340 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:49.335520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026533-5d44-4ada-89d0-fa909fd2c340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:49.355758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-29026533-5d44-4ada-89d0-fa909fd2c340 None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:21:49.356971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-29026533-5d44-4ada-89d0-fa909fd2c340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:21:49.364413 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1133/2279] 10.222.0.99 () {58 vars in 967 bytes} [Mon Jul 18 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:21:49.378617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abc072-268a-47fa-a2a5-6c7ba5011e91 service swift] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:21:49.390933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abc072-268a-47fa-a2a5-6c7ba5011e91 service swift] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:21:49.398612 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226011e-b6ec-40ac-b98c-783c724cbbce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:21:49.399369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226011e-b6ec-40ac-b98c-783c724cbbce service swift] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:21:49.399681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226011e-b6ec-40ac-b98c-783c724cbbce service swift] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:21:49.399985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226011e-b6ec-40ac-b98c-783c724cbbce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:21:49.409676 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226011e-b6ec-40ac-b98c-783c724cbbce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:21:49.411302 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226011e-b6ec-40ac-b98c-783c724cbbce service swift] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:21:49.420107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1147/2280] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:21:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:21:59.350279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:59.416260 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=6 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:45.500734 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026533-5d44-4ada-89d0-fa909fd2c340 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:22:45.512005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026533-5d44-4ada-89d0-fa909fd2c340 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:22:45.516068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431b013-1d3c-4c0e-9457-c3af6505214d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:22:45.516857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431b013-1d3c-4c0e-9457-c3af6505214d service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:22:45.517030 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431b013-1d3c-4c0e-9457-c3af6505214d service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:22:45.517763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431b013-1d3c-4c0e-9457-c3af6505214d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:22:45.519918 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a431b013-1d3c-4c0e-9457-c3af6505214d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:22:45.534598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431b013-1d3c-4c0e-9457-c3af6505214d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:22:45.536538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431b013-1d3c-4c0e-9457-c3af6505214d service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:22:45.549557 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1134/2281] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:22:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:22:46.192994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226011e-b6ec-40ac-b98c-783c724cbbce service swift] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:22:46.195685 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b226011e-b6ec-40ac-b98c-783c724cbbce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:22:46.208935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226011e-b6ec-40ac-b98c-783c724cbbce service swift] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:22:46.213874 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f1897-cdb2-4ad5-bae9-7a1a30d23b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:22:46.215681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f1897-cdb2-4ad5-bae9-7a1a30d23b69 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:22:46.216337 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f1897-cdb2-4ad5-bae9-7a1a30d23b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:22:46.216829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f1897-cdb2-4ad5-bae9-7a1a30d23b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:22:46.219403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-890f1897-cdb2-4ad5-bae9-7a1a30d23b69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:22:46.237650 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f1897-cdb2-4ad5-bae9-7a1a30d23b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:22:46.239584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f1897-cdb2-4ad5-bae9-7a1a30d23b69 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:22:46.254519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1148/2282] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:22:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:22:46.394504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f353d-c43b-4a33-aab7-0ae1eadab7f1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:22:46.394772 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f353d-c43b-4a33-aab7-0ae1eadab7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:22:46.395840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f353d-c43b-4a33-aab7-0ae1eadab7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:22:46.415975 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c71f353d-c43b-4a33-aab7-0ae1eadab7f1 None None] MFA Rules not processed for user `c8a38997f7094d019157ab969487da12`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:22:46.417212 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c71f353d-c43b-4a33-aab7-0ae1eadab7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:22:46.474639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1135/2283] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:22:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:22:56.247925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=6 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:56.466992 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=31 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:59.625714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d20cad-8dda-46a2-bb3e-be012a618485 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:22:59.626220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d20cad-8dda-46a2-bb3e-be012a618485 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:22:59.626321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d20cad-8dda-46a2-bb3e-be012a618485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:22:59.644537 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-70d20cad-8dda-46a2-bb3e-be012a618485 None None] MFA Rules not processed for user `a19eb1f3c9e74f3c92755186a7a44ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:22:59.645741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-70d20cad-8dda-46a2-bb3e-be012a618485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:22:59.714173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1149/2284] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:22:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:23:01.416214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f353d-c43b-4a33-aab7-0ae1eadab7f1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:23:01.417982 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c71f353d-c43b-4a33-aab7-0ae1eadab7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:01.435321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f353d-c43b-4a33-aab7-0ae1eadab7f1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:23:01.441902 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4899afe-73fa-4d72-a928-6a9588e26a5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:23:01.442593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4899afe-73fa-4d72-a928-6a9588e26a5d service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:23:01.442918 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4899afe-73fa-4d72-a928-6a9588e26a5d service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:23:01.443212 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4899afe-73fa-4d72-a928-6a9588e26a5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:23:01.445108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a4899afe-73fa-4d72-a928-6a9588e26a5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:01.456473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4899afe-73fa-4d72-a928-6a9588e26a5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:23:01.458066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4899afe-73fa-4d72-a928-6a9588e26a5d service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:23:01.467888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1136/2285] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:23:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:23:07.617174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d20cad-8dda-46a2-bb3e-be012a618485 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:23:07.618853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-70d20cad-8dda-46a2-bb3e-be012a618485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:07.637262 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d20cad-8dda-46a2-bb3e-be012a618485 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:23:07.644410 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085ad33-242b-482b-8c30-58050862f2aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:23:07.645069 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085ad33-242b-482b-8c30-58050862f2aa service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:23:07.645352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085ad33-242b-482b-8c30-58050862f2aa service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:23:07.645625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085ad33-242b-482b-8c30-58050862f2aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:23:07.647903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-7085ad33-242b-482b-8c30-58050862f2aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:07.712617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085ad33-242b-482b-8c30-58050862f2aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:23:07.714246 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085ad33-242b-482b-8c30-58050862f2aa service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:23:07.724414 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1150/2286] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:23:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:23:11.463289 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:16.773717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4899afe-73fa-4d72-a928-6a9588e26a5d service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:23:16.784409 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4899afe-73fa-4d72-a928-6a9588e26a5d service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:23:16.788282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ab0dd-6684-4c57-bcc6-13c48fedb28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:23:16.789022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ab0dd-6684-4c57-bcc6-13c48fedb28d service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:23:16.789306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ab0dd-6684-4c57-bcc6-13c48fedb28d service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:23:16.789673 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ab0dd-6684-4c57-bcc6-13c48fedb28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:23:16.791919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-971ab0dd-6684-4c57-bcc6-13c48fedb28d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:16.802686 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ab0dd-6684-4c57-bcc6-13c48fedb28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:23:16.804273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ab0dd-6684-4c57-bcc6-13c48fedb28d service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:23:16.813753 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1137/2287] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:23:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:23:17.719666 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=53 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:18.793653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212d6e-bb47-40e3-b0a1-567fb4945235 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:23:18.794301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212d6e-bb47-40e3-b0a1-567fb4945235 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:23:18.794301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212d6e-bb47-40e3-b0a1-567fb4945235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:23:18.814822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-10212d6e-bb47-40e3-b0a1-567fb4945235 None None] MFA Rules not processed for user `896e2214f4794e90a5f0416e016d0dde`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:23:18.816066 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-10212d6e-bb47-40e3-b0a1-567fb4945235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:18.823504 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1151/2288] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:23:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:23:19.169479 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ab0dd-6684-4c57-bcc6-13c48fedb28d service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:23:19.179047 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ab0dd-6684-4c57-bcc6-13c48fedb28d service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:23:19.183493 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89c940-cd52-40b3-a0d5-345b1db3696c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:23:19.184137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89c940-cd52-40b3-a0d5-345b1db3696c service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:23:19.184424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89c940-cd52-40b3-a0d5-345b1db3696c service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:23:19.184699 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89c940-cd52-40b3-a0d5-345b1db3696c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:23:19.186813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cf89c940-cd52-40b3-a0d5-345b1db3696c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:19.197668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89c940-cd52-40b3-a0d5-345b1db3696c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:23:19.199378 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89c940-cd52-40b3-a0d5-345b1db3696c service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:23:19.208040 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1138/2289] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:23:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:23:19.799959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10212d6e-bb47-40e3-b0a1-567fb4945235 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:23:19.801405 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-10212d6e-bb47-40e3-b0a1-567fb4945235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:19.817935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10212d6e-bb47-40e3-b0a1-567fb4945235 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:23:19.823747 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221713a-3fac-4a8e-a685-d6f872eb7ec0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92b73e1a514148b19bb6a1d2a39e32cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:23:19.824409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221713a-3fac-4a8e-a685-d6f872eb7ec0 service placement] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:23:19.824691 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221713a-3fac-4a8e-a685-d6f872eb7ec0 service placement] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:23:19.824962 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221713a-3fac-4a8e-a685-d6f872eb7ec0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:23:19.827708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c221713a-3fac-4a8e-a685-d6f872eb7ec0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:19.840686 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221713a-3fac-4a8e-a685-d6f872eb7ec0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:23:19.842476 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221713a-3fac-4a8e-a685-d6f872eb7ec0 service placement] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:23:19.853621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1152/2290] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:23:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:23:22.690060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89c940-cd52-40b3-a0d5-345b1db3696c service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:23:22.711322 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89c940-cd52-40b3-a0d5-345b1db3696c service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:23:22.719853 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95aae6-e217-4ddc-8a87-fca7200cd45b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:23:22.720539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95aae6-e217-4ddc-8a87-fca7200cd45b service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:23:22.720813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95aae6-e217-4ddc-8a87-fca7200cd45b service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:23:22.721089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95aae6-e217-4ddc-8a87-fca7200cd45b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:23:22.723020 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8c95aae6-e217-4ddc-8a87-fca7200cd45b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:22.737668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95aae6-e217-4ddc-8a87-fca7200cd45b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:23:22.739340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95aae6-e217-4ddc-8a87-fca7200cd45b service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:23:22.757145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1139/2291] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:23:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:23:29.849107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=9 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:32.748161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=18 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:35.545937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221713a-3fac-4a8e-a685-d6f872eb7ec0 service placement] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:23:35.563789 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221713a-3fac-4a8e-a685-d6f872eb7ec0 service placement] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:23:35.580107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e47867-3557-4566-b9f3-7f432324c78e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:23:35.580793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e47867-3557-4566-b9f3-7f432324c78e service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:23:35.581082 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e47867-3557-4566-b9f3-7f432324c78e service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:23:35.581382 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e47867-3557-4566-b9f3-7f432324c78e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:23:35.583578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-27e47867-3557-4566-b9f3-7f432324c78e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:35.596505 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e47867-3557-4566-b9f3-7f432324c78e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:23:35.598285 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e47867-3557-4566-b9f3-7f432324c78e service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:23:35.610870 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1153/2292] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:23:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:23:39.722194 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf07da-0fb4-4428-90d5-e57591cf917f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:23:39.722762 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf07da-0fb4-4428-90d5-e57591cf917f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:23:39.722762 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf07da-0fb4-4428-90d5-e57591cf917f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:23:39.741336 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-dbdf07da-0fb4-4428-90d5-e57591cf917f None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:23:39.742583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dbdf07da-0fb4-4428-90d5-e57591cf917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:39.750270 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1140/2293] 10.222.0.99 () {58 vars in 967 bytes} [Mon Jul 18 14:23:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:23:39.800823 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e47867-3557-4566-b9f3-7f432324c78e service nova] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:23:39.813057 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e47867-3557-4566-b9f3-7f432324c78e service nova] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:23:39.819693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19c2d8-8a47-4804-bf78-1d8ea7f6039c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:23:39.820524 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19c2d8-8a47-4804-bf78-1d8ea7f6039c service swift] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:23:39.820814 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19c2d8-8a47-4804-bf78-1d8ea7f6039c service swift] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:23:39.821078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19c2d8-8a47-4804-bf78-1d8ea7f6039c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:23:39.830445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19c2d8-8a47-4804-bf78-1d8ea7f6039c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:23:39.831959 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19c2d8-8a47-4804-bf78-1d8ea7f6039c service swift] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:23:39.840869 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1154/2294] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:23:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:23:47.276468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf07da-0fb4-4428-90d5-e57591cf917f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:23:47.277912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dbdf07da-0fb4-4428-90d5-e57591cf917f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:47.345699 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf07da-0fb4-4428-90d5-e57591cf917f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:23:47.350581 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf95d1-ba74-403a-8cdd-927326f9214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:23:47.351451 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf95d1-ba74-403a-8cdd-927326f9214b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:23:47.351731 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf95d1-ba74-403a-8cdd-927326f9214b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:23:47.352002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf95d1-ba74-403a-8cdd-927326f9214b admin admin] PATH_INFO: `/v3/users/7caa4c7290254e358d9e7b0e64c17b0e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:23:47.353222 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf95d1-ba74-403a-8cdd-927326f9214b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7caa4c7290254e358d9e7b0e64c17b0e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:23:47.355201 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf95d1-ba74-403a-8cdd-927326f9214b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:23:47.405342 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a0cf95d1-ba74-403a-8cdd-927326f9214b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7caa4c7290254e358d9e7b0e64c17b0e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:47.412874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a0cf95d1-ba74-403a-8cdd-927326f9214b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7caa4c7290254e358d9e7b0e64c17b0e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:47.413517 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a0cf95d1-ba74-403a-8cdd-927326f9214b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7caa4c7290254e358d9e7b0e64c17b0e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:47.427217 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a0cf95d1-ba74-403a-8cdd-927326f9214b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7caa4c7290254e358d9e7b0e64c17b0e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:47.435940 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a0cf95d1-ba74-403a-8cdd-927326f9214b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7caa4c7290254e358d9e7b0e64c17b0e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:47.442766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1141/2295] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:23:47 2022] DELETE /identity/v3/users/7caa4c7290254e358d9e7b0e64c17b0e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:23:47.642540 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19c2d8-8a47-4804-bf78-1d8ea7f6039c service swift] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:23:47.653903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19c2d8-8a47-4804-bf78-1d8ea7f6039c service swift] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:23:47.714020 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed97a14-35ff-48ee-8008-c3d5870616f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:23:47.714834 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed97a14-35ff-48ee-8008-c3d5870616f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:23:47.715108 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed97a14-35ff-48ee-8008-c3d5870616f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:23:47.715396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed97a14-35ff-48ee-8008-c3d5870616f8 admin admin] PATH_INFO: `/v3/projects/d3ab5b8368ea459a98a891d3680d8afe` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:23:47.716607 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed97a14-35ff-48ee-8008-c3d5870616f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ab5b8368ea459a98a891d3680d8afe)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:23:47.718688 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed97a14-35ff-48ee-8008-c3d5870616f8 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:23:47.780854 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2ed97a14-35ff-48ee-8008-c3d5870616f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ab5b8368ea459a98a891d3680d8afe', 'request_id': 'req-2ed97a14-35ff-48ee-8008-c3d5870616f8'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:47.787262 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2ed97a14-35ff-48ee-8008-c3d5870616f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ab5b8368ea459a98a891d3680d8afe', 'request_id': 'req-2ed97a14-35ff-48ee-8008-c3d5870616f8'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:47.793373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2ed97a14-35ff-48ee-8008-c3d5870616f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ab5b8368ea459a98a891d3680d8afe', 'request_id': 'req-2ed97a14-35ff-48ee-8008-c3d5870616f8'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:47.807920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2ed97a14-35ff-48ee-8008-c3d5870616f8 admin admin] The token cache is being invalidate because project d3ab5b8368ea459a98a891d3680d8afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:23:47.808210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2ed97a14-35ff-48ee-8008-c3d5870616f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:47.808868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2ed97a14-35ff-48ee-8008-c3d5870616f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:47.810514 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1155/2296] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:23:47 2022] DELETE /identity/v3/projects/d3ab5b8368ea459a98a891d3680d8afe => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:23:47.814892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf95d1-ba74-403a-8cdd-927326f9214b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:23:47.816395 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a0cf95d1-ba74-403a-8cdd-927326f9214b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:47.829719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf95d1-ba74-403a-8cdd-927326f9214b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:23:47.897614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becda012-c91c-4182-b0a2-6fa8a81754d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:23:47.898552 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becda012-c91c-4182-b0a2-6fa8a81754d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:23:47.898857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becda012-c91c-4182-b0a2-6fa8a81754d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:23:47.899132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becda012-c91c-4182-b0a2-6fa8a81754d3 admin admin] PATH_INFO: `/v3/users/994c7c3d21c6491c85a741ffa29254a8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:23:47.900398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becda012-c91c-4182-b0a2-6fa8a81754d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=994c7c3d21c6491c85a741ffa29254a8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:23:47.902381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becda012-c91c-4182-b0a2-6fa8a81754d3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:23:47.917487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:47.958522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-becda012-c91c-4182-b0a2-6fa8a81754d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '994c7c3d21c6491c85a741ffa29254a8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:47.967762 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-becda012-c91c-4182-b0a2-6fa8a81754d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '994c7c3d21c6491c85a741ffa29254a8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:47.968365 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-becda012-c91c-4182-b0a2-6fa8a81754d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '994c7c3d21c6491c85a741ffa29254a8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:47.980892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-becda012-c91c-4182-b0a2-6fa8a81754d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '994c7c3d21c6491c85a741ffa29254a8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:47.988136 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-becda012-c91c-4182-b0a2-6fa8a81754d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '994c7c3d21c6491c85a741ffa29254a8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:47.994039 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1142/2297] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:23:47 2022] DELETE /identity/v3/users/994c7c3d21c6491c85a741ffa29254a8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:23:48.191835 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed97a14-35ff-48ee-8008-c3d5870616f8 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:23:48.193399 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2ed97a14-35ff-48ee-8008-c3d5870616f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:23:48.206919 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed97a14-35ff-48ee-8008-c3d5870616f8 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:23:48.265450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81005349-2884-462d-b56e-41190f01a8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:23:48.266316 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81005349-2884-462d-b56e-41190f01a8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:23:48.266628 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81005349-2884-462d-b56e-41190f01a8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:23:48.266902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81005349-2884-462d-b56e-41190f01a8ea admin admin] PATH_INFO: `/v3/projects/4cb211f5cdec41cea3e96e36ce8a5925` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:23:48.268137 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81005349-2884-462d-b56e-41190f01a8ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb211f5cdec41cea3e96e36ce8a5925)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:23:48.270137 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81005349-2884-462d-b56e-41190f01a8ea admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:23:48.277183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:48.321318 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-81005349-2884-462d-b56e-41190f01a8ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb211f5cdec41cea3e96e36ce8a5925', 'request_id': 'req-81005349-2884-462d-b56e-41190f01a8ea'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:48.326782 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-81005349-2884-462d-b56e-41190f01a8ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb211f5cdec41cea3e96e36ce8a5925', 'request_id': 'req-81005349-2884-462d-b56e-41190f01a8ea'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:48.332963 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-81005349-2884-462d-b56e-41190f01a8ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb211f5cdec41cea3e96e36ce8a5925', 'request_id': 'req-81005349-2884-462d-b56e-41190f01a8ea'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:48.347043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-81005349-2884-462d-b56e-41190f01a8ea admin admin] The token cache is being invalidate because project 4cb211f5cdec41cea3e96e36ce8a5925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:23:48.347328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-81005349-2884-462d-b56e-41190f01a8ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:48.347991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-81005349-2884-462d-b56e-41190f01a8ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:23:48.349663 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1156/2298] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:23:48 2022] DELETE /identity/v3/projects/4cb211f5cdec41cea3e96e36ce8a5925 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:23:57.990643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:58.344186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:00.703848 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becda012-c91c-4182-b0a2-6fa8a81754d3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:00.705669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-becda012-c91c-4182-b0a2-6fa8a81754d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:00.791349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becda012-c91c-4182-b0a2-6fa8a81754d3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:00.868912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65bc0c-9c4f-4b15-9b4e-c3f2aa228e03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:00.869642 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65bc0c-9c4f-4b15-9b4e-c3f2aa228e03 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:00.869932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65bc0c-9c4f-4b15-9b4e-c3f2aa228e03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:00.870218 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65bc0c-9c4f-4b15-9b4e-c3f2aa228e03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:00.872904 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9e65bc0c-9c4f-4b15-9b4e-c3f2aa228e03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:00.958428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65bc0c-9c4f-4b15-9b4e-c3f2aa228e03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:00.961053 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65bc0c-9c4f-4b15-9b4e-c3f2aa228e03 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:00.973244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1143/2299] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:24:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:24:10.968306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=68 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:20.164771 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81005349-2884-462d-b56e-41190f01a8ea admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:20.166269 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-81005349-2884-462d-b56e-41190f01a8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:20.227842 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81005349-2884-462d-b56e-41190f01a8ea admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:20.232390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac56326-e461-436d-991a-bde30c079a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:20.233055 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac56326-e461-436d-991a-bde30c079a61 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:20.233331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac56326-e461-436d-991a-bde30c079a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:20.233603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac56326-e461-436d-991a-bde30c079a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:20.235691 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5ac56326-e461-436d-991a-bde30c079a61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:20.303467 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac56326-e461-436d-991a-bde30c079a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:20.304915 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac56326-e461-436d-991a-bde30c079a61 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:20.314658 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1157/2300] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:24:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:24:23.818709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65bc0c-9c4f-4b15-9b4e-c3f2aa228e03 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:23.820297 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9e65bc0c-9c4f-4b15-9b4e-c3f2aa228e03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:23.875160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac56326-e461-436d-991a-bde30c079a61 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:23.877893 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5ac56326-e461-436d-991a-bde30c079a61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:23.892473 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac56326-e461-436d-991a-bde30c079a61 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:23.899026 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf8989-0789-4f2a-87dc-79b028dbb726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:23.900790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf8989-0789-4f2a-87dc-79b028dbb726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:23.901080 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf8989-0789-4f2a-87dc-79b028dbb726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:23.901376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf8989-0789-4f2a-87dc-79b028dbb726 admin admin] PATH_INFO: `/v3/users/c8a38997f7094d019157ab969487da12` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:23.902640 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf8989-0789-4f2a-87dc-79b028dbb726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a38997f7094d019157ab969487da12)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:23.904644 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf8989-0789-4f2a-87dc-79b028dbb726 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:23.911813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65bc0c-9c4f-4b15-9b4e-c3f2aa228e03 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:23.917039 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61470ce5-c587-4ae5-bb2c-09bd43864acf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92b73e1a514148b19bb6a1d2a39e32cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:23.917738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61470ce5-c587-4ae5-bb2c-09bd43864acf service placement] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:23.918038 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61470ce5-c587-4ae5-bb2c-09bd43864acf service placement] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:23.918310 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61470ce5-c587-4ae5-bb2c-09bd43864acf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:23.920322 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-61470ce5-c587-4ae5-bb2c-09bd43864acf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:23.932678 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61470ce5-c587-4ae5-bb2c-09bd43864acf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:23.934297 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61470ce5-c587-4ae5-bb2c-09bd43864acf service placement] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:23.945254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1144/2301] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:24:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:24:23.959949 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-47cf8989-0789-4f2a-87dc-79b028dbb726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a38997f7094d019157ab969487da12'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:23.968685 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-47cf8989-0789-4f2a-87dc-79b028dbb726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a38997f7094d019157ab969487da12'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:23.969565 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-47cf8989-0789-4f2a-87dc-79b028dbb726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a38997f7094d019157ab969487da12'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:23.984008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-47cf8989-0789-4f2a-87dc-79b028dbb726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a38997f7094d019157ab969487da12'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:23.992576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-47cf8989-0789-4f2a-87dc-79b028dbb726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a38997f7094d019157ab969487da12'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:24.000088 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1158/2302] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:24:23 2022] DELETE /identity/v3/users/c8a38997f7094d019157ab969487da12 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:24.211143 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61470ce5-c587-4ae5-bb2c-09bd43864acf service placement] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:24.223734 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61470ce5-c587-4ae5-bb2c-09bd43864acf service placement] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:24.302941 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b5dd0-18ab-40c5-a2fe-d2c24f9ff433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:24.303841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b5dd0-18ab-40c5-a2fe-d2c24f9ff433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:24.304125 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b5dd0-18ab-40c5-a2fe-d2c24f9ff433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:24.304398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b5dd0-18ab-40c5-a2fe-d2c24f9ff433 admin admin] PATH_INFO: `/v3/projects/b617d0b73acd4fc685c96da2f19312a5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:24.305595 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b5dd0-18ab-40c5-a2fe-d2c24f9ff433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b617d0b73acd4fc685c96da2f19312a5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:24.307608 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b5dd0-18ab-40c5-a2fe-d2c24f9ff433 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:24.357646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a47b5dd0-18ab-40c5-a2fe-d2c24f9ff433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b617d0b73acd4fc685c96da2f19312a5', 'request_id': 'req-a47b5dd0-18ab-40c5-a2fe-d2c24f9ff433'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:24.364552 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a47b5dd0-18ab-40c5-a2fe-d2c24f9ff433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b617d0b73acd4fc685c96da2f19312a5', 'request_id': 'req-a47b5dd0-18ab-40c5-a2fe-d2c24f9ff433'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:24.373500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a47b5dd0-18ab-40c5-a2fe-d2c24f9ff433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b617d0b73acd4fc685c96da2f19312a5', 'request_id': 'req-a47b5dd0-18ab-40c5-a2fe-d2c24f9ff433'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:24.393689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a47b5dd0-18ab-40c5-a2fe-d2c24f9ff433 admin admin] The token cache is being invalidate because project b617d0b73acd4fc685c96da2f19312a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:24:24.393923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a47b5dd0-18ab-40c5-a2fe-d2c24f9ff433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:24.394869 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a47b5dd0-18ab-40c5-a2fe-d2c24f9ff433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:24.396661 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1145/2303] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:24:24 2022] DELETE /identity/v3/projects/b617d0b73acd4fc685c96da2f19312a5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:24.402703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea438a5-c7ee-4ebd-b287-937927705bd7 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:24.402998 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea438a5-c7ee-4ebd-b287-937927705bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:24.403275 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea438a5-c7ee-4ebd-b287-937927705bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:24.426793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-aea438a5-c7ee-4ebd-b287-937927705bd7 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:24.428048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-aea438a5-c7ee-4ebd-b287-937927705bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:24.447677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:24.502996 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1159/2304] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:24.510951 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92028ac2-0779-4983-a59b-c5ccd6624b54 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:24.511247 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92028ac2-0779-4983-a59b-c5ccd6624b54 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:24.511537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92028ac2-0779-4983-a59b-c5ccd6624b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:24.532031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-92028ac2-0779-4983-a59b-c5ccd6624b54 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:24.533250 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-92028ac2-0779-4983-a59b-c5ccd6624b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:24.542988 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1146/2305] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:24.547542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea438a5-c7ee-4ebd-b287-937927705bd7 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:24.563047 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea438a5-c7ee-4ebd-b287-937927705bd7 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:24.570330 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fc795-f2b7-48c3-95fd-074c83148ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:24.571413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fc795-f2b7-48c3-95fd-074c83148ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:24.571704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fc795-f2b7-48c3-95fd-074c83148ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:24.571976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fc795-f2b7-48c3-95fd-074c83148ba9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:24.573206 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fc795-f2b7-48c3-95fd-074c83148ba9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:24:24.573734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fc795-f2b7-48c3-95fd-074c83148ba9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:24.576493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fc795-f2b7-48c3-95fd-074c83148ba9 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:24.597277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1160/2306] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:24:24.602269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92028ac2-0779-4983-a59b-c5ccd6624b54 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:24.615290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92028ac2-0779-4983-a59b-c5ccd6624b54 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:24.624722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5daa4a-62ac-486d-8716-e7a6ab0aa15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:24.625681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5daa4a-62ac-486d-8716-e7a6ab0aa15b admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:24.626016 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5daa4a-62ac-486d-8716-e7a6ab0aa15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:24.626509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5daa4a-62ac-486d-8716-e7a6ab0aa15b admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:24.627761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5daa4a-62ac-486d-8716-e7a6ab0aa15b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:24.629871 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5daa4a-62ac-486d-8716-e7a6ab0aa15b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:24.640455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:24.661912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1147/2307] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:24:24 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:24:24.666490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fc795-f2b7-48c3-95fd-074c83148ba9 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:24.682533 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fc795-f2b7-48c3-95fd-074c83148ba9 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:24.754286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a62a4-97ac-427f-8200-862eb12989f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:24.754940 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a62a4-97ac-427f-8200-862eb12989f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:24.755225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a62a4-97ac-427f-8200-862eb12989f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:24.755506 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a62a4-97ac-427f-8200-862eb12989f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:24.756210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a62a4-97ac-427f-8200-862eb12989f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:24.758153 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a62a4-97ac-427f-8200-862eb12989f3 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:24.784980 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1161/2308] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:24:24 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:24:24.789274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5daa4a-62ac-486d-8716-e7a6ab0aa15b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:24.800354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5daa4a-62ac-486d-8716-e7a6ab0aa15b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:24.805059 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe00a8-02ea-438f-9a25-3ba3ea045955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:24.805721 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe00a8-02ea-438f-9a25-3ba3ea045955 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:24.806005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe00a8-02ea-438f-9a25-3ba3ea045955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:24.806284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe00a8-02ea-438f-9a25-3ba3ea045955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:24.807076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe00a8-02ea-438f-9a25-3ba3ea045955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:24.808693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe00a8-02ea-438f-9a25-3ba3ea045955 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:24.819220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1148/2309] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:24:24.824474 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a62a4-97ac-427f-8200-862eb12989f3 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:24.834896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a62a4-97ac-427f-8200-862eb12989f3 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:24.840128 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a101323-823d-4eb1-8167-3e629f326151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:24.841168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a101323-823d-4eb1-8167-3e629f326151 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:24.841450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a101323-823d-4eb1-8167-3e629f326151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:24.841727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a101323-823d-4eb1-8167-3e629f326151 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:24.842496 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a101323-823d-4eb1-8167-3e629f326151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:24.844105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a101323-823d-4eb1-8167-3e629f326151 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:24.854267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1162/2310] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:24:24.860651 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe00a8-02ea-438f-9a25-3ba3ea045955 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:24.873968 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe00a8-02ea-438f-9a25-3ba3ea045955 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:24.880085 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8024fad-303f-430c-82d0-426ea020d2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:24.880973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8024fad-303f-430c-82d0-426ea020d2f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:24.881273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8024fad-303f-430c-82d0-426ea020d2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:24.881517 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8024fad-303f-430c-82d0-426ea020d2f0 admin admin] PATH_INFO: `/v3/projects/efe2e3a03d1f430c95c26f381bfb1a3b/users/6d589c5e69804c67bb5827ebc2bbb3f9/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:24.898567 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8024fad-303f-430c-82d0-426ea020d2f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe2e3a03d1f430c95c26f381bfb1a3b, user_id=6d589c5e69804c67bb5827ebc2bbb3f9, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:24.901368 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8024fad-303f-430c-82d0-426ea020d2f0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:24.916026 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1149/2311] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:24:24 2022] PUT /identity/v3/projects/efe2e3a03d1f430c95c26f381bfb1a3b/users/6d589c5e69804c67bb5827ebc2bbb3f9/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:24.926921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8265237-c834-4fc9-9070-6840473f29b2 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:24.927475 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8265237-c834-4fc9-9070-6840473f29b2 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:24.927475 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8265237-c834-4fc9-9070-6840473f29b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:24.957273 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-a8265237-c834-4fc9-9070-6840473f29b2 None None] MFA Rules not processed for user `6d589c5e69804c67bb5827ebc2bbb3f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:24.958507 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a8265237-c834-4fc9-9070-6840473f29b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:25.030832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1163/2312] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:25.054065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8024fad-303f-430c-82d0-426ea020d2f0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:25.056114 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c8024fad-303f-430c-82d0-426ea020d2f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:25.137206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8024fad-303f-430c-82d0-426ea020d2f0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:25.142862 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37814e26-27b9-4c11-a35e-1a10caf7448a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:25.143640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37814e26-27b9-4c11-a35e-1a10caf7448a service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:25.143923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37814e26-27b9-4c11-a35e-1a10caf7448a service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:25.144200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37814e26-27b9-4c11-a35e-1a10caf7448a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:25.152532 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37814e26-27b9-4c11-a35e-1a10caf7448a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:25.154159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37814e26-27b9-4c11-a35e-1a10caf7448a service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:25.163161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1150/2313] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:24:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:24:27.908991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8265237-c834-4fc9-9070-6840473f29b2 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:27.927664 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:27.975493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8265237-c834-4fc9-9070-6840473f29b2 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:27.980767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448a0c3-3f91-4c4c-9214-f598b8ee1110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:27.981667 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448a0c3-3f91-4c4c-9214-f598b8ee1110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:27.981952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448a0c3-3f91-4c4c-9214-f598b8ee1110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:27.982232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448a0c3-3f91-4c4c-9214-f598b8ee1110 admin admin] PATH_INFO: `/v3/users/6d589c5e69804c67bb5827ebc2bbb3f9` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:27.983599 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448a0c3-3f91-4c4c-9214-f598b8ee1110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d589c5e69804c67bb5827ebc2bbb3f9)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:27.985579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448a0c3-3f91-4c4c-9214-f598b8ee1110 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:28.037272 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-8448a0c3-3f91-4c4c-9214-f598b8ee1110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d589c5e69804c67bb5827ebc2bbb3f9'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:28.045697 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-8448a0c3-3f91-4c4c-9214-f598b8ee1110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d589c5e69804c67bb5827ebc2bbb3f9'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:28.046326 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-8448a0c3-3f91-4c4c-9214-f598b8ee1110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d589c5e69804c67bb5827ebc2bbb3f9'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:28.059399 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-8448a0c3-3f91-4c4c-9214-f598b8ee1110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d589c5e69804c67bb5827ebc2bbb3f9'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:28.067367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-8448a0c3-3f91-4c4c-9214-f598b8ee1110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d589c5e69804c67bb5827ebc2bbb3f9'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:28.074019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1164/2314] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:24:27 2022] DELETE /identity/v3/users/6d589c5e69804c67bb5827ebc2bbb3f9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:28.078902 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dbcfa-9068-4051-94d5-0eb81cd725dd None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:28.079442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dbcfa-9068-4051-94d5-0eb81cd725dd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:28.079442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dbcfa-9068-4051-94d5-0eb81cd725dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:28.098448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-824dbcfa-9068-4051-94d5-0eb81cd725dd None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:28.099666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-824dbcfa-9068-4051-94d5-0eb81cd725dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:28.166807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1151/2315] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:28.177346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448a0c3-3f91-4c4c-9214-f598b8ee1110 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:28.178947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8448a0c3-3f91-4c4c-9214-f598b8ee1110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:28.236504 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448a0c3-3f91-4c4c-9214-f598b8ee1110 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:28.240656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629936a7-0885-4f3a-b3b6-a3f2407ca9f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:28.241319 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629936a7-0885-4f3a-b3b6-a3f2407ca9f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:28.241602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629936a7-0885-4f3a-b3b6-a3f2407ca9f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:28.241877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629936a7-0885-4f3a-b3b6-a3f2407ca9f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:28.252542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629936a7-0885-4f3a-b3b6-a3f2407ca9f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:28.253993 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629936a7-0885-4f3a-b3b6-a3f2407ca9f3 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:28.264168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1165/2316] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:24:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:24:28.564958 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dbcfa-9068-4051-94d5-0eb81cd725dd None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:28.566654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-824dbcfa-9068-4051-94d5-0eb81cd725dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:28.585312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dbcfa-9068-4051-94d5-0eb81cd725dd None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:28.591040 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcbadf-cf67-48a5-ade2-948a1e610759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:28.592216 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcbadf-cf67-48a5-ade2-948a1e610759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:28.592612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcbadf-cf67-48a5-ade2-948a1e610759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:28.592894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcbadf-cf67-48a5-ade2-948a1e610759 admin admin] PATH_INFO: `/v3/projects/efe2e3a03d1f430c95c26f381bfb1a3b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:28.594187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcbadf-cf67-48a5-ade2-948a1e610759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe2e3a03d1f430c95c26f381bfb1a3b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:28.596233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcbadf-cf67-48a5-ade2-948a1e610759 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:28.637371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:28.648981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a4dcbadf-cf67-48a5-ade2-948a1e610759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe2e3a03d1f430c95c26f381bfb1a3b', 'request_id': 'req-a4dcbadf-cf67-48a5-ade2-948a1e610759'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:28.657763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a4dcbadf-cf67-48a5-ade2-948a1e610759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe2e3a03d1f430c95c26f381bfb1a3b', 'request_id': 'req-a4dcbadf-cf67-48a5-ade2-948a1e610759'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:28.664667 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a4dcbadf-cf67-48a5-ade2-948a1e610759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe2e3a03d1f430c95c26f381bfb1a3b', 'request_id': 'req-a4dcbadf-cf67-48a5-ade2-948a1e610759'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:28.677331 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a4dcbadf-cf67-48a5-ade2-948a1e610759 admin admin] The token cache is being invalidate because project efe2e3a03d1f430c95c26f381bfb1a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:24:28.677614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a4dcbadf-cf67-48a5-ade2-948a1e610759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:28.678219 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a4dcbadf-cf67-48a5-ade2-948a1e610759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:28.679832 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1152/2317] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:24:28 2022] DELETE /identity/v3/projects/efe2e3a03d1f430c95c26f381bfb1a3b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:28.686374 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714a062-2caf-447a-95fc-f9d59eb4335b None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:28.686833 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714a062-2caf-447a-95fc-f9d59eb4335b None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:28.687254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714a062-2caf-447a-95fc-f9d59eb4335b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:28.713272 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-a714a062-2caf-447a-95fc-f9d59eb4335b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:28.714523 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a714a062-2caf-447a-95fc-f9d59eb4335b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:28.753823 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:28.788254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1166/2318] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:28.796198 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8688c-a42b-4f96-8354-0852213896c5 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:28.796484 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8688c-a42b-4f96-8354-0852213896c5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:28.796760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8688c-a42b-4f96-8354-0852213896c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:28.815250 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-feb8688c-a42b-4f96-8354-0852213896c5 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:28.816502 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-feb8688c-a42b-4f96-8354-0852213896c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:28.824325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1153/2319] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:28.828621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714a062-2caf-447a-95fc-f9d59eb4335b None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:28.838381 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714a062-2caf-447a-95fc-f9d59eb4335b None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:28.843450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eaae52-2604-4164-81e0-693e597e1021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:28.844099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaae52-2604-4164-81e0-693e597e1021 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:28.844381 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaae52-2604-4164-81e0-693e597e1021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:28.844654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaae52-2604-4164-81e0-693e597e1021 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:28.845392 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eaae52-2604-4164-81e0-693e597e1021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:24:28.845700 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eaae52-2604-4164-81e0-693e597e1021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:28.847316 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eaae52-2604-4164-81e0-693e597e1021 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:28.858894 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1167/2320] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:24:28.863396 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8688c-a42b-4f96-8354-0852213896c5 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:28.873352 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8688c-a42b-4f96-8354-0852213896c5 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:28.879305 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e8768-741a-4efc-8975-a9835989b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:28.879960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e8768-741a-4efc-8975-a9835989b150 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:28.880245 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e8768-741a-4efc-8975-a9835989b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:28.880522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e8768-741a-4efc-8975-a9835989b150 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:28.881259 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e8768-741a-4efc-8975-a9835989b150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:28.883289 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e8768-741a-4efc-8975-a9835989b150 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:28.914066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1154/2321] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:24:28 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:24:28.920887 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eaae52-2604-4164-81e0-693e597e1021 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:28.934944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eaae52-2604-4164-81e0-693e597e1021 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:28.997107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a7972-6066-4581-949b-6a8287c6830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:28.997802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a7972-6066-4581-949b-6a8287c6830a admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:28.998085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a7972-6066-4581-949b-6a8287c6830a admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:28.998353 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a7972-6066-4581-949b-6a8287c6830a admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:28.999094 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a7972-6066-4581-949b-6a8287c6830a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:29.001063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a7972-6066-4581-949b-6a8287c6830a admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:29.022418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1168/2322] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:24:28 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:24:29.026832 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e8768-741a-4efc-8975-a9835989b150 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:29.037322 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e8768-741a-4efc-8975-a9835989b150 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:29.042157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ee882-900e-49ed-bc3d-26622d2f4be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:29.042852 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ee882-900e-49ed-bc3d-26622d2f4be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:29.043135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ee882-900e-49ed-bc3d-26622d2f4be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:29.043412 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ee882-900e-49ed-bc3d-26622d2f4be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:29.044155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ee882-900e-49ed-bc3d-26622d2f4be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:29.045766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ee882-900e-49ed-bc3d-26622d2f4be4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:29.056758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1155/2323] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:24:29.061311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a7972-6066-4581-949b-6a8287c6830a admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:29.074109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a7972-6066-4581-949b-6a8287c6830a admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:29.079401 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0843952-3a82-456c-8f2c-710156d268ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:29.080063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0843952-3a82-456c-8f2c-710156d268ae admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:29.080352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0843952-3a82-456c-8f2c-710156d268ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:29.080629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0843952-3a82-456c-8f2c-710156d268ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:29.081527 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0843952-3a82-456c-8f2c-710156d268ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:29.083156 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0843952-3a82-456c-8f2c-710156d268ae admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:29.093294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1169/2324] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:24:29.097684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ee882-900e-49ed-bc3d-26622d2f4be4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:29.108276 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ee882-900e-49ed-bc3d-26622d2f4be4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:29.113999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c069ce0-5cbd-4cbd-a327-5ce762d4ca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:29.114929 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c069ce0-5cbd-4cbd-a327-5ce762d4ca0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:29.115210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c069ce0-5cbd-4cbd-a327-5ce762d4ca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:29.115484 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c069ce0-5cbd-4cbd-a327-5ce762d4ca0b admin admin] PATH_INFO: `/v3/projects/ce33c8f087084a5bb171cc832beed343/users/45cf4567c4c64d848451f920732dfaba/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:29.131974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c069ce0-5cbd-4cbd-a327-5ce762d4ca0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce33c8f087084a5bb171cc832beed343, user_id=45cf4567c4c64d848451f920732dfaba, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:29.134712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c069ce0-5cbd-4cbd-a327-5ce762d4ca0b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:29.150158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1156/2325] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:24:29 2022] PUT /identity/v3/projects/ce33c8f087084a5bb171cc832beed343/users/45cf4567c4c64d848451f920732dfaba/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:29.160880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6d596-c0f1-453c-8af7-458474b178ab None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:29.161150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6d596-c0f1-453c-8af7-458474b178ab None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:29.161427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6d596-c0f1-453c-8af7-458474b178ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:29.189276 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-02b6d596-c0f1-453c-8af7-458474b178ab None None] MFA Rules not processed for user `45cf4567c4c64d848451f920732dfaba`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:29.190428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-02b6d596-c0f1-453c-8af7-458474b178ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:29.261213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1170/2326] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:29.270634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c069ce0-5cbd-4cbd-a327-5ce762d4ca0b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:29.345148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c069ce0-5cbd-4cbd-a327-5ce762d4ca0b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:29.350740 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779270da-7ec7-4b14-9273-a22f50196c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:29.351443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779270da-7ec7-4b14-9273-a22f50196c75 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:29.351723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779270da-7ec7-4b14-9273-a22f50196c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:29.351996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779270da-7ec7-4b14-9273-a22f50196c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:29.352709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779270da-7ec7-4b14-9273-a22f50196c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:29.354672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779270da-7ec7-4b14-9273-a22f50196c75 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:29.384037 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1157/2327] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:24:29 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:24:29.388609 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6d596-c0f1-453c-8af7-458474b178ab None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:29.400151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6d596-c0f1-453c-8af7-458474b178ab None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:29.432954 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:29.460190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769098c2-62b5-4cdf-9a8d-f96fd21194e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:29.460945 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769098c2-62b5-4cdf-9a8d-f96fd21194e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:29.461222 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769098c2-62b5-4cdf-9a8d-f96fd21194e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:29.461493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769098c2-62b5-4cdf-9a8d-f96fd21194e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:29.462241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769098c2-62b5-4cdf-9a8d-f96fd21194e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:29.464349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769098c2-62b5-4cdf-9a8d-f96fd21194e7 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:29.487503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1171/2328] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:24:29 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:24:29.493287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779270da-7ec7-4b14-9273-a22f50196c75 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:29.505063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779270da-7ec7-4b14-9273-a22f50196c75 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:29.510310 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17134b0f-1795-472a-be4d-6b6e44508e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:29.511045 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134b0f-1795-472a-be4d-6b6e44508e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:29.511324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134b0f-1795-472a-be4d-6b6e44508e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:29.511595 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134b0f-1795-472a-be4d-6b6e44508e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:29.512339 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17134b0f-1795-472a-be4d-6b6e44508e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:29.513982 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17134b0f-1795-472a-be4d-6b6e44508e69 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:29.525459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1158/2329] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:24:29.530458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769098c2-62b5-4cdf-9a8d-f96fd21194e7 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:29.546853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769098c2-62b5-4cdf-9a8d-f96fd21194e7 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:29.555708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013edb7-44d1-4640-abc1-eac02b07c847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:29.556571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013edb7-44d1-4640-abc1-eac02b07c847 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:29.556856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013edb7-44d1-4640-abc1-eac02b07c847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:29.557135 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013edb7-44d1-4640-abc1-eac02b07c847 admin admin] PATH_INFO: `/v3/projects/95f129ec5ee34bbb8588166bfb76a507/users/5312ffb6bffd4524a00f9795c2838534/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:29.573174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013edb7-44d1-4640-abc1-eac02b07c847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f129ec5ee34bbb8588166bfb76a507, user_id=5312ffb6bffd4524a00f9795c2838534, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:29.575945 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013edb7-44d1-4640-abc1-eac02b07c847 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:29.594688 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1172/2330] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:24:29 2022] PUT /identity/v3/projects/95f129ec5ee34bbb8588166bfb76a507/users/5312ffb6bffd4524a00f9795c2838534/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:29.601504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17134b0f-1795-472a-be4d-6b6e44508e69 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:29.617681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17134b0f-1795-472a-be4d-6b6e44508e69 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:29.653422 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:29.681168 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400b2d1-5ee8-44c0-88b6-26bf4e8099d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:29.681841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400b2d1-5ee8-44c0-88b6-26bf4e8099d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:29.682128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400b2d1-5ee8-44c0-88b6-26bf4e8099d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:29.682413 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400b2d1-5ee8-44c0-88b6-26bf4e8099d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:29.683196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400b2d1-5ee8-44c0-88b6-26bf4e8099d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:29.684808 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400b2d1-5ee8-44c0-88b6-26bf4e8099d0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:29.694695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1159/2331] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:24:29.699237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013edb7-44d1-4640-abc1-eac02b07c847 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:29.710303 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013edb7-44d1-4640-abc1-eac02b07c847 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:29.715432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7aa52-49a2-4063-9917-055b90d41ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:29.716317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7aa52-49a2-4063-9917-055b90d41ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:29.716597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7aa52-49a2-4063-9917-055b90d41ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:29.716869 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7aa52-49a2-4063-9917-055b90d41ec3 admin admin] PATH_INFO: `/v3/projects/95f129ec5ee34bbb8588166bfb76a507/users/5312ffb6bffd4524a00f9795c2838534/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:29.718892 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7aa52-49a2-4063-9917-055b90d41ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f129ec5ee34bbb8588166bfb76a507, user_id=5312ffb6bffd4524a00f9795c2838534, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:29.721551 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7aa52-49a2-4063-9917-055b90d41ec3 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:29.732022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1173/2332] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:24:29 2022] PUT /identity/v3/projects/95f129ec5ee34bbb8588166bfb76a507/users/5312ffb6bffd4524a00f9795c2838534/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:29.742208 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96786-88b4-454c-9f4d-7937711b7b90 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:29.742533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96786-88b4-454c-9f4d-7937711b7b90 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:29.742809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96786-88b4-454c-9f4d-7937711b7b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:29.781252 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-07b96786-88b4-454c-9f4d-7937711b7b90 None None] MFA Rules not processed for user `5312ffb6bffd4524a00f9795c2838534`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:29.783310 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-07b96786-88b4-454c-9f4d-7937711b7b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:29.874355 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1160/2333] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:29.887396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7aa52-49a2-4063-9917-055b90d41ec3 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:29.889355 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5ee7aa52-49a2-4063-9917-055b90d41ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:29.957860 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7aa52-49a2-4063-9917-055b90d41ec3 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:29.962943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c0660-aedd-4bb5-8e75-7298c4676e09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:29.963980 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c0660-aedd-4bb5-8e75-7298c4676e09 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:29.964249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c0660-aedd-4bb5-8e75-7298c4676e09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:29.964560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c0660-aedd-4bb5-8e75-7298c4676e09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:30.021574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c0660-aedd-4bb5-8e75-7298c4676e09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:30.023077 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c0660-aedd-4bb5-8e75-7298c4676e09 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:30.034873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1174/2334] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:24:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:24:32.631028 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b96786-88b4-454c-9f4d-7937711b7b90 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:32.641326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b96786-88b4-454c-9f4d-7937711b7b90 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:32.645452 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e119b-2da9-42f2-b5a0-f21dc1d8d0c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:32.646093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e119b-2da9-42f2-b5a0-f21dc1d8d0c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:32.646379 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e119b-2da9-42f2-b5a0-f21dc1d8d0c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:32.646690 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e119b-2da9-42f2-b5a0-f21dc1d8d0c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:32.656273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e119b-2da9-42f2-b5a0-f21dc1d8d0c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:32.657753 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e119b-2da9-42f2-b5a0-f21dc1d8d0c4 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:32.672370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1161/2335] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:24:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:24:40.028606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:42.664324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=53 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:45.397190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c0660-aedd-4bb5-8e75-7298c4676e09 service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:45.470097 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c0660-aedd-4bb5-8e75-7298c4676e09 service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:45.475513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c5b60-91aa-4892-ab22-b4b4481c3dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:45.476659 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c5b60-91aa-4892-ab22-b4b4481c3dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:45.477502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c5b60-91aa-4892-ab22-b4b4481c3dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:45.477502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c5b60-91aa-4892-ab22-b4b4481c3dd7 admin admin] PATH_INFO: `/v3/users/45cf4567c4c64d848451f920732dfaba` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:45.478635 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c5b60-91aa-4892-ab22-b4b4481c3dd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45cf4567c4c64d848451f920732dfaba)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:45.481442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c5b60-91aa-4892-ab22-b4b4481c3dd7 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:45.534804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-802c5b60-91aa-4892-ab22-b4b4481c3dd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45cf4567c4c64d848451f920732dfaba'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:45.543473 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-802c5b60-91aa-4892-ab22-b4b4481c3dd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45cf4567c4c64d848451f920732dfaba'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:45.544278 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-802c5b60-91aa-4892-ab22-b4b4481c3dd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45cf4567c4c64d848451f920732dfaba'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:45.557140 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-802c5b60-91aa-4892-ab22-b4b4481c3dd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45cf4567c4c64d848451f920732dfaba'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:45.564439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-802c5b60-91aa-4892-ab22-b4b4481c3dd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45cf4567c4c64d848451f920732dfaba'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:45.570948 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1175/2336] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:24:45 2022] DELETE /identity/v3/users/45cf4567c4c64d848451f920732dfaba => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:24:45.575845 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624956a-1032-4849-80ec-f618e4f79c7d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:45.576335 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624956a-1032-4849-80ec-f618e4f79c7d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:45.576451 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624956a-1032-4849-80ec-f618e4f79c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:45.595148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5624956a-1032-4849-80ec-f618e4f79c7d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:45.596411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5624956a-1032-4849-80ec-f618e4f79c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:45.662414 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1162/2337] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:45.673768 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c5b60-91aa-4892-ab22-b4b4481c3dd7 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:45.675984 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-802c5b60-91aa-4892-ab22-b4b4481c3dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:45.737517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c5b60-91aa-4892-ab22-b4b4481c3dd7 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:45.741081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959afb36-4aad-4c4c-93f5-88b2f7960448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:45.741766 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959afb36-4aad-4c4c-93f5-88b2f7960448 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:45.742044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959afb36-4aad-4c4c-93f5-88b2f7960448 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:45.742312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959afb36-4aad-4c4c-93f5-88b2f7960448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:45.752734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959afb36-4aad-4c4c-93f5-88b2f7960448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:45.754163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959afb36-4aad-4c4c-93f5-88b2f7960448 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:45.764345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1176/2338] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:24:46.078981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624956a-1032-4849-80ec-f618e4f79c7d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:46.080323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5624956a-1032-4849-80ec-f618e4f79c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:46.093810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624956a-1032-4849-80ec-f618e4f79c7d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:46.100195 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab6228-4843-46c8-bd73-1f4d5e26948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:46.101144 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab6228-4843-46c8-bd73-1f4d5e26948d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:46.101428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab6228-4843-46c8-bd73-1f4d5e26948d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:46.101698 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab6228-4843-46c8-bd73-1f4d5e26948d admin admin] PATH_INFO: `/v3/projects/ce33c8f087084a5bb171cc832beed343` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:46.103156 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab6228-4843-46c8-bd73-1f4d5e26948d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce33c8f087084a5bb171cc832beed343)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:46.105108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab6228-4843-46c8-bd73-1f4d5e26948d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:46.158868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-aeab6228-4843-46c8-bd73-1f4d5e26948d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce33c8f087084a5bb171cc832beed343', 'request_id': 'req-aeab6228-4843-46c8-bd73-1f4d5e26948d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:46.164720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-aeab6228-4843-46c8-bd73-1f4d5e26948d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce33c8f087084a5bb171cc832beed343', 'request_id': 'req-aeab6228-4843-46c8-bd73-1f4d5e26948d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:46.171720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-aeab6228-4843-46c8-bd73-1f4d5e26948d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce33c8f087084a5bb171cc832beed343', 'request_id': 'req-aeab6228-4843-46c8-bd73-1f4d5e26948d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:46.193963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-aeab6228-4843-46c8-bd73-1f4d5e26948d admin admin] The token cache is being invalidate because project ce33c8f087084a5bb171cc832beed343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:24:46.194337 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-aeab6228-4843-46c8-bd73-1f4d5e26948d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:46.195054 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-aeab6228-4843-46c8-bd73-1f4d5e26948d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:46.196828 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1163/2339] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:24:46 2022] DELETE /identity/v3/projects/ce33c8f087084a5bb171cc832beed343 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:46.201112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959afb36-4aad-4c4c-93f5-88b2f7960448 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:46.212471 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959afb36-4aad-4c4c-93f5-88b2f7960448 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:46.233345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:46.275171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7054f-1271-4668-b3a3-8e7c66d9e9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:46.276147 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7054f-1271-4668-b3a3-8e7c66d9e9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:46.276431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7054f-1271-4668-b3a3-8e7c66d9e9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:46.276705 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7054f-1271-4668-b3a3-8e7c66d9e9b2 admin admin] PATH_INFO: `/v3/users/5312ffb6bffd4524a00f9795c2838534` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:46.278098 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7054f-1271-4668-b3a3-8e7c66d9e9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5312ffb6bffd4524a00f9795c2838534)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:46.280200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7054f-1271-4668-b3a3-8e7c66d9e9b2 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:46.333647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-dce7054f-1271-4668-b3a3-8e7c66d9e9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5312ffb6bffd4524a00f9795c2838534'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:46.341547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-dce7054f-1271-4668-b3a3-8e7c66d9e9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5312ffb6bffd4524a00f9795c2838534'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:46.342222 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-dce7054f-1271-4668-b3a3-8e7c66d9e9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5312ffb6bffd4524a00f9795c2838534'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:46.356022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-dce7054f-1271-4668-b3a3-8e7c66d9e9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5312ffb6bffd4524a00f9795c2838534'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:46.363108 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-dce7054f-1271-4668-b3a3-8e7c66d9e9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5312ffb6bffd4524a00f9795c2838534'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:46.369880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1177/2340] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:24:46 2022] DELETE /identity/v3/users/5312ffb6bffd4524a00f9795c2838534 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:46.687609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab6228-4843-46c8-bd73-1f4d5e26948d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:46.688435 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-aeab6228-4843-46c8-bd73-1f4d5e26948d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:46.706844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab6228-4843-46c8-bd73-1f4d5e26948d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:46.787048 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1a399-a06c-4f0a-b1e7-f28ba49dfaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:46.787861 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1a399-a06c-4f0a-b1e7-f28ba49dfaed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:46.788146 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1a399-a06c-4f0a-b1e7-f28ba49dfaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:46.788426 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1a399-a06c-4f0a-b1e7-f28ba49dfaed admin admin] PATH_INFO: `/v3/projects/95f129ec5ee34bbb8588166bfb76a507` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:46.789649 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1a399-a06c-4f0a-b1e7-f28ba49dfaed admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f129ec5ee34bbb8588166bfb76a507)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:46.791734 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc1a399-a06c-4f0a-b1e7-f28ba49dfaed admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:46.825706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:46.844292 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bcc1a399-a06c-4f0a-b1e7-f28ba49dfaed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f129ec5ee34bbb8588166bfb76a507', 'request_id': 'req-bcc1a399-a06c-4f0a-b1e7-f28ba49dfaed'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:46.850590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bcc1a399-a06c-4f0a-b1e7-f28ba49dfaed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f129ec5ee34bbb8588166bfb76a507', 'request_id': 'req-bcc1a399-a06c-4f0a-b1e7-f28ba49dfaed'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:46.857580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bcc1a399-a06c-4f0a-b1e7-f28ba49dfaed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f129ec5ee34bbb8588166bfb76a507', 'request_id': 'req-bcc1a399-a06c-4f0a-b1e7-f28ba49dfaed'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:46.873173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bcc1a399-a06c-4f0a-b1e7-f28ba49dfaed admin admin] The token cache is being invalidate because project 95f129ec5ee34bbb8588166bfb76a507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:24:46.873456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bcc1a399-a06c-4f0a-b1e7-f28ba49dfaed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:46.874099 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bcc1a399-a06c-4f0a-b1e7-f28ba49dfaed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:46.875681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1164/2341] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:24:46 2022] DELETE /identity/v3/projects/95f129ec5ee34bbb8588166bfb76a507 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:24:46.881193 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fc3a8-9e06-4762-828a-f67ee73f3683 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:46.881798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fc3a8-9e06-4762-828a-f67ee73f3683 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:46.881798 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fc3a8-9e06-4762-828a-f67ee73f3683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:46.902551 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-f99fc3a8-9e06-4762-828a-f67ee73f3683 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:46.903964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f99fc3a8-9e06-4762-828a-f67ee73f3683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:46.965575 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1178/2342] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:46.973532 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ad10d-aff8-4ab2-b9c2-c685b2f29f38 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:46.973816 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ad10d-aff8-4ab2-b9c2-c685b2f29f38 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:46.974125 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ad10d-aff8-4ab2-b9c2-c685b2f29f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:46.993936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-087ad10d-aff8-4ab2-b9c2-c685b2f29f38 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:46.995543 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-087ad10d-aff8-4ab2-b9c2-c685b2f29f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:47.004012 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1165/2343] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:47.008521 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fc3a8-9e06-4762-828a-f67ee73f3683 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:47.018819 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fc3a8-9e06-4762-828a-f67ee73f3683 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:47.023837 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48c121-0109-4766-9f2a-f4fcbf0f2fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:47.024698 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48c121-0109-4766-9f2a-f4fcbf0f2fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:47.025108 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48c121-0109-4766-9f2a-f4fcbf0f2fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:47.025531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48c121-0109-4766-9f2a-f4fcbf0f2fd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:47.026282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48c121-0109-4766-9f2a-f4fcbf0f2fd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:24:47.026619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48c121-0109-4766-9f2a-f4fcbf0f2fd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:47.028639 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48c121-0109-4766-9f2a-f4fcbf0f2fd1 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:47.042832 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1179/2344] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:24:47.048568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ad10d-aff8-4ab2-b9c2-c685b2f29f38 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:47.060538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ad10d-aff8-4ab2-b9c2-c685b2f29f38 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:47.066208 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01b1ec-052b-4501-a715-d659b38e41e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:47.066909 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01b1ec-052b-4501-a715-d659b38e41e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:47.067184 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01b1ec-052b-4501-a715-d659b38e41e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:47.067452 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01b1ec-052b-4501-a715-d659b38e41e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:47.068146 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01b1ec-052b-4501-a715-d659b38e41e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:47.070062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01b1ec-052b-4501-a715-d659b38e41e5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:47.101817 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1166/2345] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:24:47 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:24:47.106836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48c121-0109-4766-9f2a-f4fcbf0f2fd1 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:47.117452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48c121-0109-4766-9f2a-f4fcbf0f2fd1 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:47.152707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:47.186706 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ec84a-b4b0-4e8d-802e-c2040044dc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:47.187388 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ec84a-b4b0-4e8d-802e-c2040044dc49 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:47.187672 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ec84a-b4b0-4e8d-802e-c2040044dc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:47.187952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ec84a-b4b0-4e8d-802e-c2040044dc49 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:47.188647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ec84a-b4b0-4e8d-802e-c2040044dc49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:47.190793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270ec84a-b4b0-4e8d-802e-c2040044dc49 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:47.216017 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1180/2346] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:24:47 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:24:47.221339 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01b1ec-052b-4501-a715-d659b38e41e5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:47.232541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01b1ec-052b-4501-a715-d659b38e41e5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:47.237562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68de491-99ee-41f1-9d92-430a34b42a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:47.238259 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68de491-99ee-41f1-9d92-430a34b42a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:47.238628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68de491-99ee-41f1-9d92-430a34b42a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:47.238918 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68de491-99ee-41f1-9d92-430a34b42a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:47.239692 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68de491-99ee-41f1-9d92-430a34b42a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:47.241393 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68de491-99ee-41f1-9d92-430a34b42a92 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:47.253169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1167/2347] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:24:47.257443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ec84a-b4b0-4e8d-802e-c2040044dc49 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:47.268317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ec84a-b4b0-4e8d-802e-c2040044dc49 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:47.274020 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225637cf-5459-4062-80d9-b42720f28b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:47.274729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225637cf-5459-4062-80d9-b42720f28b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:47.275008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225637cf-5459-4062-80d9-b42720f28b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:47.275279 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225637cf-5459-4062-80d9-b42720f28b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:47.276054 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225637cf-5459-4062-80d9-b42720f28b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:47.277696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225637cf-5459-4062-80d9-b42720f28b79 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:47.289173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1181/2348] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:24:47.293591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68de491-99ee-41f1-9d92-430a34b42a92 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:47.304106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68de491-99ee-41f1-9d92-430a34b42a92 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:47.309137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ee24e-58c9-488f-8e2e-2f41c449dd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:47.310019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee24e-58c9-488f-8e2e-2f41c449dd08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:47.310297 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee24e-58c9-488f-8e2e-2f41c449dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:47.310604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee24e-58c9-488f-8e2e-2f41c449dd08 admin admin] PATH_INFO: `/v3/projects/b897df1cec81483abeff5e62929039cb/users/5396f6f09cf24ee7b9b8d641a1dc9c3c/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:47.327666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ee24e-58c9-488f-8e2e-2f41c449dd08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b897df1cec81483abeff5e62929039cb, user_id=5396f6f09cf24ee7b9b8d641a1dc9c3c, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:47.330340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ee24e-58c9-488f-8e2e-2f41c449dd08 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:47.348530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1168/2349] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:24:47 2022] PUT /identity/v3/projects/b897df1cec81483abeff5e62929039cb/users/5396f6f09cf24ee7b9b8d641a1dc9c3c/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:47.365063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ee600-73c4-4fca-84ec-949aa48e5e3e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:47.365401 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ee600-73c4-4fca-84ec-949aa48e5e3e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:47.365787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ee600-73c4-4fca-84ec-949aa48e5e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:47.395857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-941ee600-73c4-4fca-84ec-949aa48e5e3e None None] MFA Rules not processed for user `5396f6f09cf24ee7b9b8d641a1dc9c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:47.397074 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-941ee600-73c4-4fca-84ec-949aa48e5e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:47.489021 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1182/2350] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:47.494757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ee24e-58c9-488f-8e2e-2f41c449dd08 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:47.563784 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ee24e-58c9-488f-8e2e-2f41c449dd08 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:47.568679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76544e0-ccea-4bf6-9873-5db4317f03d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:47.569331 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76544e0-ccea-4bf6-9873-5db4317f03d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:47.569617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76544e0-ccea-4bf6-9873-5db4317f03d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:47.569891 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76544e0-ccea-4bf6-9873-5db4317f03d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:47.570639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76544e0-ccea-4bf6-9873-5db4317f03d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:47.572583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76544e0-ccea-4bf6-9873-5db4317f03d1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:47.599940 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1169/2351] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:24:47 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:24:47.605457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ee600-73c4-4fca-84ec-949aa48e5e3e None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:47.618581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ee600-73c4-4fca-84ec-949aa48e5e3e None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:47.686946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cf434-366f-400f-b98b-0dd13482f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:47.687742 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf434-366f-400f-b98b-0dd13482f2fc admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:47.688024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf434-366f-400f-b98b-0dd13482f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:47.688424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95cf434-366f-400f-b98b-0dd13482f2fc admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:47.689196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cf434-366f-400f-b98b-0dd13482f2fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:47.691274 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95cf434-366f-400f-b98b-0dd13482f2fc admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:47.712828 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1183/2352] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:24:47 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:24:47.716997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76544e0-ccea-4bf6-9873-5db4317f03d1 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:47.728255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76544e0-ccea-4bf6-9873-5db4317f03d1 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:47.736686 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ba401-c9da-4e01-bdfe-1da982c20c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:47.736686 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ba401-c9da-4e01-bdfe-1da982c20c76 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:47.736686 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ba401-c9da-4e01-bdfe-1da982c20c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:47.736686 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ba401-c9da-4e01-bdfe-1da982c20c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:47.737382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ba401-c9da-4e01-bdfe-1da982c20c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:47.739091 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ba401-c9da-4e01-bdfe-1da982c20c76 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:47.751380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1170/2353] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:24:47.756478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cf434-366f-400f-b98b-0dd13482f2fc admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:47.766822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95cf434-366f-400f-b98b-0dd13482f2fc admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:47.779818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748ab85-98b1-4659-a018-cbf3b2731fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:47.780762 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748ab85-98b1-4659-a018-cbf3b2731fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:47.781040 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748ab85-98b1-4659-a018-cbf3b2731fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:47.781315 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748ab85-98b1-4659-a018-cbf3b2731fa3 admin admin] PATH_INFO: `/v3/projects/e6c75423e43749da936818e9ebeffd2c/users/9be7cc4914aa40dca3b5f594d671e408/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:47.808009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748ab85-98b1-4659-a018-cbf3b2731fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c75423e43749da936818e9ebeffd2c, user_id=9be7cc4914aa40dca3b5f594d671e408, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:47.810714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748ab85-98b1-4659-a018-cbf3b2731fa3 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:47.827618 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1184/2354] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:24:47 2022] PUT /identity/v3/projects/e6c75423e43749da936818e9ebeffd2c/users/9be7cc4914aa40dca3b5f594d671e408/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:24:47.832084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ba401-c9da-4e01-bdfe-1da982c20c76 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:47.842717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ba401-c9da-4e01-bdfe-1da982c20c76 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:47.865423 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:47.910046 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3ae58-59db-43e6-bd61-7baba6b5de16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:47.910788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3ae58-59db-43e6-bd61-7baba6b5de16 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:47.911070 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3ae58-59db-43e6-bd61-7baba6b5de16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:47.911340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3ae58-59db-43e6-bd61-7baba6b5de16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:47.912080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3ae58-59db-43e6-bd61-7baba6b5de16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:47.913706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3ae58-59db-43e6-bd61-7baba6b5de16 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:47.925434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1171/2355] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:24:47.929752 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748ab85-98b1-4659-a018-cbf3b2731fa3 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:47.936913 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:47.944404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748ab85-98b1-4659-a018-cbf3b2731fa3 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:47.953709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268940d0-e117-4f6d-bd4f-498d598a68d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:47.954828 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268940d0-e117-4f6d-bd4f-498d598a68d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:47.955114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268940d0-e117-4f6d-bd4f-498d598a68d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:47.955406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268940d0-e117-4f6d-bd4f-498d598a68d0 admin admin] PATH_INFO: `/v3/projects/e6c75423e43749da936818e9ebeffd2c/users/9be7cc4914aa40dca3b5f594d671e408/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:47.957442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268940d0-e117-4f6d-bd4f-498d598a68d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c75423e43749da936818e9ebeffd2c, user_id=9be7cc4914aa40dca3b5f594d671e408, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:47.960151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268940d0-e117-4f6d-bd4f-498d598a68d0 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:47.973241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1185/2356] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:24:47 2022] PUT /identity/v3/projects/e6c75423e43749da936818e9ebeffd2c/users/9be7cc4914aa40dca3b5f594d671e408/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:47.983564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbb928-1ee6-4a94-8082-535196f24d7b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:47.983854 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbb928-1ee6-4a94-8082-535196f24d7b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:47.984134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbb928-1ee6-4a94-8082-535196f24d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:48.012718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4cdbb928-1ee6-4a94-8082-535196f24d7b None None] MFA Rules not processed for user `9be7cc4914aa40dca3b5f594d671e408`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:48.013989 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4cdbb928-1ee6-4a94-8082-535196f24d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:48.093008 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1172/2357] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:48.104621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268940d0-e117-4f6d-bd4f-498d598a68d0 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:48.106581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-268940d0-e117-4f6d-bd4f-498d598a68d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:48.166351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268940d0-e117-4f6d-bd4f-498d598a68d0 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:48.170330 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df70c0-6deb-42a7-843d-f10792ede50e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:48.171059 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df70c0-6deb-42a7-843d-f10792ede50e service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:48.171365 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df70c0-6deb-42a7-843d-f10792ede50e service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:48.171641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df70c0-6deb-42a7-843d-f10792ede50e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:48.231269 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df70c0-6deb-42a7-843d-f10792ede50e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:48.232795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df70c0-6deb-42a7-843d-f10792ede50e service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:48.242335 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1186/2358] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:24:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:24:48.944134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbb928-1ee6-4a94-8082-535196f24d7b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:48.945602 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4cdbb928-1ee6-4a94-8082-535196f24d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:48.959066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbb928-1ee6-4a94-8082-535196f24d7b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:48.963550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a84f92-84dc-4235-8675-da7936a3a385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:48.964226 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a84f92-84dc-4235-8675-da7936a3a385 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:48.964577 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a84f92-84dc-4235-8675-da7936a3a385 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:48.964893 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a84f92-84dc-4235-8675-da7936a3a385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:48.968585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b6a84f92-84dc-4235-8675-da7936a3a385 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:49.039434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a84f92-84dc-4235-8675-da7936a3a385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:49.040806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a84f92-84dc-4235-8675-da7936a3a385 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:49.050353 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1173/2359] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:24:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:24:49.601669 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df70c0-6deb-42a7-843d-f10792ede50e service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:49.616462 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df70c0-6deb-42a7-843d-f10792ede50e service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:49.622345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6db830-d305-44d9-b1fb-3b3a46df5dc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:49.623102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6db830-d305-44d9-b1fb-3b3a46df5dc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:49.623388 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6db830-d305-44d9-b1fb-3b3a46df5dc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:49.623667 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6db830-d305-44d9-b1fb-3b3a46df5dc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:49.634877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6db830-d305-44d9-b1fb-3b3a46df5dc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:49.636607 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6db830-d305-44d9-b1fb-3b3a46df5dc3 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:49.647638 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1187/2360] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:24:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:24:53.457193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a84f92-84dc-4235-8675-da7936a3a385 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:53.507726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:53.526216 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a84f92-84dc-4235-8675-da7936a3a385 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:53.531341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90607ac-aed6-444c-b441-818cef54ee69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:53.532252 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90607ac-aed6-444c-b441-818cef54ee69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:53.532532 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90607ac-aed6-444c-b441-818cef54ee69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:53.532810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90607ac-aed6-444c-b441-818cef54ee69 admin admin] PATH_INFO: `/v3/users/5396f6f09cf24ee7b9b8d641a1dc9c3c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:53.534005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90607ac-aed6-444c-b441-818cef54ee69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5396f6f09cf24ee7b9b8d641a1dc9c3c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:53.536340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90607ac-aed6-444c-b441-818cef54ee69 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:53.588787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e90607ac-aed6-444c-b441-818cef54ee69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5396f6f09cf24ee7b9b8d641a1dc9c3c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:53.598181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e90607ac-aed6-444c-b441-818cef54ee69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5396f6f09cf24ee7b9b8d641a1dc9c3c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:53.598968 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e90607ac-aed6-444c-b441-818cef54ee69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5396f6f09cf24ee7b9b8d641a1dc9c3c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:53.612148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e90607ac-aed6-444c-b441-818cef54ee69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5396f6f09cf24ee7b9b8d641a1dc9c3c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:53.621726 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e90607ac-aed6-444c-b441-818cef54ee69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5396f6f09cf24ee7b9b8d641a1dc9c3c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:53.628429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1174/2361] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:24:53 2022] DELETE /identity/v3/users/5396f6f09cf24ee7b9b8d641a1dc9c3c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:53.633109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8fa86-9dd0-4a16-9eba-5e74bed898e8 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:53.633586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8fa86-9dd0-4a16-9eba-5e74bed898e8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:53.633699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8fa86-9dd0-4a16-9eba-5e74bed898e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:53.653247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-17e8fa86-9dd0-4a16-9eba-5e74bed898e8 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:53.654521 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-17e8fa86-9dd0-4a16-9eba-5e74bed898e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:53.718770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1188/2362] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:24:53.728780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90607ac-aed6-444c-b441-818cef54ee69 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:53.730659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e90607ac-aed6-444c-b441-818cef54ee69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:53.824617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90607ac-aed6-444c-b441-818cef54ee69 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:53.837675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e95c68-c4ee-4e8b-9034-72bef254dfd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:53.838423 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e95c68-c4ee-4e8b-9034-72bef254dfd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:53.838715 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e95c68-c4ee-4e8b-9034-72bef254dfd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:53.838993 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e95c68-c4ee-4e8b-9034-72bef254dfd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:53.886063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e95c68-c4ee-4e8b-9034-72bef254dfd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:53.891075 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e95c68-c4ee-4e8b-9034-72bef254dfd5 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:53.921861 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1175/2363] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:24:54.503473 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8fa86-9dd0-4a16-9eba-5e74bed898e8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:54.505819 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-17e8fa86-9dd0-4a16-9eba-5e74bed898e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:54.525868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8fa86-9dd0-4a16-9eba-5e74bed898e8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:54.532341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d88052-417e-487c-ae9e-ea02a41241ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:54.533581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d88052-417e-487c-ae9e-ea02a41241ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:54.534107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d88052-417e-487c-ae9e-ea02a41241ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:54.534620 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d88052-417e-487c-ae9e-ea02a41241ff admin admin] PATH_INFO: `/v3/projects/b897df1cec81483abeff5e62929039cb` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:54.539815 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d88052-417e-487c-ae9e-ea02a41241ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b897df1cec81483abeff5e62929039cb)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:54.544142 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d88052-417e-487c-ae9e-ea02a41241ff admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:54.627551 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:54.655311 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f6d88052-417e-487c-ae9e-ea02a41241ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b897df1cec81483abeff5e62929039cb', 'request_id': 'req-f6d88052-417e-487c-ae9e-ea02a41241ff'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:54.661559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f6d88052-417e-487c-ae9e-ea02a41241ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b897df1cec81483abeff5e62929039cb', 'request_id': 'req-f6d88052-417e-487c-ae9e-ea02a41241ff'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:54.671839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f6d88052-417e-487c-ae9e-ea02a41241ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b897df1cec81483abeff5e62929039cb', 'request_id': 'req-f6d88052-417e-487c-ae9e-ea02a41241ff'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:54.688231 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f6d88052-417e-487c-ae9e-ea02a41241ff admin admin] The token cache is being invalidate because project b897df1cec81483abeff5e62929039cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:24:54.688522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f6d88052-417e-487c-ae9e-ea02a41241ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:54.689145 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f6d88052-417e-487c-ae9e-ea02a41241ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:54.691087 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1189/2364] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:24:54 2022] DELETE /identity/v3/projects/b897df1cec81483abeff5e62929039cb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:54.695063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e95c68-c4ee-4e8b-9034-72bef254dfd5 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:54.705701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e95c68-c4ee-4e8b-9034-72bef254dfd5 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:54.767803 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057d61d-75ed-482f-952b-396d968a53cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:54.769574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057d61d-75ed-482f-952b-396d968a53cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:54.769574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057d61d-75ed-482f-952b-396d968a53cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:54.769574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057d61d-75ed-482f-952b-396d968a53cf admin admin] PATH_INFO: `/v3/users/9be7cc4914aa40dca3b5f594d671e408` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:54.770677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057d61d-75ed-482f-952b-396d968a53cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be7cc4914aa40dca3b5f594d671e408)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:54.773084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057d61d-75ed-482f-952b-396d968a53cf admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:54.780272 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:54.834827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0057d61d-75ed-482f-952b-396d968a53cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be7cc4914aa40dca3b5f594d671e408'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:54.844219 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0057d61d-75ed-482f-952b-396d968a53cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be7cc4914aa40dca3b5f594d671e408'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:54.844955 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0057d61d-75ed-482f-952b-396d968a53cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be7cc4914aa40dca3b5f594d671e408'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:54.863351 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0057d61d-75ed-482f-952b-396d968a53cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be7cc4914aa40dca3b5f594d671e408'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:54.876246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0057d61d-75ed-482f-952b-396d968a53cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be7cc4914aa40dca3b5f594d671e408'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:54.885062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1176/2365] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:24:54 2022] DELETE /identity/v3/users/9be7cc4914aa40dca3b5f594d671e408 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:55.260658 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d88052-417e-487c-ae9e-ea02a41241ff admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:55.263263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f6d88052-417e-487c-ae9e-ea02a41241ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:55.284209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d88052-417e-487c-ae9e-ea02a41241ff admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:55.369019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54acf82-0abe-4dd0-8785-b2c5f11d2015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:55.371394 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54acf82-0abe-4dd0-8785-b2c5f11d2015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:55.371903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54acf82-0abe-4dd0-8785-b2c5f11d2015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:55.372364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54acf82-0abe-4dd0-8785-b2c5f11d2015 admin admin] PATH_INFO: `/v3/projects/e6c75423e43749da936818e9ebeffd2c` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:55.374843 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54acf82-0abe-4dd0-8785-b2c5f11d2015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c75423e43749da936818e9ebeffd2c)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:55.386288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54acf82-0abe-4dd0-8785-b2c5f11d2015 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:55.511429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c54acf82-0abe-4dd0-8785-b2c5f11d2015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c75423e43749da936818e9ebeffd2c', 'request_id': 'req-c54acf82-0abe-4dd0-8785-b2c5f11d2015'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:55.519146 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c54acf82-0abe-4dd0-8785-b2c5f11d2015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c75423e43749da936818e9ebeffd2c', 'request_id': 'req-c54acf82-0abe-4dd0-8785-b2c5f11d2015'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:55.526737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c54acf82-0abe-4dd0-8785-b2c5f11d2015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c75423e43749da936818e9ebeffd2c', 'request_id': 'req-c54acf82-0abe-4dd0-8785-b2c5f11d2015'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:55.545108 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c54acf82-0abe-4dd0-8785-b2c5f11d2015 admin admin] The token cache is being invalidate because project e6c75423e43749da936818e9ebeffd2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:24:55.545407 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c54acf82-0abe-4dd0-8785-b2c5f11d2015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:55.546062 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c54acf82-0abe-4dd0-8785-b2c5f11d2015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:24:55.548078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1190/2366] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:24:55 2022] DELETE /identity/v3/projects/e6c75423e43749da936818e9ebeffd2c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:55.553678 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dec2f-cbce-4cc7-8df7-3d3998bfaafa None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:55.553973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dec2f-cbce-4cc7-8df7-3d3998bfaafa None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:55.554252 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dec2f-cbce-4cc7-8df7-3d3998bfaafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:55.573315 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-606dec2f-cbce-4cc7-8df7-3d3998bfaafa None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:55.574167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-606dec2f-cbce-4cc7-8df7-3d3998bfaafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:55.650648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1177/2367] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:55.657661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8bc8b-6497-4a1c-a159-4ac39574e6bb None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:55.658305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8bc8b-6497-4a1c-a159-4ac39574e6bb None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:55.658305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8bc8b-6497-4a1c-a159-4ac39574e6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:55.688187 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-fdc8bc8b-6497-4a1c-a159-4ac39574e6bb None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:55.689796 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-fdc8bc8b-6497-4a1c-a159-4ac39574e6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:55.708803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1191/2368] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:55.709886 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dec2f-cbce-4cc7-8df7-3d3998bfaafa None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:55.720889 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dec2f-cbce-4cc7-8df7-3d3998bfaafa None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:55.726260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ab851-b53e-4484-b75c-329896d77722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:55.727121 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ab851-b53e-4484-b75c-329896d77722 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:55.727563 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ab851-b53e-4484-b75c-329896d77722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:55.731066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ab851-b53e-4484-b75c-329896d77722 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:55.731862 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ab851-b53e-4484-b75c-329896d77722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:24:55.732176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ab851-b53e-4484-b75c-329896d77722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:55.733822 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ab851-b53e-4484-b75c-329896d77722 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:55.749503 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1178/2369] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:24:55.754141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8bc8b-6497-4a1c-a159-4ac39574e6bb None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:55.766009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8bc8b-6497-4a1c-a159-4ac39574e6bb None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:55.772592 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9e5d7-26a5-4861-a50d-63244f8651f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:55.773558 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9e5d7-26a5-4861-a50d-63244f8651f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:55.774075 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9e5d7-26a5-4861-a50d-63244f8651f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:55.774600 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9e5d7-26a5-4861-a50d-63244f8651f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:55.775574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9e5d7-26a5-4861-a50d-63244f8651f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:55.777789 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9e5d7-26a5-4861-a50d-63244f8651f0 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:55.809642 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1192/2370] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:24:55 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:24:55.813924 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ab851-b53e-4484-b75c-329896d77722 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:55.824667 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ab851-b53e-4484-b75c-329896d77722 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:55.896456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5c8a2-c85b-4ae2-b62a-c935ed2532c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:55.897487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5c8a2-c85b-4ae2-b62a-c935ed2532c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:55.897966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5c8a2-c85b-4ae2-b62a-c935ed2532c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:55.898490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5c8a2-c85b-4ae2-b62a-c935ed2532c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:55.899418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5c8a2-c85b-4ae2-b62a-c935ed2532c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:55.901578 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5c8a2-c85b-4ae2-b62a-c935ed2532c3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:55.943612 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1179/2371] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:24:55 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:24:55.947653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9e5d7-26a5-4861-a50d-63244f8651f0 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:55.958691 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9e5d7-26a5-4861-a50d-63244f8651f0 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:55.964379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029e063-3e79-4dec-95ae-bf2ff70d2666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:55.965146 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029e063-3e79-4dec-95ae-bf2ff70d2666 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:55.965746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029e063-3e79-4dec-95ae-bf2ff70d2666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:55.966359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029e063-3e79-4dec-95ae-bf2ff70d2666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:55.967444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029e063-3e79-4dec-95ae-bf2ff70d2666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:55.969053 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029e063-3e79-4dec-95ae-bf2ff70d2666 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:55.980243 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1193/2372] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:24:55.985155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5c8a2-c85b-4ae2-b62a-c935ed2532c3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:55.991431 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:56.002110 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5c8a2-c85b-4ae2-b62a-c935ed2532c3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:56.011226 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c4964-9cdc-4b83-bbce-88f6ab8deddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:56.012071 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c4964-9cdc-4b83-bbce-88f6ab8deddd admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:56.012366 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c4964-9cdc-4b83-bbce-88f6ab8deddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:56.013299 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c4964-9cdc-4b83-bbce-88f6ab8deddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:56.014160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c4964-9cdc-4b83-bbce-88f6ab8deddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:56.017240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c4964-9cdc-4b83-bbce-88f6ab8deddd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:56.038277 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1180/2373] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:24:56.039663 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029e063-3e79-4dec-95ae-bf2ff70d2666 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:56.047827 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:56.053502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029e063-3e79-4dec-95ae-bf2ff70d2666 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:56.061515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5830c4-2968-4d63-96ec-84721983a0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:56.062867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5830c4-2968-4d63-96ec-84721983a0d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:56.063358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5830c4-2968-4d63-96ec-84721983a0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:56.063849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5830c4-2968-4d63-96ec-84721983a0d6 admin admin] PATH_INFO: `/v3/projects/ac99d8a93cbe4d8db222e0ea8b46455e/users/da73a9e73d804bdb83ddd3698d0b3a99/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:56.082166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5830c4-2968-4d63-96ec-84721983a0d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac99d8a93cbe4d8db222e0ea8b46455e, user_id=da73a9e73d804bdb83ddd3698d0b3a99, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:56.085927 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5830c4-2968-4d63-96ec-84721983a0d6 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:56.105240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1194/2374] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:24:56 2022] PUT /identity/v3/projects/ac99d8a93cbe4d8db222e0ea8b46455e/users/da73a9e73d804bdb83ddd3698d0b3a99/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:56.107470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67707654-cce9-4eb7-9a9c-a23432978c16 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:56.107922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67707654-cce9-4eb7-9a9c-a23432978c16 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:56.108215 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67707654-cce9-4eb7-9a9c-a23432978c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:56.138765 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-67707654-cce9-4eb7-9a9c-a23432978c16 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:56.140243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-67707654-cce9-4eb7-9a9c-a23432978c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:56.221892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1181/2375] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:24:56.234725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5830c4-2968-4d63-96ec-84721983a0d6 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:56.236744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ca5830c4-2968-4d63-96ec-84721983a0d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:56.329362 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5830c4-2968-4d63-96ec-84721983a0d6 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:56.334281 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8536a-0a5b-4cc1-b588-b505a17333d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:56.335007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8536a-0a5b-4cc1-b588-b505a17333d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:56.335678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8536a-0a5b-4cc1-b588-b505a17333d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:56.335678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8536a-0a5b-4cc1-b588-b505a17333d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:56.346126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8536a-0a5b-4cc1-b588-b505a17333d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:56.347804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8536a-0a5b-4cc1-b588-b505a17333d4 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:56.363856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1195/2376] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:24:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:24:57.942716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26770fb-1d50-4147-bd62-96866a8e287c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:57.943660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26770fb-1d50-4147-bd62-96866a8e287c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:57.944110 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26770fb-1d50-4147-bd62-96866a8e287c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:57.944379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbce2fe-b5b8-4f5c-8def-ed33e2b17f59 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:57.944926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbce2fe-b5b8-4f5c-8def-ed33e2b17f59 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:57.945950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbce2fe-b5b8-4f5c-8def-ed33e2b17f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:57.985840 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-edbce2fe-b5b8-4f5c-8def-ed33e2b17f59 None None] MFA Rules not processed for user `e1852b1ef9cf4d168d0d1ebd3d65b7be`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:57.987104 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-edbce2fe-b5b8-4f5c-8def-ed33e2b17f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:57.999036 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d26770fb-1d50-4147-bd62-96866a8e287c None None] MFA Rules not processed for user `da73a9e73d804bdb83ddd3698d0b3a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:58.000376 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d26770fb-1d50-4147-bd62-96866a8e287c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:58.059101 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1196/2377] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:58.060803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be96ba7-2c0b-4aef-9db1-775195db987e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:58.061246 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be96ba7-2c0b-4aef-9db1-775195db987e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:58.061709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be96ba7-2c0b-4aef-9db1-775195db987e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:58.081232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-4be96ba7-2c0b-4aef-9db1-775195db987e None None] MFA Rules not processed for user `a19eb1f3c9e74f3c92755186a7a44ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:58.082765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-4be96ba7-2c0b-4aef-9db1-775195db987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:58.086258 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1182/2378] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:58.090888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26770fb-1d50-4147-bd62-96866a8e287c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:58.104629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26770fb-1d50-4147-bd62-96866a8e287c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:58.110544 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5980b-f2cd-4179-9a73-d9067c99403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:58.111315 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5980b-f2cd-4179-9a73-d9067c99403e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:58.111847 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5980b-f2cd-4179-9a73-d9067c99403e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:58.112318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5980b-f2cd-4179-9a73-d9067c99403e admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:58.113118 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5980b-f2cd-4179-9a73-d9067c99403e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:58.115193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5980b-f2cd-4179-9a73-d9067c99403e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:58.148193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1183/2379] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:24:58 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:24:58.152115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5980b-f2cd-4179-9a73-d9067c99403e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:58.161125 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1197/2380] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:58.222722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5980b-f2cd-4179-9a73-d9067c99403e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:58.227491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af94ea8-6330-42a3-87d7-4ecea2764ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:58.228446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af94ea8-6330-42a3-87d7-4ecea2764ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:58.228880 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af94ea8-6330-42a3-87d7-4ecea2764ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:58.229346 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af94ea8-6330-42a3-87d7-4ecea2764ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:58.230424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af94ea8-6330-42a3-87d7-4ecea2764ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:58.232190 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af94ea8-6330-42a3-87d7-4ecea2764ae0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:58.239238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:58.255626 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1184/2381] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:24:58 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:24:58.260464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be96ba7-2c0b-4aef-9db1-775195db987e None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:58.272211 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be96ba7-2c0b-4aef-9db1-775195db987e None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:58.277469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647ad29-a2f5-4e11-9594-94a4de19bef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:58.278061 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647ad29-a2f5-4e11-9594-94a4de19bef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:58.278347 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647ad29-a2f5-4e11-9594-94a4de19bef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:58.278657 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647ad29-a2f5-4e11-9594-94a4de19bef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:58.279399 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647ad29-a2f5-4e11-9594-94a4de19bef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:58.281011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647ad29-a2f5-4e11-9594-94a4de19bef7 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:58.291712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1198/2382] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:24:58.296152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af94ea8-6330-42a3-87d7-4ecea2764ae0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:58.309501 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af94ea8-6330-42a3-87d7-4ecea2764ae0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:58.314820 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69dbbf-778b-4019-894a-09987ecb6620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:58.315736 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69dbbf-778b-4019-894a-09987ecb6620 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:58.316023 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69dbbf-778b-4019-894a-09987ecb6620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:58.316309 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69dbbf-778b-4019-894a-09987ecb6620 admin admin] PATH_INFO: `/v3/projects/a139b35bcb884a508bf602ea0f4eb2fd/users/004cbf33be3b4a618adb370151d185c2/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:58.333051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69dbbf-778b-4019-894a-09987ecb6620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a139b35bcb884a508bf602ea0f4eb2fd, user_id=004cbf33be3b4a618adb370151d185c2, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:58.335839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69dbbf-778b-4019-894a-09987ecb6620 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:58.355185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1185/2383] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:24:58 2022] PUT /identity/v3/projects/a139b35bcb884a508bf602ea0f4eb2fd/users/004cbf33be3b4a618adb370151d185c2/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:24:58.359364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647ad29-a2f5-4e11-9594-94a4de19bef7 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:58.370429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647ad29-a2f5-4e11-9594-94a4de19bef7 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:58.395509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:58.442843 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac39ee-5007-406c-84a1-acb06ba0be6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:58.443625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac39ee-5007-406c-84a1-acb06ba0be6f admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:58.445014 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac39ee-5007-406c-84a1-acb06ba0be6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:58.445014 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac39ee-5007-406c-84a1-acb06ba0be6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:58.445822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac39ee-5007-406c-84a1-acb06ba0be6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:58.447536 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac39ee-5007-406c-84a1-acb06ba0be6f admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:58.461317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1199/2384] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:24:58.464753 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69dbbf-778b-4019-894a-09987ecb6620 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:58.475939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69dbbf-778b-4019-894a-09987ecb6620 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:58.481034 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358562d-f502-4dbe-94e5-412529712b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:58.482034 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358562d-f502-4dbe-94e5-412529712b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:58.483516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358562d-f502-4dbe-94e5-412529712b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:58.483901 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358562d-f502-4dbe-94e5-412529712b02 admin admin] PATH_INFO: `/v3/projects/a139b35bcb884a508bf602ea0f4eb2fd/users/004cbf33be3b4a618adb370151d185c2/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:58.486063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358562d-f502-4dbe-94e5-412529712b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a139b35bcb884a508bf602ea0f4eb2fd, user_id=004cbf33be3b4a618adb370151d185c2, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:58.488879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358562d-f502-4dbe-94e5-412529712b02 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:58.497178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac39ee-5007-406c-84a1-acb06ba0be6f admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:58.499110 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-64ac39ee-5007-406c-84a1-acb06ba0be6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:58.501098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1186/2385] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:24:58 2022] PUT /identity/v3/projects/a139b35bcb884a508bf602ea0f4eb2fd/users/004cbf33be3b4a618adb370151d185c2/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:24:58.578842 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac39ee-5007-406c-84a1-acb06ba0be6f admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:58.642931 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8e6e0-f960-4cba-839c-318a1e4c0459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:58.643599 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8e6e0-f960-4cba-839c-318a1e4c0459 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:58.644092 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8e6e0-f960-4cba-839c-318a1e4c0459 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:58.644238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8e6e0-f960-4cba-839c-318a1e4c0459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:58.646322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2cc8e6e0-f960-4cba-839c-318a1e4c0459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:58.657821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8e6e0-f960-4cba-839c-318a1e4c0459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:58.659381 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8e6e0-f960-4cba-839c-318a1e4c0459 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:58.669063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1200/2386] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:24:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:24:59.359125 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccd4a8-33f3-4c02-bf84-cda9d4705c87 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:59.359584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccd4a8-33f3-4c02-bf84-cda9d4705c87 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:59.360058 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccd4a8-33f3-4c02-bf84-cda9d4705c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:59.393187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-38ccd4a8-33f3-4c02-bf84-cda9d4705c87 None None] MFA Rules not processed for user `004cbf33be3b4a618adb370151d185c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:59.394508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-38ccd4a8-33f3-4c02-bf84-cda9d4705c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:59.489568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1187/2387] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:59 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:59.501702 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1213665-b1bf-4657-b67d-1d849e516b13 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:59.502719 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1213665-b1bf-4657-b67d-1d849e516b13 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:59.502719 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1213665-b1bf-4657-b67d-1d849e516b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:59.521496 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-c1213665-b1bf-4657-b67d-1d849e516b13 None None] MFA Rules not processed for user `da73a9e73d804bdb83ddd3698d0b3a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:24:59.522993 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c1213665-b1bf-4657-b67d-1d849e516b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:59.588340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1201/2388] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:24:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:24:59.599441 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccd4a8-33f3-4c02-bf84-cda9d4705c87 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:24:59.601278 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-38ccd4a8-33f3-4c02-bf84-cda9d4705c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:24:59.678926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccd4a8-33f3-4c02-bf84-cda9d4705c87 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:24:59.684733 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d26c12-6920-4609-9182-1ae5b1475e58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:24:59.685381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d26c12-6920-4609-9182-1ae5b1475e58 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:24:59.685663 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d26c12-6920-4609-9182-1ae5b1475e58 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:24:59.685938 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d26c12-6920-4609-9182-1ae5b1475e58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:24:59.693665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d26c12-6920-4609-9182-1ae5b1475e58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:24:59.695281 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d26c12-6920-4609-9182-1ae5b1475e58 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:24:59.704483 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1188/2389] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:24:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:25:09.579133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=90 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:09.700264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:INSERT=5,keystone:SELECT=85 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:10.949228 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1213665-b1bf-4657-b67d-1d849e516b13 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:10.977623 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1213665-b1bf-4657-b67d-1d849e516b13 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:10.990702 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71e331-3298-4710-bf4b-dc3f10350a4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:10.991828 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71e331-3298-4710-bf4b-dc3f10350a4b service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:10.992509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71e331-3298-4710-bf4b-dc3f10350a4b service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:10.993894 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71e331-3298-4710-bf4b-dc3f10350a4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:10.998414 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-eb71e331-3298-4710-bf4b-dc3f10350a4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:11.023438 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71e331-3298-4710-bf4b-dc3f10350a4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:11.023438 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71e331-3298-4710-bf4b-dc3f10350a4b service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:11.033752 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1202/2390] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:25:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:25:18.110835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d26c12-6920-4609-9182-1ae5b1475e58 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:18.112529 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-43d26c12-6920-4609-9182-1ae5b1475e58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:18.174629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d26c12-6920-4609-9182-1ae5b1475e58 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:18.179368 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef12b1b-31b1-46ce-8244-53e0f59b2b13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:18.180018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef12b1b-31b1-46ce-8244-53e0f59b2b13 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:18.180301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef12b1b-31b1-46ce-8244-53e0f59b2b13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:18.180582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef12b1b-31b1-46ce-8244-53e0f59b2b13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:18.190773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef12b1b-31b1-46ce-8244-53e0f59b2b13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:18.192218 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef12b1b-31b1-46ce-8244-53e0f59b2b13 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:18.202259 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1189/2391] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:25:18 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:25:21.029498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=6 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:27.880193 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e78130-33e5-4de9-8c15-45474619daed None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:27.880891 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e78130-33e5-4de9-8c15-45474619daed None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:27.880891 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e78130-33e5-4de9-8c15-45474619daed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:27.899032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-69e78130-33e5-4de9-8c15-45474619daed None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:25:27.900257 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-69e78130-33e5-4de9-8c15-45474619daed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:27.955440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1203/2392] 10.222.0.99 () {58 vars in 1009 bytes} [Mon Jul 18 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:25:28.004442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef12b1b-31b1-46ce-8244-53e0f59b2b13 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:28.005974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9ef12b1b-31b1-46ce-8244-53e0f59b2b13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:28.079558 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef12b1b-31b1-46ce-8244-53e0f59b2b13 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:28.084811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bd797-36eb-41db-818c-fbf9547d6f66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:28.085521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bd797-36eb-41db-818c-fbf9547d6f66 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:28.085782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bd797-36eb-41db-818c-fbf9547d6f66 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:28.086061 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bd797-36eb-41db-818c-fbf9547d6f66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:28.095308 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bd797-36eb-41db-818c-fbf9547d6f66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:28.096897 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bd797-36eb-41db-818c-fbf9547d6f66 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:28.106224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1190/2393] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:25:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:25:37.948221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=25 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:38.102538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=58 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:41.095066 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e78130-33e5-4de9-8c15-45474619daed None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:41.213604 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e78130-33e5-4de9-8c15-45474619daed None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:41.219896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1594c-97b9-46e5-99fa-abc328dc435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:41.220804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1594c-97b9-46e5-99fa-abc328dc435a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:41.221083 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1594c-97b9-46e5-99fa-abc328dc435a admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:41.221354 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1594c-97b9-46e5-99fa-abc328dc435a admin admin] PATH_INFO: `/v3/users/da73a9e73d804bdb83ddd3698d0b3a99` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:41.222727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1594c-97b9-46e5-99fa-abc328dc435a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da73a9e73d804bdb83ddd3698d0b3a99)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:41.224743 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1594c-97b9-46e5-99fa-abc328dc435a admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:41.280288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-79e1594c-97b9-46e5-99fa-abc328dc435a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da73a9e73d804bdb83ddd3698d0b3a99'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:41.288323 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-79e1594c-97b9-46e5-99fa-abc328dc435a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da73a9e73d804bdb83ddd3698d0b3a99'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:41.289177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-79e1594c-97b9-46e5-99fa-abc328dc435a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da73a9e73d804bdb83ddd3698d0b3a99'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:41.304064 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-79e1594c-97b9-46e5-99fa-abc328dc435a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da73a9e73d804bdb83ddd3698d0b3a99'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:41.312162 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-79e1594c-97b9-46e5-99fa-abc328dc435a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da73a9e73d804bdb83ddd3698d0b3a99'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:41.319161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1204/2394] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:25:41 2022] DELETE /identity/v3/users/da73a9e73d804bdb83ddd3698d0b3a99 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:25:41.521711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bd797-36eb-41db-818c-fbf9547d6f66 service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:41.559510 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bd797-36eb-41db-818c-fbf9547d6f66 service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:41.627054 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efae74-e471-428f-ade8-4c9cd49886ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:41.627968 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efae74-e471-428f-ade8-4c9cd49886ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:41.628251 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efae74-e471-428f-ade8-4c9cd49886ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:41.628528 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efae74-e471-428f-ade8-4c9cd49886ba admin admin] PATH_INFO: `/v3/projects/ac99d8a93cbe4d8db222e0ea8b46455e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:41.629865 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efae74-e471-428f-ade8-4c9cd49886ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac99d8a93cbe4d8db222e0ea8b46455e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:41.631875 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efae74-e471-428f-ade8-4c9cd49886ba admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:41.684211 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5efae74-e471-428f-ade8-4c9cd49886ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac99d8a93cbe4d8db222e0ea8b46455e', 'request_id': 'req-a5efae74-e471-428f-ade8-4c9cd49886ba'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:41.692791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5efae74-e471-428f-ade8-4c9cd49886ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac99d8a93cbe4d8db222e0ea8b46455e', 'request_id': 'req-a5efae74-e471-428f-ade8-4c9cd49886ba'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:41.704190 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5efae74-e471-428f-ade8-4c9cd49886ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac99d8a93cbe4d8db222e0ea8b46455e', 'request_id': 'req-a5efae74-e471-428f-ade8-4c9cd49886ba'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:41.733637 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5efae74-e471-428f-ade8-4c9cd49886ba admin admin] The token cache is being invalidate because project ac99d8a93cbe4d8db222e0ea8b46455e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:25:41.733932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5efae74-e471-428f-ade8-4c9cd49886ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:41.734604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5efae74-e471-428f-ade8-4c9cd49886ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:41.736175 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1191/2395] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:25:41 2022] DELETE /identity/v3/projects/ac99d8a93cbe4d8db222e0ea8b46455e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:25:41.740438 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1594c-97b9-46e5-99fa-abc328dc435a admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:41.741992 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-79e1594c-97b9-46e5-99fa-abc328dc435a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:41.765192 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1594c-97b9-46e5-99fa-abc328dc435a admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:41.793415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:41.827745 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47dde9-1855-4ce0-a564-ed42c1119a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:41.828698 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47dde9-1855-4ce0-a564-ed42c1119a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:41.829063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47dde9-1855-4ce0-a564-ed42c1119a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:41.829396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47dde9-1855-4ce0-a564-ed42c1119a17 admin admin] PATH_INFO: `/v3/users/004cbf33be3b4a618adb370151d185c2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:41.830683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47dde9-1855-4ce0-a564-ed42c1119a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=004cbf33be3b4a618adb370151d185c2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:41.832677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47dde9-1855-4ce0-a564-ed42c1119a17 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:42.014203 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-bf47dde9-1855-4ce0-a564-ed42c1119a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '004cbf33be3b4a618adb370151d185c2'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:42.022882 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-bf47dde9-1855-4ce0-a564-ed42c1119a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '004cbf33be3b4a618adb370151d185c2'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:42.023514 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-bf47dde9-1855-4ce0-a564-ed42c1119a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '004cbf33be3b4a618adb370151d185c2'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:42.036898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-bf47dde9-1855-4ce0-a564-ed42c1119a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '004cbf33be3b4a618adb370151d185c2'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:42.044625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-bf47dde9-1855-4ce0-a564-ed42c1119a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '004cbf33be3b4a618adb370151d185c2'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:42.050730 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1205/2396] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:25:41 2022] DELETE /identity/v3/users/004cbf33be3b4a618adb370151d185c2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:25:42.243654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efae74-e471-428f-ade8-4c9cd49886ba admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:42.245601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a5efae74-e471-428f-ade8-4c9cd49886ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:42.268081 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efae74-e471-428f-ade8-4c9cd49886ba admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:42.330595 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:42.340111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45b525-b02c-47fa-8f2b-c46f2da92fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:42.341276 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45b525-b02c-47fa-8f2b-c46f2da92fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:42.341634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45b525-b02c-47fa-8f2b-c46f2da92fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:42.341981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45b525-b02c-47fa-8f2b-c46f2da92fd7 admin admin] PATH_INFO: `/v3/projects/a139b35bcb884a508bf602ea0f4eb2fd` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:42.343879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45b525-b02c-47fa-8f2b-c46f2da92fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a139b35bcb884a508bf602ea0f4eb2fd)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:42.346114 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45b525-b02c-47fa-8f2b-c46f2da92fd7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:42.414789 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bf45b525-b02c-47fa-8f2b-c46f2da92fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a139b35bcb884a508bf602ea0f4eb2fd', 'request_id': 'req-bf45b525-b02c-47fa-8f2b-c46f2da92fd7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:42.427240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bf45b525-b02c-47fa-8f2b-c46f2da92fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a139b35bcb884a508bf602ea0f4eb2fd', 'request_id': 'req-bf45b525-b02c-47fa-8f2b-c46f2da92fd7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:42.441564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bf45b525-b02c-47fa-8f2b-c46f2da92fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a139b35bcb884a508bf602ea0f4eb2fd', 'request_id': 'req-bf45b525-b02c-47fa-8f2b-c46f2da92fd7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:42.457529 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bf45b525-b02c-47fa-8f2b-c46f2da92fd7 admin admin] The token cache is being invalidate because project a139b35bcb884a508bf602ea0f4eb2fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:25:42.457919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bf45b525-b02c-47fa-8f2b-c46f2da92fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:42.459955 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bf45b525-b02c-47fa-8f2b-c46f2da92fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:25:42.461754 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1192/2397] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:25:42 2022] DELETE /identity/v3/projects/a139b35bcb884a508bf602ea0f4eb2fd => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:25:42.466970 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34443fb-5a34-4687-b529-10b641cb37d9 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:42.467520 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34443fb-5a34-4687-b529-10b641cb37d9 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:42.467775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34443fb-5a34-4687-b529-10b641cb37d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:42.541778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-e34443fb-5a34-4687-b529-10b641cb37d9 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:25:42.543119 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e34443fb-5a34-4687-b529-10b641cb37d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:42.644106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1206/2398] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:25:42.652889 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68201a92-6477-41e1-b49c-5a9bb6e30ac1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:42.653518 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68201a92-6477-41e1-b49c-5a9bb6e30ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:42.654155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68201a92-6477-41e1-b49c-5a9bb6e30ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:42.684823 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-68201a92-6477-41e1-b49c-5a9bb6e30ac1 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:25:42.686640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-68201a92-6477-41e1-b49c-5a9bb6e30ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:42.695082 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1193/2399] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:25:42.707046 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34443fb-5a34-4687-b529-10b641cb37d9 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:42.716986 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34443fb-5a34-4687-b529-10b641cb37d9 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:42.721987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62819845-d25f-4c10-bbc7-aaa4c271a5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:42.722786 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62819845-d25f-4c10-bbc7-aaa4c271a5fd admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:42.723149 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62819845-d25f-4c10-bbc7-aaa4c271a5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:42.723540 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62819845-d25f-4c10-bbc7-aaa4c271a5fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:42.724378 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62819845-d25f-4c10-bbc7-aaa4c271a5fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:25:42.724748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62819845-d25f-4c10-bbc7-aaa4c271a5fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:42.726452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62819845-d25f-4c10-bbc7-aaa4c271a5fd admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:42.740306 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1207/2400] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:25:42.745228 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68201a92-6477-41e1-b49c-5a9bb6e30ac1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:42.755607 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68201a92-6477-41e1-b49c-5a9bb6e30ac1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:42.772433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3cd27-1153-4c45-8c75-9cfb65bab490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:42.773593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3cd27-1153-4c45-8c75-9cfb65bab490 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:42.773593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3cd27-1153-4c45-8c75-9cfb65bab490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:42.773849 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3cd27-1153-4c45-8c75-9cfb65bab490 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:42.774380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3cd27-1153-4c45-8c75-9cfb65bab490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:42.776404 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3cd27-1153-4c45-8c75-9cfb65bab490 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:42.817658 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1194/2401] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:25:42 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:25:42.819073 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62819845-d25f-4c10-bbc7-aaa4c271a5fd admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:42.829530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:42.835187 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62819845-d25f-4c10-bbc7-aaa4c271a5fd admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:42.909918 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18875cba-58d6-485a-9f23-b552238f01de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:42.910634 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18875cba-58d6-485a-9f23-b552238f01de admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:42.910922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18875cba-58d6-485a-9f23-b552238f01de admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:42.911268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18875cba-58d6-485a-9f23-b552238f01de admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:42.911903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18875cba-58d6-485a-9f23-b552238f01de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:42.913839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18875cba-58d6-485a-9f23-b552238f01de admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:42.943887 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1208/2402] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:25:42 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:25:42.947783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3cd27-1153-4c45-8c75-9cfb65bab490 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:42.959018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3cd27-1153-4c45-8c75-9cfb65bab490 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:42.963820 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec2d50-d84f-4a89-8dda-c67c83197b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:42.964494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec2d50-d84f-4a89-8dda-c67c83197b1e admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:42.964773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec2d50-d84f-4a89-8dda-c67c83197b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:42.965050 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec2d50-d84f-4a89-8dda-c67c83197b1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:42.965815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec2d50-d84f-4a89-8dda-c67c83197b1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:42.967475 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec2d50-d84f-4a89-8dda-c67c83197b1e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:42.982440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1195/2403] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:25:42.984728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18875cba-58d6-485a-9f23-b552238f01de admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:42.995603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18875cba-58d6-485a-9f23-b552238f01de admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:43.000616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8669296-eb9d-4696-94b8-8b5bc5123381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:43.001460 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8669296-eb9d-4696-94b8-8b5bc5123381 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:43.001746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8669296-eb9d-4696-94b8-8b5bc5123381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:43.002018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8669296-eb9d-4696-94b8-8b5bc5123381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:43.002796 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8669296-eb9d-4696-94b8-8b5bc5123381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:43.004395 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8669296-eb9d-4696-94b8-8b5bc5123381 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:43.016362 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1209/2404] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:25:43.020582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec2d50-d84f-4a89-8dda-c67c83197b1e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:43.031925 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec2d50-d84f-4a89-8dda-c67c83197b1e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:43.037973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ce6ee-5c7a-48c2-96ee-5ebaa0e93a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:43.038889 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ce6ee-5c7a-48c2-96ee-5ebaa0e93a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:43.039172 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ce6ee-5c7a-48c2-96ee-5ebaa0e93a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:43.039444 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ce6ee-5c7a-48c2-96ee-5ebaa0e93a33 admin admin] PATH_INFO: `/v3/projects/ac50c1968a124d31a0a28be0c1d8e89a/users/78f5bac4c9774a8daa66700052896410/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:43.056713 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ce6ee-5c7a-48c2-96ee-5ebaa0e93a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac50c1968a124d31a0a28be0c1d8e89a, user_id=78f5bac4c9774a8daa66700052896410, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:43.059414 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ce6ee-5c7a-48c2-96ee-5ebaa0e93a33 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:43.075033 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1196/2405] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:25:43 2022] PUT /identity/v3/projects/ac50c1968a124d31a0a28be0c1d8e89a/users/78f5bac4c9774a8daa66700052896410/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:25:43.087067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe970e1-85a8-42b5-9449-df7e3a5d86fe None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:43.087373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe970e1-85a8-42b5-9449-df7e3a5d86fe None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:43.087695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe970e1-85a8-42b5-9449-df7e3a5d86fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:43.119139 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-0fe970e1-85a8-42b5-9449-df7e3a5d86fe None None] MFA Rules not processed for user `78f5bac4c9774a8daa66700052896410`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:25:43.120763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-0fe970e1-85a8-42b5-9449-df7e3a5d86fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:43.214947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1210/2406] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:25:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:25:43.233801 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ce6ee-5c7a-48c2-96ee-5ebaa0e93a33 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:43.236937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a55ce6ee-5c7a-48c2-96ee-5ebaa0e93a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:43.341642 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ce6ee-5c7a-48c2-96ee-5ebaa0e93a33 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:43.347731 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc1421-2645-4ea9-965e-196d2e5bb6b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '927543219de847b88b97fbe4f343d2be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:43.348864 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc1421-2645-4ea9-965e-196d2e5bb6b2 service glance] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:43.349358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc1421-2645-4ea9-965e-196d2e5bb6b2 service glance] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:43.349853 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc1421-2645-4ea9-965e-196d2e5bb6b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:43.365318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc1421-2645-4ea9-965e-196d2e5bb6b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:43.368159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc1421-2645-4ea9-965e-196d2e5bb6b2 service glance] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:43.382275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1197/2407] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:25:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:25:44.733839 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e76ab-f90e-4ef0-8f96-70224a4dd1a9 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:44.734460 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e76ab-f90e-4ef0-8f96-70224a4dd1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:44.734733 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e76ab-f90e-4ef0-8f96-70224a4dd1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:44.770335 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-552e76ab-f90e-4ef0-8f96-70224a4dd1a9 None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:25:44.771585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-552e76ab-f90e-4ef0-8f96-70224a4dd1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:44.840539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1211/2408] 10.222.0.99 () {58 vars in 1009 bytes} [Mon Jul 18 14:25:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:25:44.852819 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc1421-2645-4ea9-965e-196d2e5bb6b2 service glance] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:25:44.854257 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1bcc1421-2645-4ea9-965e-196d2e5bb6b2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:25:44.865416 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:44.932982 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc1421-2645-4ea9-965e-196d2e5bb6b2 service glance] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:25:44.941737 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64423309-f1d9-4300-a7f2-e72353a7bd70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:25:44.942415 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64423309-f1d9-4300-a7f2-e72353a7bd70 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:25:44.942717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64423309-f1d9-4300-a7f2-e72353a7bd70 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:25:44.942990 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64423309-f1d9-4300-a7f2-e72353a7bd70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:25:44.952130 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64423309-f1d9-4300-a7f2-e72353a7bd70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:25:44.953733 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64423309-f1d9-4300-a7f2-e72353a7bd70 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:25:44.965106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1198/2409] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:25:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:25:54.842360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:54.960905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=28 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:12.983911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdad818-cca7-495c-8ac1-1e46b5e526d4 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:12.984680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdad818-cca7-495c-8ac1-1e46b5e526d4 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:12.984680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdad818-cca7-495c-8ac1-1e46b5e526d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:13.009926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-3bdad818-cca7-495c-8ac1-1e46b5e526d4 None None] MFA Rules not processed for user `8f3ee6a031214346a20cdfcb7fb551d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:26:13.011284 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3bdad818-cca7-495c-8ac1-1e46b5e526d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:13.019233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1212/2410] 10.222.0.99 () {58 vars in 967 bytes} [Mon Jul 18 14:26:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:26:13.032396 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64423309-f1d9-4300-a7f2-e72353a7bd70 service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:13.043356 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64423309-f1d9-4300-a7f2-e72353a7bd70 service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:13.048911 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fb8b8-0a30-4a85-ac32-c9fdff4a0fc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fe1a286c2045d5bcd49895a878a3bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:13.049610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fb8b8-0a30-4a85-ac32-c9fdff4a0fc5 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:13.049893 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fb8b8-0a30-4a85-ac32-c9fdff4a0fc5 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:13.050167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fb8b8-0a30-4a85-ac32-c9fdff4a0fc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:13.058786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fb8b8-0a30-4a85-ac32-c9fdff4a0fc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:13.060371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fb8b8-0a30-4a85-ac32-c9fdff4a0fc5 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:13.068533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1199/2411] 10.222.0.99 () {60 vars in 1384 bytes} [Mon Jul 18 14:26:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 14:26:16.886305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdad818-cca7-495c-8ac1-1e46b5e526d4 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:16.954091 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdad818-cca7-495c-8ac1-1e46b5e526d4 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:16.958894 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f25067-218e-407e-9a2b-a445ddea7f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:16.959794 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f25067-218e-407e-9a2b-a445ddea7f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:16.960076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f25067-218e-407e-9a2b-a445ddea7f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:16.960353 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f25067-218e-407e-9a2b-a445ddea7f9f admin admin] PATH_INFO: `/v3/users/78f5bac4c9774a8daa66700052896410` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:16.961600 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f25067-218e-407e-9a2b-a445ddea7f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f5bac4c9774a8daa66700052896410)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:16.963603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f25067-218e-407e-9a2b-a445ddea7f9f admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:17.014939 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f1f25067-218e-407e-9a2b-a445ddea7f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f5bac4c9774a8daa66700052896410'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:17.024692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f1f25067-218e-407e-9a2b-a445ddea7f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f5bac4c9774a8daa66700052896410'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:17.025352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f1f25067-218e-407e-9a2b-a445ddea7f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f5bac4c9774a8daa66700052896410'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:17.037629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f1f25067-218e-407e-9a2b-a445ddea7f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f5bac4c9774a8daa66700052896410'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:17.044691 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f1f25067-218e-407e-9a2b-a445ddea7f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f5bac4c9774a8daa66700052896410'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:17.051376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1213/2412] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:26:16 2022] DELETE /identity/v3/users/78f5bac4c9774a8daa66700052896410 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:26:17.056294 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c7dc3-bc90-4400-8dca-3622dd8572c9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:17.056748 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c7dc3-bc90-4400-8dca-3622dd8572c9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:17.056856 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c7dc3-bc90-4400-8dca-3622dd8572c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:17.075925 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9e7c7dc3-bc90-4400-8dca-3622dd8572c9 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:26:17.077134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9e7c7dc3-bc90-4400-8dca-3622dd8572c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:17.142553 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1200/2413] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:26:17.152797 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f25067-218e-407e-9a2b-a445ddea7f9f admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:17.154354 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f1f25067-218e-407e-9a2b-a445ddea7f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:17.238964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f25067-218e-407e-9a2b-a445ddea7f9f admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:17.243012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c50ee-c3ab-4a05-ad1d-362043ad8549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:17.243669 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c50ee-c3ab-4a05-ad1d-362043ad8549 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:17.243964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c50ee-c3ab-4a05-ad1d-362043ad8549 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:17.244551 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c50ee-c3ab-4a05-ad1d-362043ad8549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:17.252023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:17.254625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c50ee-c3ab-4a05-ad1d-362043ad8549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:17.256328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c50ee-c3ab-4a05-ad1d-362043ad8549 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:17.266781 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1214/2414] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:26:17.548610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c7dc3-bc90-4400-8dca-3622dd8572c9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:17.550096 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9e7c7dc3-bc90-4400-8dca-3622dd8572c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:17.562630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c7dc3-bc90-4400-8dca-3622dd8572c9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:17.568202 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a02bd2-c6f4-4de2-8cbc-1c2ac9ad006c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:17.569131 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a02bd2-c6f4-4de2-8cbc-1c2ac9ad006c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:17.569408 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a02bd2-c6f4-4de2-8cbc-1c2ac9ad006c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:17.569689 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a02bd2-c6f4-4de2-8cbc-1c2ac9ad006c admin admin] PATH_INFO: `/v3/projects/ac50c1968a124d31a0a28be0c1d8e89a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:17.571193 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a02bd2-c6f4-4de2-8cbc-1c2ac9ad006c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac50c1968a124d31a0a28be0c1d8e89a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:17.573229 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a02bd2-c6f4-4de2-8cbc-1c2ac9ad006c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:17.642806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-97a02bd2-c6f4-4de2-8cbc-1c2ac9ad006c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac50c1968a124d31a0a28be0c1d8e89a', 'request_id': 'req-97a02bd2-c6f4-4de2-8cbc-1c2ac9ad006c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:17.648980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-97a02bd2-c6f4-4de2-8cbc-1c2ac9ad006c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac50c1968a124d31a0a28be0c1d8e89a', 'request_id': 'req-97a02bd2-c6f4-4de2-8cbc-1c2ac9ad006c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:17.655420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-97a02bd2-c6f4-4de2-8cbc-1c2ac9ad006c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac50c1968a124d31a0a28be0c1d8e89a', 'request_id': 'req-97a02bd2-c6f4-4de2-8cbc-1c2ac9ad006c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:17.669383 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-97a02bd2-c6f4-4de2-8cbc-1c2ac9ad006c admin admin] The token cache is being invalidate because project ac50c1968a124d31a0a28be0c1d8e89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:26:17.669591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-97a02bd2-c6f4-4de2-8cbc-1c2ac9ad006c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:17.670209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-97a02bd2-c6f4-4de2-8cbc-1c2ac9ad006c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:17.671812 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1201/2415] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:26:17 2022] DELETE /identity/v3/projects/ac50c1968a124d31a0a28be0c1d8e89a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:26:17.676847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570c8bc-e1e0-4891-b44e-5dce0e03f59f None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:17.677138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570c8bc-e1e0-4891-b44e-5dce0e03f59f None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:17.677421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570c8bc-e1e0-4891-b44e-5dce0e03f59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:17.696863 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-7570c8bc-e1e0-4891-b44e-5dce0e03f59f None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:26:17.698081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-7570c8bc-e1e0-4891-b44e-5dce0e03f59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:17.760531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1215/2416] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:26:17.768468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395121b-053e-4e3e-9ef4-ebef231914a0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:17.768758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395121b-053e-4e3e-9ef4-ebef231914a0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:17.769044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395121b-053e-4e3e-9ef4-ebef231914a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:17.788007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7395121b-053e-4e3e-9ef4-ebef231914a0 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:26:17.789225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7395121b-053e-4e3e-9ef4-ebef231914a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:17.798004 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1202/2417] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:26:17.803054 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570c8bc-e1e0-4891-b44e-5dce0e03f59f None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:17.813524 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570c8bc-e1e0-4891-b44e-5dce0e03f59f None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:17.819372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5c409-8b65-4a56-b549-952696df5375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:17.820054 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5c409-8b65-4a56-b549-952696df5375 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:17.820335 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5c409-8b65-4a56-b549-952696df5375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:17.820609 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5c409-8b65-4a56-b549-952696df5375 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:17.821357 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5c409-8b65-4a56-b549-952696df5375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:26:17.821684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5c409-8b65-4a56-b549-952696df5375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:17.823357 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5c409-8b65-4a56-b549-952696df5375 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:17.835586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1216/2418] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:26:17.840309 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395121b-053e-4e3e-9ef4-ebef231914a0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:17.850146 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395121b-053e-4e3e-9ef4-ebef231914a0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:17.858836 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f407be-9150-486a-a525-2b0a227f1498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:17.859505 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f407be-9150-486a-a525-2b0a227f1498 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:17.859791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f407be-9150-486a-a525-2b0a227f1498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:17.860064 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f407be-9150-486a-a525-2b0a227f1498 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:17.860760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f407be-9150-486a-a525-2b0a227f1498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:17.862739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f407be-9150-486a-a525-2b0a227f1498 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:17.891390 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1203/2419] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:26:17 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:26:17.896031 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5c409-8b65-4a56-b549-952696df5375 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:17.906707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5c409-8b65-4a56-b549-952696df5375 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:17.964285 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69613567-e494-47f7-9562-763338d09730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:17.964891 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69613567-e494-47f7-9562-763338d09730 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:17.965173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69613567-e494-47f7-9562-763338d09730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:17.965436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69613567-e494-47f7-9562-763338d09730 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:17.966150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69613567-e494-47f7-9562-763338d09730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:17.968197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69613567-e494-47f7-9562-763338d09730 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:17.989755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1217/2420] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:26:17 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:26:17.994556 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f407be-9150-486a-a525-2b0a227f1498 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:18.005625 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f407be-9150-486a-a525-2b0a227f1498 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:18.011549 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1b0d5-18d8-4a54-a050-0c581ea60fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:18.012205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1b0d5-18d8-4a54-a050-0c581ea60fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:18.012488 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1b0d5-18d8-4a54-a050-0c581ea60fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:18.012765 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1b0d5-18d8-4a54-a050-0c581ea60fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:18.013495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1b0d5-18d8-4a54-a050-0c581ea60fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:18.015137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1b0d5-18d8-4a54-a050-0c581ea60fa7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:18.026163 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1204/2421] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:26:18.030273 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69613567-e494-47f7-9562-763338d09730 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:18.041484 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69613567-e494-47f7-9562-763338d09730 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:18.047203 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605ae4f-d8d7-4aec-83ae-a25eaf23ef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:18.047863 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ae4f-d8d7-4aec-83ae-a25eaf23ef98 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:18.048150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ae4f-d8d7-4aec-83ae-a25eaf23ef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:18.048425 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ae4f-d8d7-4aec-83ae-a25eaf23ef98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:18.049160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605ae4f-d8d7-4aec-83ae-a25eaf23ef98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:18.050800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605ae4f-d8d7-4aec-83ae-a25eaf23ef98 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:18.061032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1218/2422] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:26:18.065242 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1b0d5-18d8-4a54-a050-0c581ea60fa7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:18.075609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1b0d5-18d8-4a54-a050-0c581ea60fa7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:18.080770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd5e0d-916b-44a3-8704-6ab6ba34c891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:18.081645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd5e0d-916b-44a3-8704-6ab6ba34c891 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:18.081926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd5e0d-916b-44a3-8704-6ab6ba34c891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:18.082199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd5e0d-916b-44a3-8704-6ab6ba34c891 admin admin] PATH_INFO: `/v3/projects/99869ec73fbd484d80cdf5102100609f/users/126b2238e8fb4bc699ec93d3ce3b1294/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:18.097884 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd5e0d-916b-44a3-8704-6ab6ba34c891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99869ec73fbd484d80cdf5102100609f, user_id=126b2238e8fb4bc699ec93d3ce3b1294, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:18.100692 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd5e0d-916b-44a3-8704-6ab6ba34c891 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:18.114708 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1205/2423] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:26:18 2022] PUT /identity/v3/projects/99869ec73fbd484d80cdf5102100609f/users/126b2238e8fb4bc699ec93d3ce3b1294/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:26:18.125565 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f7c9-2d4c-4688-a3d0-2c3cb4b67989 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:18.125927 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f7c9-2d4c-4688-a3d0-2c3cb4b67989 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:18.126269 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193f7c9-2d4c-4688-a3d0-2c3cb4b67989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:18.155266 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-d193f7c9-2d4c-4688-a3d0-2c3cb4b67989 None None] MFA Rules not processed for user `126b2238e8fb4bc699ec93d3ce3b1294`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:26:18.156471 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d193f7c9-2d4c-4688-a3d0-2c3cb4b67989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:18.207174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:18.225266 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1219/2424] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:26:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:26:18.237261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd5e0d-916b-44a3-8704-6ab6ba34c891 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:18.239037 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6dfd5e0d-916b-44a3-8704-6ab6ba34c891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:18.249744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:18.323300 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd5e0d-916b-44a3-8704-6ab6ba34c891 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:18.332848 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53515b7-35be-47f8-8a65-d69c44cbfbc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:18.333507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53515b7-35be-47f8-8a65-d69c44cbfbc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:18.333788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53515b7-35be-47f8-8a65-d69c44cbfbc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:18.334057 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53515b7-35be-47f8-8a65-d69c44cbfbc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:18.343669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53515b7-35be-47f8-8a65-d69c44cbfbc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:18.345096 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53515b7-35be-47f8-8a65-d69c44cbfbc9 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:18.354017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1206/2425] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:26:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:26:28.222120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=4 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:28.349893 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=32 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:28.408929 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193f7c9-2d4c-4688-a3d0-2c3cb4b67989 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:28.471973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193f7c9-2d4c-4688-a3d0-2c3cb4b67989 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:28.476881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0353f-1fd4-451b-b926-5a82430874b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:28.477770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0353f-1fd4-451b-b926-5a82430874b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:28.478051 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0353f-1fd4-451b-b926-5a82430874b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:28.478316 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0353f-1fd4-451b-b926-5a82430874b0 admin admin] PATH_INFO: `/v3/users/126b2238e8fb4bc699ec93d3ce3b1294` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:28.479587 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0353f-1fd4-451b-b926-5a82430874b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=126b2238e8fb4bc699ec93d3ce3b1294)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:28.481632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0353f-1fd4-451b-b926-5a82430874b0 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:28.530040 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-0db0353f-1fd4-451b-b926-5a82430874b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '126b2238e8fb4bc699ec93d3ce3b1294'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:28.538245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-0db0353f-1fd4-451b-b926-5a82430874b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '126b2238e8fb4bc699ec93d3ce3b1294'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:28.538885 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-0db0353f-1fd4-451b-b926-5a82430874b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '126b2238e8fb4bc699ec93d3ce3b1294'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:28.551830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-0db0353f-1fd4-451b-b926-5a82430874b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '126b2238e8fb4bc699ec93d3ce3b1294'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:28.558994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-0db0353f-1fd4-451b-b926-5a82430874b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '126b2238e8fb4bc699ec93d3ce3b1294'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:28.565509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1220/2426] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:26:28 2022] DELETE /identity/v3/users/126b2238e8fb4bc699ec93d3ce3b1294 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:26:28.570296 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52194cf-6c7a-4823-9d8a-62551e172374 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:28.570732 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52194cf-6c7a-4823-9d8a-62551e172374 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:28.571016 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52194cf-6c7a-4823-9d8a-62551e172374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:28.591565 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f52194cf-6c7a-4823-9d8a-62551e172374 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:26:28.592789 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f52194cf-6c7a-4823-9d8a-62551e172374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:28.665701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1207/2427] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:26:28.677126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0353f-1fd4-451b-b926-5a82430874b0 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:28.678961 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-0db0353f-1fd4-451b-b926-5a82430874b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:28.737795 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0353f-1fd4-451b-b926-5a82430874b0 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:28.742020 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3ca5d-fd94-4451-bc8c-bfee949c5463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:28.742759 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ca5d-fd94-4451-bc8c-bfee949c5463 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:28.743042 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ca5d-fd94-4451-bc8c-bfee949c5463 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:28.743318 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ca5d-fd94-4451-bc8c-bfee949c5463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:28.753182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3ca5d-fd94-4451-bc8c-bfee949c5463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:28.754674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3ca5d-fd94-4451-bc8c-bfee949c5463 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:28.764239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1221/2428] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:26:29.045544 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52194cf-6c7a-4823-9d8a-62551e172374 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:29.047849 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f52194cf-6c7a-4823-9d8a-62551e172374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:29.060495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52194cf-6c7a-4823-9d8a-62551e172374 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:29.065779 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4e5df-f130-4db5-9681-b953314aafc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:29.066788 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4e5df-f130-4db5-9681-b953314aafc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:29.067038 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4e5df-f130-4db5-9681-b953314aafc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:29.067326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4e5df-f130-4db5-9681-b953314aafc3 admin admin] PATH_INFO: `/v3/projects/99869ec73fbd484d80cdf5102100609f` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:29.068568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4e5df-f130-4db5-9681-b953314aafc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99869ec73fbd484d80cdf5102100609f)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:29.070517 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4e5df-f130-4db5-9681-b953314aafc3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:29.119947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c4d4e5df-f130-4db5-9681-b953314aafc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99869ec73fbd484d80cdf5102100609f', 'request_id': 'req-c4d4e5df-f130-4db5-9681-b953314aafc3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:29.125862 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c4d4e5df-f130-4db5-9681-b953314aafc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99869ec73fbd484d80cdf5102100609f', 'request_id': 'req-c4d4e5df-f130-4db5-9681-b953314aafc3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:29.132453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c4d4e5df-f130-4db5-9681-b953314aafc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99869ec73fbd484d80cdf5102100609f', 'request_id': 'req-c4d4e5df-f130-4db5-9681-b953314aafc3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:29.146221 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c4d4e5df-f130-4db5-9681-b953314aafc3 admin admin] The token cache is being invalidate because project 99869ec73fbd484d80cdf5102100609f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:26:29.146699 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c4d4e5df-f130-4db5-9681-b953314aafc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:29.147347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c4d4e5df-f130-4db5-9681-b953314aafc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:26:29.149462 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1208/2429] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:26:29 2022] DELETE /identity/v3/projects/99869ec73fbd484d80cdf5102100609f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:26:29.154203 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f86524-b897-4c0e-8826-14c7e2c74e98 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:29.154545 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f86524-b897-4c0e-8826-14c7e2c74e98 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:29.154831 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f86524-b897-4c0e-8826-14c7e2c74e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:29.173974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-71f86524-b897-4c0e-8826-14c7e2c74e98 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:26:29.175131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-71f86524-b897-4c0e-8826-14c7e2c74e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:29.192352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:29.237065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1222/2430] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:26:29.245337 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98f356-c659-40f1-b378-849d2258cfdb None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:29.245629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98f356-c659-40f1-b378-849d2258cfdb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:29.245910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98f356-c659-40f1-b378-849d2258cfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:29.265535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2f98f356-c659-40f1-b378-849d2258cfdb None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:26:29.266791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2f98f356-c659-40f1-b378-849d2258cfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:29.275866 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1209/2431] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:26:29.285526 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f86524-b897-4c0e-8826-14c7e2c74e98 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:29.296453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f86524-b897-4c0e-8826-14c7e2c74e98 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:29.302642 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c143c26-888a-4eca-93fc-96dc11328d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:29.303346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c143c26-888a-4eca-93fc-96dc11328d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:29.303632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c143c26-888a-4eca-93fc-96dc11328d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:29.303932 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c143c26-888a-4eca-93fc-96dc11328d7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:29.304690 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c143c26-888a-4eca-93fc-96dc11328d7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:26:29.305000 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c143c26-888a-4eca-93fc-96dc11328d7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:29.306636 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c143c26-888a-4eca-93fc-96dc11328d7b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:29.318829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1223/2432] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:26:29.323490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98f356-c659-40f1-b378-849d2258cfdb None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:29.333592 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98f356-c659-40f1-b378-849d2258cfdb None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:29.339421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be2dd4-93a5-40d0-9e7b-89ab70c1940e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:29.340086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be2dd4-93a5-40d0-9e7b-89ab70c1940e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:29.340366 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be2dd4-93a5-40d0-9e7b-89ab70c1940e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:29.340617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be2dd4-93a5-40d0-9e7b-89ab70c1940e admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:29.341322 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be2dd4-93a5-40d0-9e7b-89ab70c1940e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:29.343320 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be2dd4-93a5-40d0-9e7b-89ab70c1940e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:29.372451 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1210/2433] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:26:29 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:26:29.376942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c143c26-888a-4eca-93fc-96dc11328d7b admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:29.387793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c143c26-888a-4eca-93fc-96dc11328d7b admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:29.446896 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4702660-0194-435b-8fac-0fccb37fc1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:29.447476 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4702660-0194-435b-8fac-0fccb37fc1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:29.447755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4702660-0194-435b-8fac-0fccb37fc1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:29.448022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4702660-0194-435b-8fac-0fccb37fc1a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:29.448710 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4702660-0194-435b-8fac-0fccb37fc1a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:29.450653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4702660-0194-435b-8fac-0fccb37fc1a1 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:29.478633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1224/2434] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:26:29 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:26:29.480011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be2dd4-93a5-40d0-9e7b-89ab70c1940e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:29.491325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be2dd4-93a5-40d0-9e7b-89ab70c1940e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:29.497443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f97bd-b14a-4d08-a47e-5bcd3413c8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:29.498109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f97bd-b14a-4d08-a47e-5bcd3413c8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:29.498421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f97bd-b14a-4d08-a47e-5bcd3413c8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:29.498688 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f97bd-b14a-4d08-a47e-5bcd3413c8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:29.499442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f97bd-b14a-4d08-a47e-5bcd3413c8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:29.501055 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f97bd-b14a-4d08-a47e-5bcd3413c8f8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:29.513022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1211/2435] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:26:29.517188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4702660-0194-435b-8fac-0fccb37fc1a1 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:29.527935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4702660-0194-435b-8fac-0fccb37fc1a1 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:29.532637 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf08eab-5e75-4211-8481-3e1a5b921a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:29.533295 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf08eab-5e75-4211-8481-3e1a5b921a85 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:29.533574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf08eab-5e75-4211-8481-3e1a5b921a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:29.533848 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf08eab-5e75-4211-8481-3e1a5b921a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:29.534613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf08eab-5e75-4211-8481-3e1a5b921a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:29.536206 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf08eab-5e75-4211-8481-3e1a5b921a85 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:29.546133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1225/2436] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:26:29.550743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f97bd-b14a-4d08-a47e-5bcd3413c8f8 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:29.560908 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f97bd-b14a-4d08-a47e-5bcd3413c8f8 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:29.565728 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b67e7-31cb-41b7-a724-9b65c30287ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:29.566636 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b67e7-31cb-41b7-a724-9b65c30287ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:29.566897 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b67e7-31cb-41b7-a724-9b65c30287ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:29.567171 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b67e7-31cb-41b7-a724-9b65c30287ca admin admin] PATH_INFO: `/v3/projects/df2d58c6ad3640a89c104419945f4797/users/12e003af750a4033856dca442d9bc677/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:29.582261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b67e7-31cb-41b7-a724-9b65c30287ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=df2d58c6ad3640a89c104419945f4797, user_id=12e003af750a4033856dca442d9bc677, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:29.584962 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b67e7-31cb-41b7-a724-9b65c30287ca admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:29.599811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1212/2437] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:26:29 2022] PUT /identity/v3/projects/df2d58c6ad3640a89c104419945f4797/users/12e003af750a4033856dca442d9bc677/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:26:29.605188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b0497-db99-406a-b3b9-49e9e5c54daf None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:29.605424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b0497-db99-406a-b3b9-49e9e5c54daf None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:29.605730 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b0497-db99-406a-b3b9-49e9e5c54daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:29.623908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-c59b0497-db99-406a-b3b9-49e9e5c54daf None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:26:29.625089 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c59b0497-db99-406a-b3b9-49e9e5c54daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:29.683843 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1226/2438] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:26:29.694575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b67e7-31cb-41b7-a724-9b65c30287ca admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:29.696749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ca8b67e7-31cb-41b7-a724-9b65c30287ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:29.720391 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:29.757187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b67e7-31cb-41b7-a724-9b65c30287ca admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:29.761306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17002be-d191-42a5-a324-f1caef6259b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:29.761922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17002be-d191-42a5-a324-f1caef6259b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:29.762215 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17002be-d191-42a5-a324-f1caef6259b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:29.762512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17002be-d191-42a5-a324-f1caef6259b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:29.771924 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17002be-d191-42a5-a324-f1caef6259b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:29.773355 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17002be-d191-42a5-a324-f1caef6259b0 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:29.782988 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1213/2439] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:26:33.728715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149a776-b008-4bf1-938d-53f9cba71697 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:33.729250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149a776-b008-4bf1-938d-53f9cba71697 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:33.729367 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149a776-b008-4bf1-938d-53f9cba71697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:33.757548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-f149a776-b008-4bf1-938d-53f9cba71697 None None] MFA Rules not processed for user `12e003af750a4033856dca442d9bc677`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:26:33.759138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f149a776-b008-4bf1-938d-53f9cba71697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:33.776880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:33.830076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1227/2440] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:26:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:26:33.834757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17002be-d191-42a5-a324-f1caef6259b0 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:33.848923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17002be-d191-42a5-a324-f1caef6259b0 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:33.866761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ced22b-6662-4a7e-93e5-ac61a76760e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:33.867654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ced22b-6662-4a7e-93e5-ac61a76760e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:33.867991 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ced22b-6662-4a7e-93e5-ac61a76760e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:33.868322 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ced22b-6662-4a7e-93e5-ac61a76760e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:33.869046 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ced22b-6662-4a7e-93e5-ac61a76760e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:33.871571 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ced22b-6662-4a7e-93e5-ac61a76760e7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:33.914610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1214/2441] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:26:33 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:26:33.915078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149a776-b008-4bf1-938d-53f9cba71697 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:33.926937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149a776-b008-4bf1-938d-53f9cba71697 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:34.000543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abe20e-4d15-4646-a557-d5b5ca34b526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:34.001259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abe20e-4d15-4646-a557-d5b5ca34b526 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:34.001546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abe20e-4d15-4646-a557-d5b5ca34b526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:34.001831 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abe20e-4d15-4646-a557-d5b5ca34b526 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:34.002615 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abe20e-4d15-4646-a557-d5b5ca34b526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:34.004683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abe20e-4d15-4646-a557-d5b5ca34b526 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:34.031225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1228/2442] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:26:33 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:26:34.035797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ced22b-6662-4a7e-93e5-ac61a76760e7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:34.047062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ced22b-6662-4a7e-93e5-ac61a76760e7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:34.051624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f06d8-aca5-4c16-b553-cd90f3e9dc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:34.052294 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f06d8-aca5-4c16-b553-cd90f3e9dc7b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:34.052576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f06d8-aca5-4c16-b553-cd90f3e9dc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:34.052851 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f06d8-aca5-4c16-b553-cd90f3e9dc7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:34.053629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f06d8-aca5-4c16-b553-cd90f3e9dc7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:34.057172 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f06d8-aca5-4c16-b553-cd90f3e9dc7b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:34.071134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1215/2443] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:26:34.075206 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abe20e-4d15-4646-a557-d5b5ca34b526 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:34.086378 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abe20e-4d15-4646-a557-d5b5ca34b526 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:34.091567 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4ca56-7b87-4f1a-b50b-6cdfc48e6ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:34.092477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4ca56-7b87-4f1a-b50b-6cdfc48e6ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:34.092762 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4ca56-7b87-4f1a-b50b-6cdfc48e6ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:34.093037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4ca56-7b87-4f1a-b50b-6cdfc48e6ac5 admin admin] PATH_INFO: `/v3/projects/5c684c14c1034f849d6a4e1b73ee5968/users/c4b1c08e912c433c8f5544fbfd53faff/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:34.111560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4ca56-7b87-4f1a-b50b-6cdfc48e6ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c684c14c1034f849d6a4e1b73ee5968, user_id=c4b1c08e912c433c8f5544fbfd53faff, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:34.114321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4ca56-7b87-4f1a-b50b-6cdfc48e6ac5 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:34.133929 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1229/2444] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:26:34 2022] PUT /identity/v3/projects/5c684c14c1034f849d6a4e1b73ee5968/users/c4b1c08e912c433c8f5544fbfd53faff/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:26:34.138111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f06d8-aca5-4c16-b553-cd90f3e9dc7b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:34.157088 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f06d8-aca5-4c16-b553-cd90f3e9dc7b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:34.232419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bec315-56d5-465f-bc15-b9027bf09d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:34.233208 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bec315-56d5-465f-bc15-b9027bf09d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:34.233498 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bec315-56d5-465f-bc15-b9027bf09d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:34.233776 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bec315-56d5-465f-bc15-b9027bf09d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:34.234574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bec315-56d5-465f-bc15-b9027bf09d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:34.236282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bec315-56d5-465f-bc15-b9027bf09d73 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:34.248471 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1216/2445] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:26:34.252331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4ca56-7b87-4f1a-b50b-6cdfc48e6ac5 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:34.263027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4ca56-7b87-4f1a-b50b-6cdfc48e6ac5 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:34.268122 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82763201-2408-44e4-90b4-13b3897cff68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:34.269137 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82763201-2408-44e4-90b4-13b3897cff68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:34.269484 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82763201-2408-44e4-90b4-13b3897cff68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:34.269829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82763201-2408-44e4-90b4-13b3897cff68 admin admin] PATH_INFO: `/v3/projects/5c684c14c1034f849d6a4e1b73ee5968/users/c4b1c08e912c433c8f5544fbfd53faff/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:34.271906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82763201-2408-44e4-90b4-13b3897cff68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c684c14c1034f849d6a4e1b73ee5968, user_id=c4b1c08e912c433c8f5544fbfd53faff, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:34.274718 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82763201-2408-44e4-90b4-13b3897cff68 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:34.292348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1230/2446] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:26:34 2022] PUT /identity/v3/projects/5c684c14c1034f849d6a4e1b73ee5968/users/c4b1c08e912c433c8f5544fbfd53faff/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:26:38.920040 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292c191-947c-46cc-8572-f341623de86e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:38.920638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292c191-947c-46cc-8572-f341623de86e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:38.920638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292c191-947c-46cc-8572-f341623de86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:38.947377 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9292c191-947c-46cc-8572-f341623de86e None None] MFA Rules not processed for user `c4b1c08e912c433c8f5544fbfd53faff`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:26:38.948861 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9292c191-947c-46cc-8572-f341623de86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:39.032797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1217/2447] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:26:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:26:39.050743 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82763201-2408-44e4-90b4-13b3897cff68 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:39.052710 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-82763201-2408-44e4-90b4-13b3897cff68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:39.156469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:39.184277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82763201-2408-44e4-90b4-13b3897cff68 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:39.189883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ede1c-fd0c-4fd5-8375-c00f5fc903a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:39.190701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ede1c-fd0c-4fd5-8375-c00f5fc903a0 service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:39.190922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ede1c-fd0c-4fd5-8375-c00f5fc903a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:39.191197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ede1c-fd0c-4fd5-8375-c00f5fc903a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:39.246497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ede1c-fd0c-4fd5-8375-c00f5fc903a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:39.248117 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ede1c-fd0c-4fd5-8375-c00f5fc903a0 service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:39.257572 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1231/2448] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:26:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:26:40.298237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e25f9-3368-42d2-aeb4-c84945eb5da2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:40.298789 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e25f9-3368-42d2-aeb4-c84945eb5da2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:40.298900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e25f9-3368-42d2-aeb4-c84945eb5da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:40.317410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-dc6e25f9-3368-42d2-aeb4-c84945eb5da2 None None] MFA Rules not processed for user `12e003af750a4033856dca442d9bc677`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:26:40.318568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dc6e25f9-3368-42d2-aeb4-c84945eb5da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:40.326055 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1218/2449] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:26:42.728488 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ede1c-fd0c-4fd5-8375-c00f5fc903a0 service nova] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:26:42.730010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e49ede1c-fd0c-4fd5-8375-c00f5fc903a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:42.883235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ede1c-fd0c-4fd5-8375-c00f5fc903a0 service nova] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:26:42.888683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2be675-2aad-4779-815d-807166cf8da6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92b73e1a514148b19bb6a1d2a39e32cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:26:42.889361 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2be675-2aad-4779-815d-807166cf8da6 service placement] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:26:42.889708 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2be675-2aad-4779-815d-807166cf8da6 service placement] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:26:42.890243 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2be675-2aad-4779-815d-807166cf8da6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:26:42.893164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-4a2be675-2aad-4779-815d-807166cf8da6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:26:42.915182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2be675-2aad-4779-815d-807166cf8da6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:26:42.917074 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2be675-2aad-4779-815d-807166cf8da6 service placement] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:26:42.930541 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1232/2450] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:26:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:26:50.311965 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:52.923957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=74 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:13.472380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e25f9-3368-42d2-aeb4-c84945eb5da2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:13.473807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dc6e25f9-3368-42d2-aeb4-c84945eb5da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:13.535969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e25f9-3368-42d2-aeb4-c84945eb5da2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:13.540183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6e3ba-9978-46ed-9d67-460bae26589a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:13.540845 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6e3ba-9978-46ed-9d67-460bae26589a service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:13.541129 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6e3ba-9978-46ed-9d67-460bae26589a service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:13.541407 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6e3ba-9978-46ed-9d67-460bae26589a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:13.543333 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c1a6e3ba-9978-46ed-9d67-460bae26589a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:13.617636 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6e3ba-9978-46ed-9d67-460bae26589a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:13.619463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6e3ba-9978-46ed-9d67-460bae26589a service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:13.629854 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1219/2451] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:17.032597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2be675-2aad-4779-815d-807166cf8da6 service placement] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:17.034151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-4a2be675-2aad-4779-815d-807166cf8da6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:17.052954 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2be675-2aad-4779-815d-807166cf8da6 service placement] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:17.058432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bf7e3-934d-4f85-838b-f0de2d925c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:17.059309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bf7e3-934d-4f85-838b-f0de2d925c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:17.059594 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bf7e3-934d-4f85-838b-f0de2d925c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:17.059868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bf7e3-934d-4f85-838b-f0de2d925c3a admin admin] PATH_INFO: `/v3/users/a19eb1f3c9e74f3c92755186a7a44ba8` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:17.061183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bf7e3-934d-4f85-838b-f0de2d925c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19eb1f3c9e74f3c92755186a7a44ba8)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:17.063547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bf7e3-934d-4f85-838b-f0de2d925c3a admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:17.144374 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-d65bf7e3-934d-4f85-838b-f0de2d925c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19eb1f3c9e74f3c92755186a7a44ba8'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:17.157243 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-d65bf7e3-934d-4f85-838b-f0de2d925c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19eb1f3c9e74f3c92755186a7a44ba8'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:17.157894 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-d65bf7e3-934d-4f85-838b-f0de2d925c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19eb1f3c9e74f3c92755186a7a44ba8'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:17.174983 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-d65bf7e3-934d-4f85-838b-f0de2d925c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19eb1f3c9e74f3c92755186a7a44ba8'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:17.182554 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-d65bf7e3-934d-4f85-838b-f0de2d925c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19eb1f3c9e74f3c92755186a7a44ba8'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:17.195578 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1233/2452] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:17 2022] DELETE /identity/v3/users/a19eb1f3c9e74f3c92755186a7a44ba8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:17.385302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6e3ba-9978-46ed-9d67-460bae26589a service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:17.397460 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6e3ba-9978-46ed-9d67-460bae26589a service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:17.472764 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1931a78-3bd6-420b-9c24-f244412b7c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:17.473663 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1931a78-3bd6-420b-9c24-f244412b7c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:17.474187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1931a78-3bd6-420b-9c24-f244412b7c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:17.474511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1931a78-3bd6-420b-9c24-f244412b7c27 admin admin] PATH_INFO: `/v3/projects/e54fbc9cf2cc4131bc6239d082a8f991` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:17.475731 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1931a78-3bd6-420b-9c24-f244412b7c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e54fbc9cf2cc4131bc6239d082a8f991)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:17.477743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1931a78-3bd6-420b-9c24-f244412b7c27 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:17.525186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f1931a78-3bd6-420b-9c24-f244412b7c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e54fbc9cf2cc4131bc6239d082a8f991', 'request_id': 'req-f1931a78-3bd6-420b-9c24-f244412b7c27'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:17.527273 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:17.531454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f1931a78-3bd6-420b-9c24-f244412b7c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e54fbc9cf2cc4131bc6239d082a8f991', 'request_id': 'req-f1931a78-3bd6-420b-9c24-f244412b7c27'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:17.537703 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f1931a78-3bd6-420b-9c24-f244412b7c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e54fbc9cf2cc4131bc6239d082a8f991', 'request_id': 'req-f1931a78-3bd6-420b-9c24-f244412b7c27'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:17.551014 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f1931a78-3bd6-420b-9c24-f244412b7c27 admin admin] The token cache is being invalidate because project e54fbc9cf2cc4131bc6239d082a8f991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:17.551328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f1931a78-3bd6-420b-9c24-f244412b7c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:17.551948 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f1931a78-3bd6-420b-9c24-f244412b7c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:17.553565 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1220/2453] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:17 2022] DELETE /identity/v3/projects/e54fbc9cf2cc4131bc6239d082a8f991 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:17.558729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62692fb9-4f53-426d-8c11-67509a2f6183 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:17.559024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62692fb9-4f53-426d-8c11-67509a2f6183 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:17.559303 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62692fb9-4f53-426d-8c11-67509a2f6183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:17.579926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-62692fb9-4f53-426d-8c11-67509a2f6183 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:17.581163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-62692fb9-4f53-426d-8c11-67509a2f6183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:17.658799 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1234/2454] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:17.666885 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b3a01-8eb3-4d43-9db0-2895701928ac None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:17.667199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b3a01-8eb3-4d43-9db0-2895701928ac None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:17.667456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b3a01-8eb3-4d43-9db0-2895701928ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:17.698228 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ec2b3a01-8eb3-4d43-9db0-2895701928ac None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:17.699590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ec2b3a01-8eb3-4d43-9db0-2895701928ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:17.708047 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1221/2455] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:17.712579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62692fb9-4f53-426d-8c11-67509a2f6183 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:17.722213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62692fb9-4f53-426d-8c11-67509a2f6183 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:17.726897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d16b61-d0a0-47bb-b7b8-4ae680fb3628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:17.727677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d16b61-d0a0-47bb-b7b8-4ae680fb3628 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:17.727957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d16b61-d0a0-47bb-b7b8-4ae680fb3628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:17.728318 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d16b61-d0a0-47bb-b7b8-4ae680fb3628 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:17.729065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d16b61-d0a0-47bb-b7b8-4ae680fb3628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:27:17.729391 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d16b61-d0a0-47bb-b7b8-4ae680fb3628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:17.731080 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d16b61-d0a0-47bb-b7b8-4ae680fb3628 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:17.745027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1235/2456] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:27:17.751187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b3a01-8eb3-4d43-9db0-2895701928ac None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:17.761457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b3a01-8eb3-4d43-9db0-2895701928ac None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:17.766578 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d87ef-40c9-4e37-bde8-01eea54863ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:17.767280 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d87ef-40c9-4e37-bde8-01eea54863ba admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:17.767571 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d87ef-40c9-4e37-bde8-01eea54863ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:17.767864 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d87ef-40c9-4e37-bde8-01eea54863ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:17.768584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d87ef-40c9-4e37-bde8-01eea54863ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:17.770561 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d87ef-40c9-4e37-bde8-01eea54863ba admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:17.798433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1222/2457] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:17 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:17.803636 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d16b61-d0a0-47bb-b7b8-4ae680fb3628 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:17.814045 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d16b61-d0a0-47bb-b7b8-4ae680fb3628 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:17.871824 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a6ef0-ba3a-4cb9-a54d-bc7863bf218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:17.872668 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a6ef0-ba3a-4cb9-a54d-bc7863bf218c admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:17.872958 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a6ef0-ba3a-4cb9-a54d-bc7863bf218c admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:17.873240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a6ef0-ba3a-4cb9-a54d-bc7863bf218c admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:17.874027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a6ef0-ba3a-4cb9-a54d-bc7863bf218c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:17.876184 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a6ef0-ba3a-4cb9-a54d-bc7863bf218c admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:17.883217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:17.897722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1236/2458] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:17 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:17.902033 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d87ef-40c9-4e37-bde8-01eea54863ba admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:17.913134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d87ef-40c9-4e37-bde8-01eea54863ba admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:17.918418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca614287-1868-4219-8f61-14361bfd674e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:17.919091 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca614287-1868-4219-8f61-14361bfd674e admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:17.919380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca614287-1868-4219-8f61-14361bfd674e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:17.919663 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca614287-1868-4219-8f61-14361bfd674e admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:17.920404 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca614287-1868-4219-8f61-14361bfd674e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:17.922019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca614287-1868-4219-8f61-14361bfd674e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:17.933526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1223/2459] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:17.937758 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a6ef0-ba3a-4cb9-a54d-bc7863bf218c admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:17.948899 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a6ef0-ba3a-4cb9-a54d-bc7863bf218c admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:17.953713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c221ac7-2d61-43eb-9971-b6d4b5c425fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:17.954443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c221ac7-2d61-43eb-9971-b6d4b5c425fd admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:17.954742 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c221ac7-2d61-43eb-9971-b6d4b5c425fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:17.955023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c221ac7-2d61-43eb-9971-b6d4b5c425fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:17.955764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c221ac7-2d61-43eb-9971-b6d4b5c425fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:17.957378 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c221ac7-2d61-43eb-9971-b6d4b5c425fd admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:17.968484 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1237/2460] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:17.972951 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca614287-1868-4219-8f61-14361bfd674e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:17.983755 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca614287-1868-4219-8f61-14361bfd674e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:17.989094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6f32a-84c0-415a-a5d8-12250b6d3007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:17.990138 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6f32a-84c0-415a-a5d8-12250b6d3007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:17.990525 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6f32a-84c0-415a-a5d8-12250b6d3007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:17.990846 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6f32a-84c0-415a-a5d8-12250b6d3007 admin admin] PATH_INFO: `/v3/projects/bc2df5ee0f5d4d8ea01a01f5f950f3a1/users/73820b136d14483182f576965c13a936/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:18.006379 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6f32a-84c0-415a-a5d8-12250b6d3007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc2df5ee0f5d4d8ea01a01f5f950f3a1, user_id=73820b136d14483182f576965c13a936, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:18.009149 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6f32a-84c0-415a-a5d8-12250b6d3007 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:18.024395 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1224/2461] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:17 2022] PUT /identity/v3/projects/bc2df5ee0f5d4d8ea01a01f5f950f3a1/users/73820b136d14483182f576965c13a936/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:18.035600 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2e71b-ce05-4626-bc33-92b0770ea9f2 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:18.036140 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2e71b-ce05-4626-bc33-92b0770ea9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:18.036140 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2e71b-ce05-4626-bc33-92b0770ea9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:18.073847 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-b5b2e71b-ce05-4626-bc33-92b0770ea9f2 None None] MFA Rules not processed for user `73820b136d14483182f576965c13a936`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:18.075299 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b5b2e71b-ce05-4626-bc33-92b0770ea9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:18.148972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1238/2462] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:18.160554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6f32a-84c0-415a-a5d8-12250b6d3007 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:18.162705 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-15f6f32a-84c0-415a-a5d8-12250b6d3007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:18.225793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6f32a-84c0-415a-a5d8-12250b6d3007 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:18.229732 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f46a9-d8b0-44c6-98a3-05dad1e069be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:18.230440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f46a9-d8b0-44c6-98a3-05dad1e069be service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:18.230732 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f46a9-d8b0-44c6-98a3-05dad1e069be service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:18.231013 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f46a9-d8b0-44c6-98a3-05dad1e069be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:18.240231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f46a9-d8b0-44c6-98a3-05dad1e069be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:18.241746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f46a9-d8b0-44c6-98a3-05dad1e069be service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:18.251366 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1225/2463] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:18.913880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2e71b-ce05-4626-bc33-92b0770ea9f2 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:18.915474 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b5b2e71b-ce05-4626-bc33-92b0770ea9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:18.973919 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2e71b-ce05-4626-bc33-92b0770ea9f2 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:18.978672 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c339a-b9e8-4d15-ac67-b4ec4cd834d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:18.979364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c339a-b9e8-4d15-ac67-b4ec4cd834d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:18.979643 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c339a-b9e8-4d15-ac67-b4ec4cd834d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:18.979917 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c339a-b9e8-4d15-ac67-b4ec4cd834d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:18.982083 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c22c339a-b9e8-4d15-ac67-b4ec4cd834d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:19.048017 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c339a-b9e8-4d15-ac67-b4ec4cd834d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:19.049466 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c339a-b9e8-4d15-ac67-b4ec4cd834d2 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:19.059631 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1239/2464] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:19.840961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f46a9-d8b0-44c6-98a3-05dad1e069be service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:19.842625 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e76f46a9-d8b0-44c6-98a3-05dad1e069be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:19.856239 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f46a9-d8b0-44c6-98a3-05dad1e069be service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:19.860987 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84521870-9fec-4f08-b3b1-8869bf120af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:19.861661 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84521870-9fec-4f08-b3b1-8869bf120af6 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:19.861944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84521870-9fec-4f08-b3b1-8869bf120af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:19.862218 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84521870-9fec-4f08-b3b1-8869bf120af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:19.865974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-84521870-9fec-4f08-b3b1-8869bf120af6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:19.958256 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84521870-9fec-4f08-b3b1-8869bf120af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:19.959814 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84521870-9fec-4f08-b3b1-8869bf120af6 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:19.972558 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1226/2465] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:22.899070 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c339a-b9e8-4d15-ac67-b4ec4cd834d2 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:22.900616 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c22c339a-b9e8-4d15-ac67-b4ec4cd834d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:22.920327 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c339a-b9e8-4d15-ac67-b4ec4cd834d2 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:22.925954 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7d8f8-57d7-4743-8201-4686d1262d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:22.927117 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7d8f8-57d7-4743-8201-4686d1262d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:22.927997 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7d8f8-57d7-4743-8201-4686d1262d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:22.928342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7d8f8-57d7-4743-8201-4686d1262d4d admin admin] PATH_INFO: `/v3/users/e1852b1ef9cf4d168d0d1ebd3d65b7be` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:22.930169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7d8f8-57d7-4743-8201-4686d1262d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1852b1ef9cf4d168d0d1ebd3d65b7be)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:22.932478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7d8f8-57d7-4743-8201-4686d1262d4d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:22.948532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:22.996962 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c4d7d8f8-57d7-4743-8201-4686d1262d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1852b1ef9cf4d168d0d1ebd3d65b7be'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:23.009488 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c4d7d8f8-57d7-4743-8201-4686d1262d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1852b1ef9cf4d168d0d1ebd3d65b7be'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:23.010448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c4d7d8f8-57d7-4743-8201-4686d1262d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1852b1ef9cf4d168d0d1ebd3d65b7be'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:23.025610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c4d7d8f8-57d7-4743-8201-4686d1262d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1852b1ef9cf4d168d0d1ebd3d65b7be'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:23.033157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c4d7d8f8-57d7-4743-8201-4686d1262d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1852b1ef9cf4d168d0d1ebd3d65b7be'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:23.040434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1240/2466] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:22 2022] DELETE /identity/v3/users/e1852b1ef9cf4d168d0d1ebd3d65b7be => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:23.414372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84521870-9fec-4f08-b3b1-8869bf120af6 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:23.431794 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84521870-9fec-4f08-b3b1-8869bf120af6 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:23.459391 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:23.582906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda1805-ee59-4a3e-a6cb-3777703a300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:23.584078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda1805-ee59-4a3e-a6cb-3777703a300c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:23.584550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda1805-ee59-4a3e-a6cb-3777703a300c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:23.585037 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda1805-ee59-4a3e-a6cb-3777703a300c admin admin] PATH_INFO: `/v3/projects/e1502c1b4a964477a87db6c4812db5ad` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:23.586719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda1805-ee59-4a3e-a6cb-3777703a300c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1502c1b4a964477a87db6c4812db5ad)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:23.589368 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda1805-ee59-4a3e-a6cb-3777703a300c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:23.662620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0cda1805-ee59-4a3e-a6cb-3777703a300c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1502c1b4a964477a87db6c4812db5ad', 'request_id': 'req-0cda1805-ee59-4a3e-a6cb-3777703a300c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:23.671613 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0cda1805-ee59-4a3e-a6cb-3777703a300c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1502c1b4a964477a87db6c4812db5ad', 'request_id': 'req-0cda1805-ee59-4a3e-a6cb-3777703a300c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:23.679406 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0cda1805-ee59-4a3e-a6cb-3777703a300c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1502c1b4a964477a87db6c4812db5ad', 'request_id': 'req-0cda1805-ee59-4a3e-a6cb-3777703a300c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:23.692141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0cda1805-ee59-4a3e-a6cb-3777703a300c admin admin] The token cache is being invalidate because project e1502c1b4a964477a87db6c4812db5ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:23.692520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0cda1805-ee59-4a3e-a6cb-3777703a300c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:23.693317 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0cda1805-ee59-4a3e-a6cb-3777703a300c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:23.696063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1227/2467] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:23 2022] DELETE /identity/v3/projects/e1502c1b4a964477a87db6c4812db5ad => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:23.700791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65805af-f5fb-446a-9273-5cefe4c86dd0 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:23.701358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65805af-f5fb-446a-9273-5cefe4c86dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:23.701934 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65805af-f5fb-446a-9273-5cefe4c86dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:23.729988 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-d65805af-f5fb-446a-9273-5cefe4c86dd0 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:23.731564 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d65805af-f5fb-446a-9273-5cefe4c86dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:23.834960 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1241/2468] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:23.837815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0796b-9eea-4779-9ad4-5498293b21fb None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:23.838461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0796b-9eea-4779-9ad4-5498293b21fb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:23.838896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0796b-9eea-4779-9ad4-5498293b21fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:23.879592 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-bbb0796b-9eea-4779-9ad4-5498293b21fb None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:23.882106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bbb0796b-9eea-4779-9ad4-5498293b21fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:23.906253 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1228/2469] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:23.907192 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65805af-f5fb-446a-9273-5cefe4c86dd0 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:23.926240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65805af-f5fb-446a-9273-5cefe4c86dd0 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:23.932632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c005b-f8be-4cdd-8e07-6371dd91a266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:23.933412 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c005b-f8be-4cdd-8e07-6371dd91a266 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:23.933759 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c005b-f8be-4cdd-8e07-6371dd91a266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:23.934098 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c005b-f8be-4cdd-8e07-6371dd91a266 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:23.934937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c005b-f8be-4cdd-8e07-6371dd91a266 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:27:23.935243 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c005b-f8be-4cdd-8e07-6371dd91a266 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:23.936965 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c005b-f8be-4cdd-8e07-6371dd91a266 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:23.953247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1242/2470] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:27:23.957455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0796b-9eea-4779-9ad4-5498293b21fb None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:23.967758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0796b-9eea-4779-9ad4-5498293b21fb None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:23.984024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37713780-7c40-4498-ab65-5655ab32b36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:23.984024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37713780-7c40-4498-ab65-5655ab32b36e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:23.984024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37713780-7c40-4498-ab65-5655ab32b36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:23.984024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37713780-7c40-4498-ab65-5655ab32b36e admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:23.984693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37713780-7c40-4498-ab65-5655ab32b36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:23.984693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37713780-7c40-4498-ab65-5655ab32b36e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:24.019626 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1229/2471] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:23 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:24.024785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c005b-f8be-4cdd-8e07-6371dd91a266 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:24.038111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c005b-f8be-4cdd-8e07-6371dd91a266 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:24.136645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5af41a-aecf-4d96-afad-9807a6a9bee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:24.137350 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5af41a-aecf-4d96-afad-9807a6a9bee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:24.137633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5af41a-aecf-4d96-afad-9807a6a9bee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:24.137907 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5af41a-aecf-4d96-afad-9807a6a9bee6 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:24.138787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5af41a-aecf-4d96-afad-9807a6a9bee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:24.140767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5af41a-aecf-4d96-afad-9807a6a9bee6 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:24.176037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1243/2472] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:24 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:24.180587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37713780-7c40-4498-ab65-5655ab32b36e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:24.191449 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37713780-7c40-4498-ab65-5655ab32b36e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:24.196651 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffc491-8d2d-4d73-9364-171ea0b85755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:24.197320 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffc491-8d2d-4d73-9364-171ea0b85755 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:24.197600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffc491-8d2d-4d73-9364-171ea0b85755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:24.197896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffc491-8d2d-4d73-9364-171ea0b85755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:24.198675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffc491-8d2d-4d73-9364-171ea0b85755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:24.200505 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffc491-8d2d-4d73-9364-171ea0b85755 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:24.212412 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1230/2473] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:24.216480 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5af41a-aecf-4d96-afad-9807a6a9bee6 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:24.227980 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5af41a-aecf-4d96-afad-9807a6a9bee6 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:24.233933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a534d-503c-4c15-9da4-dca44f1279a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:24.234671 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a534d-503c-4c15-9da4-dca44f1279a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:24.234955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a534d-503c-4c15-9da4-dca44f1279a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:24.235237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a534d-503c-4c15-9da4-dca44f1279a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:24.235978 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a534d-503c-4c15-9da4-dca44f1279a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:24.237596 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a534d-503c-4c15-9da4-dca44f1279a9 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:24.239095 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:24.256469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1244/2474] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:24.257326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffc491-8d2d-4d73-9364-171ea0b85755 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:24.269143 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffc491-8d2d-4d73-9364-171ea0b85755 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:24.274742 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4300113-1300-4036-9011-dbb917da0ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:24.275681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4300113-1300-4036-9011-dbb917da0ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:24.275965 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4300113-1300-4036-9011-dbb917da0ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:24.276243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4300113-1300-4036-9011-dbb917da0ae6 admin admin] PATH_INFO: `/v3/projects/deed922419164f11b89c9b3e074436e5/users/c0fd128c86a84f9f911f595c2107a197/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:24.292184 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4300113-1300-4036-9011-dbb917da0ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deed922419164f11b89c9b3e074436e5, user_id=c0fd128c86a84f9f911f595c2107a197, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:24.294974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4300113-1300-4036-9011-dbb917da0ae6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:24.310266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1231/2475] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:24 2022] PUT /identity/v3/projects/deed922419164f11b89c9b3e074436e5/users/c0fd128c86a84f9f911f595c2107a197/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:24.321770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555b32b-7bdf-4444-bcfa-2a8acd10352d None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:24.322067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555b32b-7bdf-4444-bcfa-2a8acd10352d None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:24.323475 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555b32b-7bdf-4444-bcfa-2a8acd10352d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:24.355623 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-5555b32b-7bdf-4444-bcfa-2a8acd10352d None None] MFA Rules not processed for user `c0fd128c86a84f9f911f595c2107a197`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:24.360844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5555b32b-7bdf-4444-bcfa-2a8acd10352d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:24.438012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1245/2476] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:24.450103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4300113-1300-4036-9011-dbb917da0ae6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:24.452486 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a4300113-1300-4036-9011-dbb917da0ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:24.511157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:24.544643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4300113-1300-4036-9011-dbb917da0ae6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:24.550275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e196e5e-afb8-40d1-ac0a-b190a604645a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:24.550956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e196e5e-afb8-40d1-ac0a-b190a604645a service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:24.551217 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e196e5e-afb8-40d1-ac0a-b190a604645a service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:24.551518 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e196e5e-afb8-40d1-ac0a-b190a604645a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:24.559767 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e196e5e-afb8-40d1-ac0a-b190a604645a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:24.561371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e196e5e-afb8-40d1-ac0a-b190a604645a service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:24.570552 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1232/2477] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:24.847141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555b32b-7bdf-4444-bcfa-2a8acd10352d None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:24.930721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555b32b-7bdf-4444-bcfa-2a8acd10352d None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:24.935831 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecba134-4dbd-490d-a629-dc9e182c641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:24.936718 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecba134-4dbd-490d-a629-dc9e182c641e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:24.937003 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecba134-4dbd-490d-a629-dc9e182c641e admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:24.937328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecba134-4dbd-490d-a629-dc9e182c641e admin admin] PATH_INFO: `/v3/users/c0fd128c86a84f9f911f595c2107a197` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:24.938750 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecba134-4dbd-490d-a629-dc9e182c641e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0fd128c86a84f9f911f595c2107a197)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:24.940721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecba134-4dbd-490d-a629-dc9e182c641e admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:24.990549 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-8ecba134-4dbd-490d-a629-dc9e182c641e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0fd128c86a84f9f911f595c2107a197'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:24.998374 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-8ecba134-4dbd-490d-a629-dc9e182c641e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0fd128c86a84f9f911f595c2107a197'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:24.999252 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-8ecba134-4dbd-490d-a629-dc9e182c641e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0fd128c86a84f9f911f595c2107a197'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:25.011920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-8ecba134-4dbd-490d-a629-dc9e182c641e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0fd128c86a84f9f911f595c2107a197'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:25.019290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-8ecba134-4dbd-490d-a629-dc9e182c641e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0fd128c86a84f9f911f595c2107a197'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:25.025982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1246/2478] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:24 2022] DELETE /identity/v3/users/c0fd128c86a84f9f911f595c2107a197 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:25.030624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9eb66-df23-4977-9196-0fc1d6d434fe None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:25.030915 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9eb66-df23-4977-9196-0fc1d6d434fe None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:25.031189 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9eb66-df23-4977-9196-0fc1d6d434fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:25.048544 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-aba9eb66-df23-4977-9196-0fc1d6d434fe None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:25.049902 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-aba9eb66-df23-4977-9196-0fc1d6d434fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:25.116753 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1233/2479] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:25.128433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecba134-4dbd-490d-a629-dc9e182c641e admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:25.129718 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8ecba134-4dbd-490d-a629-dc9e182c641e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:25.146086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:25.265294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecba134-4dbd-490d-a629-dc9e182c641e admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:25.274494 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adb594-866a-4c6b-b5c5-809037f2f330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:25.276229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adb594-866a-4c6b-b5c5-809037f2f330 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:25.276517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adb594-866a-4c6b-b5c5-809037f2f330 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:25.276799 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adb594-866a-4c6b-b5c5-809037f2f330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:25.293317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adb594-866a-4c6b-b5c5-809037f2f330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:25.297060 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adb594-866a-4c6b-b5c5-809037f2f330 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:25.310348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1247/2480] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:25.651239 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9eb66-df23-4977-9196-0fc1d6d434fe None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:25.652835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-aba9eb66-df23-4977-9196-0fc1d6d434fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:25.669600 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9eb66-df23-4977-9196-0fc1d6d434fe None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:25.677517 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf51a0b-0034-4a6e-869b-0029293da24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:25.679345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf51a0b-0034-4a6e-869b-0029293da24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:25.679653 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf51a0b-0034-4a6e-869b-0029293da24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:25.679970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf51a0b-0034-4a6e-869b-0029293da24a admin admin] PATH_INFO: `/v3/projects/deed922419164f11b89c9b3e074436e5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:25.684426 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf51a0b-0034-4a6e-869b-0029293da24a admin admin] RBAC: Authorizing `identity:delete_project(project_id=deed922419164f11b89c9b3e074436e5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:25.686940 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf51a0b-0034-4a6e-869b-0029293da24a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:25.748214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8cf51a0b-0034-4a6e-869b-0029293da24a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deed922419164f11b89c9b3e074436e5', 'request_id': 'req-8cf51a0b-0034-4a6e-869b-0029293da24a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:25.754500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8cf51a0b-0034-4a6e-869b-0029293da24a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deed922419164f11b89c9b3e074436e5', 'request_id': 'req-8cf51a0b-0034-4a6e-869b-0029293da24a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:25.773159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8cf51a0b-0034-4a6e-869b-0029293da24a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deed922419164f11b89c9b3e074436e5', 'request_id': 'req-8cf51a0b-0034-4a6e-869b-0029293da24a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:25.791233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8cf51a0b-0034-4a6e-869b-0029293da24a admin admin] The token cache is being invalidate because project deed922419164f11b89c9b3e074436e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:25.791527 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8cf51a0b-0034-4a6e-869b-0029293da24a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:25.792332 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8cf51a0b-0034-4a6e-869b-0029293da24a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:25.793882 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1234/2481] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:25 2022] DELETE /identity/v3/projects/deed922419164f11b89c9b3e074436e5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:25.798892 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1603d6-f50e-4e46-b6ac-c181d3ebd7f0 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:25.799182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1603d6-f50e-4e46-b6ac-c181d3ebd7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:25.799459 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1603d6-f50e-4e46-b6ac-c181d3ebd7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:25.820243 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-3f1603d6-f50e-4e46-b6ac-c181d3ebd7f0 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:25.821862 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3f1603d6-f50e-4e46-b6ac-c181d3ebd7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:25.899528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1248/2482] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:25.908198 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b30198-1d69-4cb7-9c8b-fd3abba95b7a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:25.908555 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b30198-1d69-4cb7-9c8b-fd3abba95b7a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:25.908841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b30198-1d69-4cb7-9c8b-fd3abba95b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:25.928466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-57b30198-1d69-4cb7-9c8b-fd3abba95b7a None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:25.930730 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-57b30198-1d69-4cb7-9c8b-fd3abba95b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:25.940424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1235/2483] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:25.944884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1603d6-f50e-4e46-b6ac-c181d3ebd7f0 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:25.955352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1603d6-f50e-4e46-b6ac-c181d3ebd7f0 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:25.960658 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230afed-811b-4b0d-bbc2-778c07df5977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:25.961560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230afed-811b-4b0d-bbc2-778c07df5977 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:25.961836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230afed-811b-4b0d-bbc2-778c07df5977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:25.962121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230afed-811b-4b0d-bbc2-778c07df5977 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:25.962869 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230afed-811b-4b0d-bbc2-778c07df5977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:27:25.963173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230afed-811b-4b0d-bbc2-778c07df5977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:25.964769 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230afed-811b-4b0d-bbc2-778c07df5977 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:25.976528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1249/2484] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:27:25.980960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b30198-1d69-4cb7-9c8b-fd3abba95b7a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:25.991387 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b30198-1d69-4cb7-9c8b-fd3abba95b7a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:25.997400 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba1755-5952-438b-8c5c-ee5571f128da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:25.998071 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba1755-5952-438b-8c5c-ee5571f128da admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:25.998357 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba1755-5952-438b-8c5c-ee5571f128da admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:25.998665 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba1755-5952-438b-8c5c-ee5571f128da admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:25.999399 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba1755-5952-438b-8c5c-ee5571f128da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:26.001336 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba1755-5952-438b-8c5c-ee5571f128da admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:26.029094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1236/2485] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:25 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:26.033269 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230afed-811b-4b0d-bbc2-778c07df5977 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:26.043458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230afed-811b-4b0d-bbc2-778c07df5977 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:26.102803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea0195-4508-42e0-ba88-9aeb1b574780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:26.103482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea0195-4508-42e0-ba88-9aeb1b574780 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:26.103767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea0195-4508-42e0-ba88-9aeb1b574780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:26.104066 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea0195-4508-42e0-ba88-9aeb1b574780 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:26.104762 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea0195-4508-42e0-ba88-9aeb1b574780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:26.106719 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea0195-4508-42e0-ba88-9aeb1b574780 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:26.129843 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1250/2486] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:26 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:26.134037 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba1755-5952-438b-8c5c-ee5571f128da admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:26.146442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba1755-5952-438b-8c5c-ee5571f128da admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:26.151593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b05a9e-8edd-47b3-a166-23236754e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:26.152253 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b05a9e-8edd-47b3-a166-23236754e852 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:26.152533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b05a9e-8edd-47b3-a166-23236754e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:26.152810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b05a9e-8edd-47b3-a166-23236754e852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:26.153562 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b05a9e-8edd-47b3-a166-23236754e852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:26.155291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b05a9e-8edd-47b3-a166-23236754e852 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:26.166237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1237/2487] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:26.170340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea0195-4508-42e0-ba88-9aeb1b574780 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:26.182785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea0195-4508-42e0-ba88-9aeb1b574780 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:26.187960 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7bbd0-d49b-4be7-9738-de5421c61188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:26.188656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7bbd0-d49b-4be7-9738-de5421c61188 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:26.188936 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7bbd0-d49b-4be7-9738-de5421c61188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:26.189209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7bbd0-d49b-4be7-9738-de5421c61188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:26.189942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7bbd0-d49b-4be7-9738-de5421c61188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:26.191654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7bbd0-d49b-4be7-9738-de5421c61188 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:26.202759 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1251/2488] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:26.207090 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b05a9e-8edd-47b3-a166-23236754e852 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:26.217464 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b05a9e-8edd-47b3-a166-23236754e852 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:26.222798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fec2d-8178-4e08-9708-7c2c27a839bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:26.223844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fec2d-8178-4e08-9708-7c2c27a839bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:26.224257 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fec2d-8178-4e08-9708-7c2c27a839bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:26.224648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fec2d-8178-4e08-9708-7c2c27a839bd admin admin] PATH_INFO: `/v3/projects/d684b28979684bcf9116606ff4d0c624/users/10e11cb84df14952b7df94611d7ba018/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:26.228933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:26.247599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fec2d-8178-4e08-9708-7c2c27a839bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d684b28979684bcf9116606ff4d0c624, user_id=10e11cb84df14952b7df94611d7ba018, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:26.251797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fec2d-8178-4e08-9708-7c2c27a839bd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:26.267974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1238/2489] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:26 2022] PUT /identity/v3/projects/d684b28979684bcf9116606ff4d0c624/users/10e11cb84df14952b7df94611d7ba018/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:26.279133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d488986-5683-42e1-a5bc-b5ef6790390e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:26.279450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d488986-5683-42e1-a5bc-b5ef6790390e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:26.279736 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d488986-5683-42e1-a5bc-b5ef6790390e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:26.308575 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:26.312483 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-3d488986-5683-42e1-a5bc-b5ef6790390e None None] MFA Rules not processed for user `10e11cb84df14952b7df94611d7ba018`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:26.315846 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3d488986-5683-42e1-a5bc-b5ef6790390e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:26.387433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1252/2490] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:26.392323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fec2d-8178-4e08-9708-7c2c27a839bd admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:26.461798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fec2d-8178-4e08-9708-7c2c27a839bd admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:26.466410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8188917-1b14-4134-86e1-b937a70fa8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:26.467076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8188917-1b14-4134-86e1-b937a70fa8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:26.467361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8188917-1b14-4134-86e1-b937a70fa8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:26.467638 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8188917-1b14-4134-86e1-b937a70fa8d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:26.468331 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8188917-1b14-4134-86e1-b937a70fa8d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:26.470254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8188917-1b14-4134-86e1-b937a70fa8d3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:26.495852 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1239/2491] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:26 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:26.500341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d488986-5683-42e1-a5bc-b5ef6790390e None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:26.511696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d488986-5683-42e1-a5bc-b5ef6790390e None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:26.574282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcae3b-d8cb-4eb8-8dd4-ac0eefd4ce90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:26.575419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcae3b-d8cb-4eb8-8dd4-ac0eefd4ce90 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:26.575852 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcae3b-d8cb-4eb8-8dd4-ac0eefd4ce90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:26.576203 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcae3b-d8cb-4eb8-8dd4-ac0eefd4ce90 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:26.577273 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcae3b-d8cb-4eb8-8dd4-ac0eefd4ce90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:26.579778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcae3b-d8cb-4eb8-8dd4-ac0eefd4ce90 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:26.601914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1253/2492] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:26 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:26.606066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8188917-1b14-4134-86e1-b937a70fa8d3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:26.618961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8188917-1b14-4134-86e1-b937a70fa8d3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:26.624401 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a71f4e-fc5f-44fb-8d88-52b4fc5fad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:26.625068 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a71f4e-fc5f-44fb-8d88-52b4fc5fad97 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:26.625352 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a71f4e-fc5f-44fb-8d88-52b4fc5fad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:26.625628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a71f4e-fc5f-44fb-8d88-52b4fc5fad97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:26.626361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a71f4e-fc5f-44fb-8d88-52b4fc5fad97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:26.628000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a71f4e-fc5f-44fb-8d88-52b4fc5fad97 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:26.639701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1240/2493] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:26.644224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcae3b-d8cb-4eb8-8dd4-ac0eefd4ce90 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:26.654678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcae3b-d8cb-4eb8-8dd4-ac0eefd4ce90 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:26.660163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0cb34-5f96-405f-8c6d-3f7b488e1dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:26.661025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0cb34-5f96-405f-8c6d-3f7b488e1dac admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:26.661307 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0cb34-5f96-405f-8c6d-3f7b488e1dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:26.661585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0cb34-5f96-405f-8c6d-3f7b488e1dac admin admin] PATH_INFO: `/v3/projects/0f5884aa47be4e99a6fbfe31d9128923/users/90b617432ccb4f6c9bbc6563299e10e3/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:26.677486 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0cb34-5f96-405f-8c6d-3f7b488e1dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5884aa47be4e99a6fbfe31d9128923, user_id=90b617432ccb4f6c9bbc6563299e10e3, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:26.680392 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0cb34-5f96-405f-8c6d-3f7b488e1dac admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:26.694449 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1254/2494] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:26 2022] PUT /identity/v3/projects/0f5884aa47be4e99a6fbfe31d9128923/users/90b617432ccb4f6c9bbc6563299e10e3/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:26.698574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a71f4e-fc5f-44fb-8d88-52b4fc5fad97 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:26.708845 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a71f4e-fc5f-44fb-8d88-52b4fc5fad97 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:26.772403 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d73bc-9bae-4b4c-aae2-c325e2d55ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:26.773137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d73bc-9bae-4b4c-aae2-c325e2d55ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:26.773419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d73bc-9bae-4b4c-aae2-c325e2d55ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:26.773737 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d73bc-9bae-4b4c-aae2-c325e2d55ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:26.774492 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d73bc-9bae-4b4c-aae2-c325e2d55ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:26.776138 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d73bc-9bae-4b4c-aae2-c325e2d55ed2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:26.787185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1241/2495] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:27:26.791628 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0cb34-5f96-405f-8c6d-3f7b488e1dac admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:26.802727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0cb34-5f96-405f-8c6d-3f7b488e1dac admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:26.808460 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7ec2c-4a56-43e7-bd22-177fbfd8d113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:26.809361 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7ec2c-4a56-43e7-bd22-177fbfd8d113 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:26.809645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7ec2c-4a56-43e7-bd22-177fbfd8d113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:26.809901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7ec2c-4a56-43e7-bd22-177fbfd8d113 admin admin] PATH_INFO: `/v3/projects/0f5884aa47be4e99a6fbfe31d9128923/users/90b617432ccb4f6c9bbc6563299e10e3/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:26.812217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7ec2c-4a56-43e7-bd22-177fbfd8d113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5884aa47be4e99a6fbfe31d9128923, user_id=90b617432ccb4f6c9bbc6563299e10e3, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:26.816084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7ec2c-4a56-43e7-bd22-177fbfd8d113 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:26.828322 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1255/2496] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:26 2022] PUT /identity/v3/projects/0f5884aa47be4e99a6fbfe31d9128923/users/90b617432ccb4f6c9bbc6563299e10e3/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:26.838806 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61489e8b-61d0-481d-9e32-d42ddd01f7d2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:26.839095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61489e8b-61d0-481d-9e32-d42ddd01f7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:26.839390 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61489e8b-61d0-481d-9e32-d42ddd01f7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:26.868084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-61489e8b-61d0-481d-9e32-d42ddd01f7d2 None None] MFA Rules not processed for user `90b617432ccb4f6c9bbc6563299e10e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:26.869709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-61489e8b-61d0-481d-9e32-d42ddd01f7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:26.919793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:26.946727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1242/2497] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:26.959563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7ec2c-4a56-43e7-bd22-177fbfd8d113 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:26.961497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-eac7ec2c-4a56-43e7-bd22-177fbfd8d113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:27.024297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7ec2c-4a56-43e7-bd22-177fbfd8d113 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:27.028883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cac83-a93d-4957-b015-10ed155e789e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:27.029767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cac83-a93d-4957-b015-10ed155e789e service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:27.029767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cac83-a93d-4957-b015-10ed155e789e service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:27.030056 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cac83-a93d-4957-b015-10ed155e789e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:27.040655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cac83-a93d-4957-b015-10ed155e789e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:27.042103 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cac83-a93d-4957-b015-10ed155e789e service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:27.045993 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:27.052973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1256/2498] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:27.455982 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61489e8b-61d0-481d-9e32-d42ddd01f7d2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:27.484129 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cac83-a93d-4957-b015-10ed155e789e service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:27.485922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9f0cac83-a93d-4957-b015-10ed155e789e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:27.539910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61489e8b-61d0-481d-9e32-d42ddd01f7d2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:27.545088 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b28f0-0191-4f92-bc19-d8d5cfa8d823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:27.547337 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b28f0-0191-4f92-bc19-d8d5cfa8d823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:27.547627 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b28f0-0191-4f92-bc19-d8d5cfa8d823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:27.548092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b28f0-0191-4f92-bc19-d8d5cfa8d823 admin admin] PATH_INFO: `/v3/users/10e11cb84df14952b7df94611d7ba018` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:27.551105 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b28f0-0191-4f92-bc19-d8d5cfa8d823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10e11cb84df14952b7df94611d7ba018)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:27.553095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b28f0-0191-4f92-bc19-d8d5cfa8d823 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:27.567499 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cac83-a93d-4957-b015-10ed155e789e service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:27.573927 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b146f5e-67b3-4086-8594-5a1c32bebde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:27.574972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b146f5e-67b3-4086-8594-5a1c32bebde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:27.575314 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b146f5e-67b3-4086-8594-5a1c32bebde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:27.575662 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b146f5e-67b3-4086-8594-5a1c32bebde2 admin admin] PATH_INFO: `/v3/users/73820b136d14483182f576965c13a936` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:27.577242 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b146f5e-67b3-4086-8594-5a1c32bebde2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73820b136d14483182f576965c13a936)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:27.582451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b146f5e-67b3-4086-8594-5a1c32bebde2 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:27.615002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b10b28f0-0191-4f92-bc19-d8d5cfa8d823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10e11cb84df14952b7df94611d7ba018'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:27.623234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b10b28f0-0191-4f92-bc19-d8d5cfa8d823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10e11cb84df14952b7df94611d7ba018'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:27.624146 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b10b28f0-0191-4f92-bc19-d8d5cfa8d823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10e11cb84df14952b7df94611d7ba018'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:27.632951 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-4b146f5e-67b3-4086-8594-5a1c32bebde2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73820b136d14483182f576965c13a936'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:27.639286 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b10b28f0-0191-4f92-bc19-d8d5cfa8d823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10e11cb84df14952b7df94611d7ba018'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:27.641656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-4b146f5e-67b3-4086-8594-5a1c32bebde2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73820b136d14483182f576965c13a936'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:27.642317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-4b146f5e-67b3-4086-8594-5a1c32bebde2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73820b136d14483182f576965c13a936'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:27.647181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b10b28f0-0191-4f92-bc19-d8d5cfa8d823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10e11cb84df14952b7df94611d7ba018'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:27.653672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1243/2499] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:27 2022] DELETE /identity/v3/users/10e11cb84df14952b7df94611d7ba018 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:27.655039 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-4b146f5e-67b3-4086-8594-5a1c32bebde2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73820b136d14483182f576965c13a936'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:27.658341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eae4b0-a78d-4dbb-a9de-43a749858261 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:27.658720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eae4b0-a78d-4dbb-a9de-43a749858261 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:27.658993 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eae4b0-a78d-4dbb-a9de-43a749858261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:27.662220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-4b146f5e-67b3-4086-8594-5a1c32bebde2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73820b136d14483182f576965c13a936'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:27.669023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1257/2500] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:27 2022] DELETE /identity/v3/users/73820b136d14483182f576965c13a936 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:27:27.673648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d8e28-fa71-4521-a0ae-484c7ae9e91f None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:27.673941 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d8e28-fa71-4521-a0ae-484c7ae9e91f None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:27.674226 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d8e28-fa71-4521-a0ae-484c7ae9e91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:27.676799 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-53eae4b0-a78d-4dbb-a9de-43a749858261 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:27.678044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-53eae4b0-a78d-4dbb-a9de-43a749858261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:27.693962 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-323d8e28-fa71-4521-a0ae-484c7ae9e91f None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:27.695769 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-323d8e28-fa71-4521-a0ae-484c7ae9e91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:27.734858 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:27.745026 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1244/2501] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:27.755733 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eae4b0-a78d-4dbb-a9de-43a749858261 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:27.757380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-53eae4b0-a78d-4dbb-a9de-43a749858261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:27.766808 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1258/2502] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:27.776231 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d8e28-fa71-4521-a0ae-484c7ae9e91f None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:27.777682 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-323d8e28-fa71-4521-a0ae-484c7ae9e91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:27.798174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:27.817606 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eae4b0-a78d-4dbb-a9de-43a749858261 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:27.821402 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10c8ae-2af0-45ae-8142-d9882c7e8a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:27.822060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10c8ae-2af0-45ae-8142-d9882c7e8a96 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:27.822348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10c8ae-2af0-45ae-8142-d9882c7e8a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:27.822657 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10c8ae-2af0-45ae-8142-d9882c7e8a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:27.833270 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10c8ae-2af0-45ae-8142-d9882c7e8a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:27.834878 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10c8ae-2af0-45ae-8142-d9882c7e8a96 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:27.839768 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d8e28-fa71-4521-a0ae-484c7ae9e91f None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:27.843893 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba49894-34bd-479b-8b3e-241418762d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:27.844644 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba49894-34bd-479b-8b3e-241418762d05 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:27.845332 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba49894-34bd-479b-8b3e-241418762d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:27.845494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1245/2503] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:27.845597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba49894-34bd-479b-8b3e-241418762d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:27.855836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba49894-34bd-479b-8b3e-241418762d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:27.858352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba49894-34bd-479b-8b3e-241418762d05 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:27.869033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1259/2504] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:27:28.301531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10c8ae-2af0-45ae-8142-d9882c7e8a96 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:28.303223 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cd10c8ae-2af0-45ae-8142-d9882c7e8a96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:28.323510 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10c8ae-2af0-45ae-8142-d9882c7e8a96 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:28.331115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c301a2d-2f70-4697-9fef-fdc50137e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:28.332004 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c301a2d-2f70-4697-9fef-fdc50137e5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:28.332291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c301a2d-2f70-4697-9fef-fdc50137e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:28.332574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c301a2d-2f70-4697-9fef-fdc50137e5e2 admin admin] PATH_INFO: `/v3/projects/d684b28979684bcf9116606ff4d0c624` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:28.333861 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c301a2d-2f70-4697-9fef-fdc50137e5e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d684b28979684bcf9116606ff4d0c624)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:28.336011 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c301a2d-2f70-4697-9fef-fdc50137e5e2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:28.340426 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba49894-34bd-479b-8b3e-241418762d05 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:28.341938 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-7ba49894-34bd-479b-8b3e-241418762d05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:28.365210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba49894-34bd-479b-8b3e-241418762d05 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:28.372532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c147c-50e9-4de6-83c7-24bbfb58ec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:28.373524 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c147c-50e9-4de6-83c7-24bbfb58ec19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:28.373812 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c147c-50e9-4de6-83c7-24bbfb58ec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:28.374212 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c147c-50e9-4de6-83c7-24bbfb58ec19 admin admin] PATH_INFO: `/v3/projects/bc2df5ee0f5d4d8ea01a01f5f950f3a1` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:28.375551 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c147c-50e9-4de6-83c7-24bbfb58ec19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc2df5ee0f5d4d8ea01a01f5f950f3a1)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:28.377813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c147c-50e9-4de6-83c7-24bbfb58ec19 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:28.393496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3c301a2d-2f70-4697-9fef-fdc50137e5e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd684b28979684bcf9116606ff4d0c624', 'request_id': 'req-3c301a2d-2f70-4697-9fef-fdc50137e5e2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:28.400437 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3c301a2d-2f70-4697-9fef-fdc50137e5e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd684b28979684bcf9116606ff4d0c624', 'request_id': 'req-3c301a2d-2f70-4697-9fef-fdc50137e5e2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:28.408021 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3c301a2d-2f70-4697-9fef-fdc50137e5e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd684b28979684bcf9116606ff4d0c624', 'request_id': 'req-3c301a2d-2f70-4697-9fef-fdc50137e5e2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:28.420615 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3c301a2d-2f70-4697-9fef-fdc50137e5e2 admin admin] The token cache is being invalidate because project d684b28979684bcf9116606ff4d0c624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:28.420909 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3c301a2d-2f70-4697-9fef-fdc50137e5e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:28.421520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3c301a2d-2f70-4697-9fef-fdc50137e5e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:28.423307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1246/2505] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:28 2022] DELETE /identity/v3/projects/d684b28979684bcf9116606ff4d0c624 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:28.427401 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c301a2d-2f70-4697-9fef-fdc50137e5e2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:28.429268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-626c147c-50e9-4de6-83c7-24bbfb58ec19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc2df5ee0f5d4d8ea01a01f5f950f3a1', 'request_id': 'req-626c147c-50e9-4de6-83c7-24bbfb58ec19'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:28.429406 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3c301a2d-2f70-4697-9fef-fdc50137e5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:28.435197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-626c147c-50e9-4de6-83c7-24bbfb58ec19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc2df5ee0f5d4d8ea01a01f5f950f3a1', 'request_id': 'req-626c147c-50e9-4de6-83c7-24bbfb58ec19'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:28.442272 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-626c147c-50e9-4de6-83c7-24bbfb58ec19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc2df5ee0f5d4d8ea01a01f5f950f3a1', 'request_id': 'req-626c147c-50e9-4de6-83c7-24bbfb58ec19'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:28.456251 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-626c147c-50e9-4de6-83c7-24bbfb58ec19 admin admin] The token cache is being invalidate because project bc2df5ee0f5d4d8ea01a01f5f950f3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:28.456544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-626c147c-50e9-4de6-83c7-24bbfb58ec19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:28.457176 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-626c147c-50e9-4de6-83c7-24bbfb58ec19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:28.462272 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1260/2506] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:28 2022] DELETE /identity/v3/projects/bc2df5ee0f5d4d8ea01a01f5f950f3a1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:27:28.463814 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bac13-982a-4fd5-80bf-162029abc975 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:28.464182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bac13-982a-4fd5-80bf-162029abc975 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:28.464542 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bac13-982a-4fd5-80bf-162029abc975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:28.483588 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-297bac13-982a-4fd5-80bf-162029abc975 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:28.484805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-297bac13-982a-4fd5-80bf-162029abc975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:28.495382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c301a2d-2f70-4697-9fef-fdc50137e5e2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:28.525587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:28.547259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1261/2507] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:28.554141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5561815-f2b7-4764-98f4-b7b66fb4b1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:28.555050 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5561815-f2b7-4764-98f4-b7b66fb4b1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:28.555332 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5561815-f2b7-4764-98f4-b7b66fb4b1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:28.555586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98545f4-6c48-4acc-b965-d16248dc8b8d None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:28.555709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5561815-f2b7-4764-98f4-b7b66fb4b1d7 admin admin] PATH_INFO: `/v3/users/90b617432ccb4f6c9bbc6563299e10e3` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:28.555880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98545f4-6c48-4acc-b965-d16248dc8b8d None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:28.556192 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98545f4-6c48-4acc-b965-d16248dc8b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:28.556820 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5561815-f2b7-4764-98f4-b7b66fb4b1d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90b617432ccb4f6c9bbc6563299e10e3)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:28.558767 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5561815-f2b7-4764-98f4-b7b66fb4b1d7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:28.575887 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-b98545f4-6c48-4acc-b965-d16248dc8b8d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:28.577088 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b98545f4-6c48-4acc-b965-d16248dc8b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:28.585624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1262/2508] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:28.593669 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98545f4-6c48-4acc-b965-d16248dc8b8d None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:28.603507 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98545f4-6c48-4acc-b965-d16248dc8b8d None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:28.612171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76b729-2f30-4f57-9946-671b9b7b7450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:28.612171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76b729-2f30-4f57-9946-671b9b7b7450 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:28.612171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76b729-2f30-4f57-9946-671b9b7b7450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:28.612171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76b729-2f30-4f57-9946-671b9b7b7450 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:28.612904 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e5561815-f2b7-4764-98f4-b7b66fb4b1d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90b617432ccb4f6c9bbc6563299e10e3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:28.613009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76b729-2f30-4f57-9946-671b9b7b7450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:27:28.613009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76b729-2f30-4f57-9946-671b9b7b7450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:28.614338 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76b729-2f30-4f57-9946-671b9b7b7450 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:28.620628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e5561815-f2b7-4764-98f4-b7b66fb4b1d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90b617432ccb4f6c9bbc6563299e10e3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:28.621400 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e5561815-f2b7-4764-98f4-b7b66fb4b1d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90b617432ccb4f6c9bbc6563299e10e3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:28.630423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1263/2509] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:27:28.632342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76b729-2f30-4f57-9946-671b9b7b7450 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:28.635519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-4e76b729-2f30-4f57-9946-671b9b7b7450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:28.642370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e5561815-f2b7-4764-98f4-b7b66fb4b1d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90b617432ccb4f6c9bbc6563299e10e3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:28.654377 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76b729-2f30-4f57-9946-671b9b7b7450 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:28.654756 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e5561815-f2b7-4764-98f4-b7b66fb4b1d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90b617432ccb4f6c9bbc6563299e10e3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:28.657814 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33129b-2d08-427e-b884-7766905ff175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:28.658543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33129b-2d08-427e-b884-7766905ff175 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:28.658817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33129b-2d08-427e-b884-7766905ff175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:28.659100 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33129b-2d08-427e-b884-7766905ff175 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:28.659620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1247/2510] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:28 2022] DELETE /identity/v3/users/90b617432ccb4f6c9bbc6563299e10e3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:27:28.659913 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33129b-2d08-427e-b884-7766905ff175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:28.661843 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33129b-2d08-427e-b884-7766905ff175 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:28.695260 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1264/2511] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:28 2022] POST /identity/v3/projects => generated 403 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:28.699283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5561815-f2b7-4764-98f4-b7b66fb4b1d7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:28.705639 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33129b-2d08-427e-b884-7766905ff175 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:28.708604 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9d33129b-2d08-427e-b884-7766905ff175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:28.714309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:28.777084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33129b-2d08-427e-b884-7766905ff175 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:28.781713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3d6a5-a653-4cbd-9301-eb6c3de104f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:28.782588 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3d6a5-a653-4cbd-9301-eb6c3de104f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:28.782704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3d6a5-a653-4cbd-9301-eb6c3de104f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:28.782975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3d6a5-a653-4cbd-9301-eb6c3de104f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:28.784881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b6f3d6a5-a653-4cbd-9301-eb6c3de104f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:28.785769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5561815-f2b7-4764-98f4-b7b66fb4b1d7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:28.851734 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ca5a2-1c5d-4602-bfd9-f392baf2eb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:28.852497 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ca5a2-1c5d-4602-bfd9-f392baf2eb39 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:28.852844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ca5a2-1c5d-4602-bfd9-f392baf2eb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:28.853187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ca5a2-1c5d-4602-bfd9-f392baf2eb39 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:28.853967 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ca5a2-1c5d-4602-bfd9-f392baf2eb39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:28.856066 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ca5a2-1c5d-4602-bfd9-f392baf2eb39 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:28.860070 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3d6a5-a653-4cbd-9301-eb6c3de104f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:28.861543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3d6a5-a653-4cbd-9301-eb6c3de104f5 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:28.863632 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:28.875174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1265/2512] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:27:28.883833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1248/2513] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:28 2022] POST /identity/v3/users => generated 302 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:28.888105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3d6a5-a653-4cbd-9301-eb6c3de104f5 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:28.898609 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3d6a5-a653-4cbd-9301-eb6c3de104f5 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:28.903481 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bee05-816d-4c2d-b232-af946a5167c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:28.904238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bee05-816d-4c2d-b232-af946a5167c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:28.904519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bee05-816d-4c2d-b232-af946a5167c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:28.904791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bee05-816d-4c2d-b232-af946a5167c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:28.905523 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bee05-816d-4c2d-b232-af946a5167c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:28.907204 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bee05-816d-4c2d-b232-af946a5167c3 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:28.917765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1266/2514] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:28.921928 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ca5a2-1c5d-4602-bfd9-f392baf2eb39 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:28.932348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ca5a2-1c5d-4602-bfd9-f392baf2eb39 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:28.937170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f71fb2-d9bd-4dd8-a8f7-163951d5bfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:28.937851 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f71fb2-d9bd-4dd8-a8f7-163951d5bfba admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:28.938139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f71fb2-d9bd-4dd8-a8f7-163951d5bfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:28.938444 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f71fb2-d9bd-4dd8-a8f7-163951d5bfba admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:28.939434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f71fb2-d9bd-4dd8-a8f7-163951d5bfba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:28.940990 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f71fb2-d9bd-4dd8-a8f7-163951d5bfba admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:28.954462 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1249/2515] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:28.956154 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bee05-816d-4c2d-b232-af946a5167c3 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:28.966849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bee05-816d-4c2d-b232-af946a5167c3 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:28.971290 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8688f-9c86-4850-b3ff-b3c0e18f54fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:28.972174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8688f-9c86-4850-b3ff-b3c0e18f54fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:28.972453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8688f-9c86-4850-b3ff-b3c0e18f54fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:28.972727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8688f-9c86-4850-b3ff-b3c0e18f54fb admin admin] PATH_INFO: `/v3/projects/44648a614578472f84cfa88355bd6a68/users/f4d985e3ae6b4bcbb5502c384071890d/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:28.990654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8688f-9c86-4850-b3ff-b3c0e18f54fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=44648a614578472f84cfa88355bd6a68, user_id=f4d985e3ae6b4bcbb5502c384071890d, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:28.994563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8688f-9c86-4850-b3ff-b3c0e18f54fb admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:29.008874 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1267/2516] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:28 2022] PUT /identity/v3/projects/44648a614578472f84cfa88355bd6a68/users/f4d985e3ae6b4bcbb5502c384071890d/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:29.019250 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c3ad9-f9ed-4f83-b588-c383f17f5225 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.019551 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c3ad9-f9ed-4f83-b588-c383f17f5225 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.019835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c3ad9-f9ed-4f83-b588-c383f17f5225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.051777 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5b8c3ad9-f9ed-4f83-b588-c383f17f5225 None None] MFA Rules not processed for user `f4d985e3ae6b4bcbb5502c384071890d`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:29.052963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5b8c3ad9-f9ed-4f83-b588-c383f17f5225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:29.119435 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8688f-9c86-4850-b3ff-b3c0e18f54fb admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:29.122222 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6af8688f-9c86-4850-b3ff-b3c0e18f54fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:29.134577 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1250/2517] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:29.146875 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c3ad9-f9ed-4f83-b588-c383f17f5225 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:29.222402 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8688f-9c86-4850-b3ff-b3c0e18f54fb admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:29.225507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c3ad9-f9ed-4f83-b588-c383f17f5225 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:29.228152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d9688-eca2-49d3-ab31-88d4053c681b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:29.229201 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d9688-eca2-49d3-ab31-88d4053c681b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.229537 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d9688-eca2-49d3-ab31-88d4053c681b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.229904 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d9688-eca2-49d3-ab31-88d4053c681b admin admin] PATH_INFO: `/v3/projects/0f5884aa47be4e99a6fbfe31d9128923` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.231216 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d9688-eca2-49d3-ab31-88d4053c681b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f5884aa47be4e99a6fbfe31d9128923)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:29.231787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6d527-e65f-40c4-af0c-7cc831b9c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:29.232470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6d527-e65f-40c4-af0c-7cc831b9c84a admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.232766 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6d527-e65f-40c4-af0c-7cc831b9c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.233051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6d527-e65f-40c4-af0c-7cc831b9c84a admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.233711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d9688-eca2-49d3-ab31-88d4053c681b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:29.234124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6d527-e65f-40c4-af0c-7cc831b9c84a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:29.236626 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6d527-e65f-40c4-af0c-7cc831b9c84a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:29.257310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:29.273508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1251/2518] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:29 2022] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:29.274709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6d527-e65f-40c4-af0c-7cc831b9c84a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:29.293017 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-177d9688-eca2-49d3-ab31-88d4053c681b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f5884aa47be4e99a6fbfe31d9128923', 'request_id': 'req-177d9688-eca2-49d3-ab31-88d4053c681b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:29.298952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-177d9688-eca2-49d3-ab31-88d4053c681b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f5884aa47be4e99a6fbfe31d9128923', 'request_id': 'req-177d9688-eca2-49d3-ab31-88d4053c681b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:29.306082 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-177d9688-eca2-49d3-ab31-88d4053c681b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f5884aa47be4e99a6fbfe31d9128923', 'request_id': 'req-177d9688-eca2-49d3-ab31-88d4053c681b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:29.322439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-177d9688-eca2-49d3-ab31-88d4053c681b admin admin] The token cache is being invalidate because project 0f5884aa47be4e99a6fbfe31d9128923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:29.323066 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-177d9688-eca2-49d3-ab31-88d4053c681b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:29.324046 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-177d9688-eca2-49d3-ab31-88d4053c681b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:29.326113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1268/2519] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:29 2022] DELETE /identity/v3/projects/0f5884aa47be4e99a6fbfe31d9128923 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:29.330986 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6d05c-6398-4152-80d7-16a98da79654 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.331288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6d05c-6398-4152-80d7-16a98da79654 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.331561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6d05c-6398-4152-80d7-16a98da79654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.342819 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:29.351308 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-51a6d05c-6398-4152-80d7-16a98da79654 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:29.352965 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-51a6d05c-6398-4152-80d7-16a98da79654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:29.356803 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6d527-e65f-40c4-af0c-7cc831b9c84a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:29.418585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7f304-ef57-4e80-bfc0-fdda854f67e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:29.419381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7f304-ef57-4e80-bfc0-fdda854f67e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.420044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7f304-ef57-4e80-bfc0-fdda854f67e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.420044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7f304-ef57-4e80-bfc0-fdda854f67e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.420928 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7f304-ef57-4e80-bfc0-fdda854f67e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:29.423044 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7f304-ef57-4e80-bfc0-fdda854f67e7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:29.426617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1269/2520] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:29.434318 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d431c31-77d0-4e40-9789-6068a0d36245 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.434875 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d431c31-77d0-4e40-9789-6068a0d36245 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.435078 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d431c31-77d0-4e40-9789-6068a0d36245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.447966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1252/2521] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:29 2022] POST /identity/v3/users => generated 309 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:29.451662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7f304-ef57-4e80-bfc0-fdda854f67e7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:29.453531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b1c7f304-ef57-4e80-bfc0-fdda854f67e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:29.462953 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-1d431c31-77d0-4e40-9789-6068a0d36245 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:29.464222 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1d431c31-77d0-4e40-9789-6068a0d36245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:29.466693 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7f304-ef57-4e80-bfc0-fdda854f67e7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:29.472783 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1270/2522] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:29.474549 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d82be4-4b81-4de1-a7ed-ff4e8d22a7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:29.475486 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d82be4-4b81-4de1-a7ed-ff4e8d22a7af admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.475999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d82be4-4b81-4de1-a7ed-ff4e8d22a7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.476318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d82be4-4b81-4de1-a7ed-ff4e8d22a7af admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.476868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d431c31-77d0-4e40-9789-6068a0d36245 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:29.477083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d82be4-4b81-4de1-a7ed-ff4e8d22a7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:29.479081 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d82be4-4b81-4de1-a7ed-ff4e8d22a7af admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:29.487667 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d431c31-77d0-4e40-9789-6068a0d36245 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:29.495966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1253/2523] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:27:29.496225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce6ace-efe3-4d79-a0eb-2d662ea9112f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:29.496225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce6ace-efe3-4d79-a0eb-2d662ea9112f admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.496225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce6ace-efe3-4d79-a0eb-2d662ea9112f admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.496225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce6ace-efe3-4d79-a0eb-2d662ea9112f admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.496648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce6ace-efe3-4d79-a0eb-2d662ea9112f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:27:29.496648 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce6ace-efe3-4d79-a0eb-2d662ea9112f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:29.497366 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce6ace-efe3-4d79-a0eb-2d662ea9112f admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:29.498285 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d82be4-4b81-4de1-a7ed-ff4e8d22a7af admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:29.514090 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1271/2524] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:27:29.514343 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d82be4-4b81-4de1-a7ed-ff4e8d22a7af admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:29.519086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc1187-d1c6-4cc4-85de-46b6d84cd014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:29.520471 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc1187-d1c6-4cc4-85de-46b6d84cd014 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.520860 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc1187-d1c6-4cc4-85de-46b6d84cd014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.521236 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc1187-d1c6-4cc4-85de-46b6d84cd014 admin admin] PATH_INFO: `/v3/projects/30caa1f109ff4aa289656d2ffdaf2c1e/users/1174b4051f71416583e13aaf95daecf7/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.527403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce6ace-efe3-4d79-a0eb-2d662ea9112f admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:29.541432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce6ace-efe3-4d79-a0eb-2d662ea9112f admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:29.543678 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc1187-d1c6-4cc4-85de-46b6d84cd014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30caa1f109ff4aa289656d2ffdaf2c1e, user_id=1174b4051f71416583e13aaf95daecf7, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:29.546703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a0d22-7300-49ce-86b3-4c0a8cdf241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:29.546898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc1187-d1c6-4cc4-85de-46b6d84cd014 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:29.547643 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a0d22-7300-49ce-86b3-4c0a8cdf241a admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.547927 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a0d22-7300-49ce-86b3-4c0a8cdf241a admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.548202 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a0d22-7300-49ce-86b3-4c0a8cdf241a admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.548910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a0d22-7300-49ce-86b3-4c0a8cdf241a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:29.550941 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a0d22-7300-49ce-86b3-4c0a8cdf241a admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:29.570554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1254/2525] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:29 2022] PUT /identity/v3/projects/30caa1f109ff4aa289656d2ffdaf2c1e/users/1174b4051f71416583e13aaf95daecf7/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:29.572751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc1187-d1c6-4cc4-85de-46b6d84cd014 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:29.589285 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1272/2526] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:29 2022] POST /identity/v3/projects => generated 365 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:29.592199 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a0d22-7300-49ce-86b3-4c0a8cdf241a admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:29.653644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc1187-d1c6-4cc4-85de-46b6d84cd014 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:29.666026 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a0d22-7300-49ce-86b3-4c0a8cdf241a admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:29.670870 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a23103-17a4-4ff9-9b01-81faadf954a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:29.671557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a23103-17a4-4ff9-9b01-81faadf954a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.672331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a23103-17a4-4ff9-9b01-81faadf954a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.672331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a23103-17a4-4ff9-9b01-81faadf954a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.672974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a23103-17a4-4ff9-9b01-81faadf954a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:29.675377 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a23103-17a4-4ff9-9b01-81faadf954a9 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:29.686971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:29.706615 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1273/2527] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:29 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:29.707742 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a23103-17a4-4ff9-9b01-81faadf954a9 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:29.718870 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a23103-17a4-4ff9-9b01-81faadf954a9 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:29.724435 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcb7a3-b548-463b-a9d9-7fb9b004f3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:29.725292 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcb7a3-b548-463b-a9d9-7fb9b004f3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.725583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcb7a3-b548-463b-a9d9-7fb9b004f3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.725998 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcb7a3-b548-463b-a9d9-7fb9b004f3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.726821 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4ad41-3f48-4e7a-a58c-59fcb00d72fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:29.726969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcb7a3-b548-463b-a9d9-7fb9b004f3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:29.727750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4ad41-3f48-4e7a-a58c-59fcb00d72fd admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.728032 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4ad41-3f48-4e7a-a58c-59fcb00d72fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.728306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4ad41-3f48-4e7a-a58c-59fcb00d72fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.728530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcb7a3-b548-463b-a9d9-7fb9b004f3f8 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:29.729048 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4ad41-3f48-4e7a-a58c-59fcb00d72fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:29.730725 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4ad41-3f48-4e7a-a58c-59fcb00d72fd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:29.733101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:29.746217 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1255/2528] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:29.750550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4ad41-3f48-4e7a-a58c-59fcb00d72fd admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:29.750740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1274/2529] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:29.752298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcb7a3-b548-463b-a9d9-7fb9b004f3f8 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:29.761406 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4ad41-3f48-4e7a-a58c-59fcb00d72fd admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:29.764232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcb7a3-b548-463b-a9d9-7fb9b004f3f8 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:29.766706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664526a-a6c5-4074-b260-fed6993a86d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:29.767824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664526a-a6c5-4074-b260-fed6993a86d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.768049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664526a-a6c5-4074-b260-fed6993a86d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.768479 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664526a-a6c5-4074-b260-fed6993a86d6 admin admin] PATH_INFO: `/v3/projects/30caa1f109ff4aa289656d2ffdaf2c1e/users/1174b4051f71416583e13aaf95daecf7/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.769884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8152ce5-6421-437a-93b0-33a077487eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:29.771160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664526a-a6c5-4074-b260-fed6993a86d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30caa1f109ff4aa289656d2ffdaf2c1e, user_id=1174b4051f71416583e13aaf95daecf7, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:29.771298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8152ce5-6421-437a-93b0-33a077487eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.771298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8152ce5-6421-437a-93b0-33a077487eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.771298 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8152ce5-6421-437a-93b0-33a077487eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.772265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8152ce5-6421-437a-93b0-33a077487eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:29.773456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664526a-a6c5-4074-b260-fed6993a86d6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:29.774125 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8152ce5-6421-437a-93b0-33a077487eb3 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:29.786281 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1256/2530] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:29 2022] PUT /identity/v3/projects/30caa1f109ff4aa289656d2ffdaf2c1e/users/1174b4051f71416583e13aaf95daecf7/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:29.791686 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1275/2531] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:27:29.793176 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664526a-a6c5-4074-b260-fed6993a86d6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:29.797780 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab83245-2bf7-4996-a5b0-e54e66c8d36a None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.798065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab83245-2bf7-4996-a5b0-e54e66c8d36a None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.798342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab83245-2bf7-4996-a5b0-e54e66c8d36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.829012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-cab83245-2bf7-4996-a5b0-e54e66c8d36a None None] MFA Rules not processed for user `1174b4051f71416583e13aaf95daecf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:29.830206 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-cab83245-2bf7-4996-a5b0-e54e66c8d36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:29.863801 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664526a-a6c5-4074-b260-fed6993a86d6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:29.869350 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83e2e8-569c-4862-a1be-5a5209765b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:29.870506 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83e2e8-569c-4862-a1be-5a5209765b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.870716 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83e2e8-569c-4862-a1be-5a5209765b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.870992 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83e2e8-569c-4862-a1be-5a5209765b94 admin admin] PATH_INFO: `/v3/projects/99796cc6307a4359885eeb7b6f3eb2b5/users/4622d37dfe1b44ef95c46b8a24f55ac2/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.888187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83e2e8-569c-4862-a1be-5a5209765b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99796cc6307a4359885eeb7b6f3eb2b5, user_id=4622d37dfe1b44ef95c46b8a24f55ac2, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:29.890950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83e2e8-569c-4862-a1be-5a5209765b94 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:29.909471 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1257/2532] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:29 2022] PUT /identity/v3/projects/99796cc6307a4359885eeb7b6f3eb2b5/users/4622d37dfe1b44ef95c46b8a24f55ac2/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:27:29.913425 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1276/2533] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:29 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:29.919879 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a862b4e-34c0-49ae-9cff-c8ab20d56759 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:29.920163 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a862b4e-34c0-49ae-9cff-c8ab20d56759 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:29.920443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a862b4e-34c0-49ae-9cff-c8ab20d56759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:29.925160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab83245-2bf7-4996-a5b0-e54e66c8d36a None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:29.926858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-cab83245-2bf7-4996-a5b0-e54e66c8d36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:29.956609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4a862b4e-34c0-49ae-9cff-c8ab20d56759 None None] MFA Rules not processed for user `4622d37dfe1b44ef95c46b8a24f55ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:29.958681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4a862b4e-34c0-49ae-9cff-c8ab20d56759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:29.997594 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab83245-2bf7-4996-a5b0-e54e66c8d36a None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:30.047233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1258/2534] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:30.051992 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a862b4e-34c0-49ae-9cff-c8ab20d56759 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:30.055632 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b68ab-b800-4bf5-9375-3ccb28e16d4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:30.056573 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b68ab-b800-4bf5-9375-3ccb28e16d4b service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:30.057018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b68ab-b800-4bf5-9375-3ccb28e16d4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:30.057491 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b68ab-b800-4bf5-9375-3ccb28e16d4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:30.092985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:30.130751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:30.136430 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b68ab-b800-4bf5-9375-3ccb28e16d4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:30.138145 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b68ab-b800-4bf5-9375-3ccb28e16d4b service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:30.139585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a862b4e-34c0-49ae-9cff-c8ab20d56759 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:30.151144 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad841d0c-5e49-43fd-ae2c-0b7733170ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:30.151840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad841d0c-5e49-43fd-ae2c-0b7733170ece admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:30.152798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad841d0c-5e49-43fd-ae2c-0b7733170ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:30.153090 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad841d0c-5e49-43fd-ae2c-0b7733170ece admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:30.153801 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad841d0c-5e49-43fd-ae2c-0b7733170ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:30.155959 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad841d0c-5e49-43fd-ae2c-0b7733170ece admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:30.162545 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1277/2535] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:29 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:27:30.200710 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1259/2536] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:30 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:30.205660 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b68ab-b800-4bf5-9375-3ccb28e16d4b service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:30.218701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b68ab-b800-4bf5-9375-3ccb28e16d4b service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:30.313242 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5ca08-8f3d-4abf-96dd-d4e34e4623d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:30.314804 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5ca08-8f3d-4abf-96dd-d4e34e4623d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:30.315301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5ca08-8f3d-4abf-96dd-d4e34e4623d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:30.315764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5ca08-8f3d-4abf-96dd-d4e34e4623d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:30.317002 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5ca08-8f3d-4abf-96dd-d4e34e4623d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:30.320880 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5ca08-8f3d-4abf-96dd-d4e34e4623d6 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:30.349280 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad841d0c-5e49-43fd-ae2c-0b7733170ece admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:30.362116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1278/2537] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:30 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:30.367957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5ca08-8f3d-4abf-96dd-d4e34e4623d6 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:30.373263 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad841d0c-5e49-43fd-ae2c-0b7733170ece admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:30.382197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5ca08-8f3d-4abf-96dd-d4e34e4623d6 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:30.383223 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409efb50-70dc-4674-b2e0-e5f383b41147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:30.385224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409efb50-70dc-4674-b2e0-e5f383b41147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:30.385755 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409efb50-70dc-4674-b2e0-e5f383b41147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:30.386138 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409efb50-70dc-4674-b2e0-e5f383b41147 admin admin] PATH_INFO: `/v3/users/f4d985e3ae6b4bcbb5502c384071890d` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:30.387864 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17c061-1c27-4529-acd5-7f6eff4d8a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:30.388257 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409efb50-70dc-4674-b2e0-e5f383b41147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d985e3ae6b4bcbb5502c384071890d)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:30.388541 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17c061-1c27-4529-acd5-7f6eff4d8a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:30.388807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17c061-1c27-4529-acd5-7f6eff4d8a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:30.389086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17c061-1c27-4529-acd5-7f6eff4d8a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:30.389833 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17c061-1c27-4529-acd5-7f6eff4d8a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:30.391255 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409efb50-70dc-4674-b2e0-e5f383b41147 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:30.391521 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17c061-1c27-4529-acd5-7f6eff4d8a0b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:30.407974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1279/2538] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:30.409195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17c061-1c27-4529-acd5-7f6eff4d8a0b admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:30.422313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17c061-1c27-4529-acd5-7f6eff4d8a0b admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:30.427556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde677d-76df-4b77-8643-8f44304bd3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:30.428458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde677d-76df-4b77-8643-8f44304bd3ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:30.428741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde677d-76df-4b77-8643-8f44304bd3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:30.429094 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde677d-76df-4b77-8643-8f44304bd3ab admin admin] PATH_INFO: `/v3/projects/063ca2fac2bd4c0a8ff1cc60927fab4a/users/7ca34e77c69a497f84786cd3f6e6ea6b/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:30.448855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde677d-76df-4b77-8643-8f44304bd3ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=063ca2fac2bd4c0a8ff1cc60927fab4a, user_id=7ca34e77c69a497f84786cd3f6e6ea6b, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:30.451662 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde677d-76df-4b77-8643-8f44304bd3ab admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:30.453744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-409efb50-70dc-4674-b2e0-e5f383b41147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d985e3ae6b4bcbb5502c384071890d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:30.463923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-409efb50-70dc-4674-b2e0-e5f383b41147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d985e3ae6b4bcbb5502c384071890d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:30.464891 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-409efb50-70dc-4674-b2e0-e5f383b41147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d985e3ae6b4bcbb5502c384071890d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:30.468495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1280/2539] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:30 2022] PUT /identity/v3/projects/063ca2fac2bd4c0a8ff1cc60927fab4a/users/7ca34e77c69a497f84786cd3f6e6ea6b/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:30.472324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde677d-76df-4b77-8643-8f44304bd3ab admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:30.474024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-dfde677d-76df-4b77-8643-8f44304bd3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:30.484760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-409efb50-70dc-4674-b2e0-e5f383b41147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d985e3ae6b4bcbb5502c384071890d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:30.493060 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-409efb50-70dc-4674-b2e0-e5f383b41147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d985e3ae6b4bcbb5502c384071890d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:30.502117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1260/2540] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:30 2022] DELETE /identity/v3/users/f4d985e3ae6b4bcbb5502c384071890d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:27:30.506748 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9fa94-9a47-4e5b-80b3-a2633e1d658d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:30.507464 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9fa94-9a47-4e5b-80b3-a2633e1d658d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:30.508291 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9fa94-9a47-4e5b-80b3-a2633e1d658d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:30.533816 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-aaf9fa94-9a47-4e5b-80b3-a2633e1d658d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:30.535380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-aaf9fa94-9a47-4e5b-80b3-a2633e1d658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:30.555171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde677d-76df-4b77-8643-8f44304bd3ab admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:30.583509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:30.610261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1261/2541] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:30.621279 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9fa94-9a47-4e5b-80b3-a2633e1d658d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:30.622912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-aaf9fa94-9a47-4e5b-80b3-a2633e1d658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:30.629157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f107d-4e0a-4b89-bfdc-ab2f9864377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:30.630334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f107d-4e0a-4b89-bfdc-ab2f9864377c admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:30.630657 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f107d-4e0a-4b89-bfdc-ab2f9864377c admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:30.631371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f107d-4e0a-4b89-bfdc-ab2f9864377c admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:30.631990 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f107d-4e0a-4b89-bfdc-ab2f9864377c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:30.634424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f107d-4e0a-4b89-bfdc-ab2f9864377c admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:30.646993 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1281/2542] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:27:30.651813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f107d-4e0a-4b89-bfdc-ab2f9864377c admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:30.662500 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f107d-4e0a-4b89-bfdc-ab2f9864377c admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:30.668079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bc6a8-fac9-40db-8483-fa4119d27720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:30.668977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc6a8-fac9-40db-8483-fa4119d27720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:30.669254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc6a8-fac9-40db-8483-fa4119d27720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:30.669529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc6a8-fac9-40db-8483-fa4119d27720 admin admin] PATH_INFO: `/v3/projects/063ca2fac2bd4c0a8ff1cc60927fab4a/users/7ca34e77c69a497f84786cd3f6e6ea6b/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:30.677693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bc6a8-fac9-40db-8483-fa4119d27720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=063ca2fac2bd4c0a8ff1cc60927fab4a, user_id=7ca34e77c69a497f84786cd3f6e6ea6b, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:30.680945 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bc6a8-fac9-40db-8483-fa4119d27720 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:30.687147 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9fa94-9a47-4e5b-80b3-a2633e1d658d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:30.694240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1282/2543] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:30 2022] PUT /identity/v3/projects/063ca2fac2bd4c0a8ff1cc60927fab4a/users/7ca34e77c69a497f84786cd3f6e6ea6b/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:27:30.696391 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:30.706793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a8ee8-1308-45cf-9b57-6f47ed7a5328 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:30.707168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a8ee8-1308-45cf-9b57-6f47ed7a5328 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:30.707455 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a8ee8-1308-45cf-9b57-6f47ed7a5328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:30.751713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-3d9a8ee8-1308-45cf-9b57-6f47ed7a5328 None None] MFA Rules not processed for user `7ca34e77c69a497f84786cd3f6e6ea6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:30.753138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3d9a8ee8-1308-45cf-9b57-6f47ed7a5328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:30.753837 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77addb-eafa-4a8e-b3a5-89703e800f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:30.754542 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77addb-eafa-4a8e-b3a5-89703e800f6e service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:30.754829 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77addb-eafa-4a8e-b3a5-89703e800f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:30.755112 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77addb-eafa-4a8e-b3a5-89703e800f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:30.841907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77addb-eafa-4a8e-b3a5-89703e800f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:30.843481 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77addb-eafa-4a8e-b3a5-89703e800f6e service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:30.856616 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1262/2544] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:27:30.858539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1283/2545] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:30 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:30.865871 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77addb-eafa-4a8e-b3a5-89703e800f6e service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:30.867459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5b77addb-eafa-4a8e-b3a5-89703e800f6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:30.929325 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77addb-eafa-4a8e-b3a5-89703e800f6e service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:30.933843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a23f7c-34ec-44cc-89a0-c09455c5d573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:30.934531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a23f7c-34ec-44cc-89a0-c09455c5d573 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:30.934818 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a23f7c-34ec-44cc-89a0-c09455c5d573 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:30.935099 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a23f7c-34ec-44cc-89a0-c09455c5d573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:30.945281 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a23f7c-34ec-44cc-89a0-c09455c5d573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:30.946956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a23f7c-34ec-44cc-89a0-c09455c5d573 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:30.957827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1263/2546] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:31.372229 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a8ee8-1308-45cf-9b57-6f47ed7a5328 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:31.373920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3d9a8ee8-1308-45cf-9b57-6f47ed7a5328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:31.399493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a8ee8-1308-45cf-9b57-6f47ed7a5328 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:31.409937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbad24-8478-4e48-800b-a77df15f856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:31.410886 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbad24-8478-4e48-800b-a77df15f856d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:31.411182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbad24-8478-4e48-800b-a77df15f856d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:31.411448 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbad24-8478-4e48-800b-a77df15f856d admin admin] PATH_INFO: `/v3/projects/44648a614578472f84cfa88355bd6a68` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:31.412677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbad24-8478-4e48-800b-a77df15f856d admin admin] RBAC: Authorizing `identity:delete_project(project_id=44648a614578472f84cfa88355bd6a68)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:31.414667 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbad24-8478-4e48-800b-a77df15f856d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:31.488008 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c9fbad24-8478-4e48-800b-a77df15f856d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44648a614578472f84cfa88355bd6a68', 'request_id': 'req-c9fbad24-8478-4e48-800b-a77df15f856d'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:31.509696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c9fbad24-8478-4e48-800b-a77df15f856d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44648a614578472f84cfa88355bd6a68', 'request_id': 'req-c9fbad24-8478-4e48-800b-a77df15f856d'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:31.518514 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c9fbad24-8478-4e48-800b-a77df15f856d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44648a614578472f84cfa88355bd6a68', 'request_id': 'req-c9fbad24-8478-4e48-800b-a77df15f856d'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:31.544301 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c9fbad24-8478-4e48-800b-a77df15f856d admin admin] The token cache is being invalidate because project 44648a614578472f84cfa88355bd6a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:31.544596 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c9fbad24-8478-4e48-800b-a77df15f856d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:31.544727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a23f7c-34ec-44cc-89a0-c09455c5d573 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:31.545585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c9fbad24-8478-4e48-800b-a77df15f856d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:31.549408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1284/2547] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:31 2022] DELETE /identity/v3/projects/44648a614578472f84cfa88355bd6a68 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:31.554673 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbad24-8478-4e48-800b-a77df15f856d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:31.556247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c9fbad24-8478-4e48-800b-a77df15f856d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:31.566782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a23f7c-34ec-44cc-89a0-c09455c5d573 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:31.584323 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:31.634572 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a0f8d-b10b-4ebf-af05-16e99d8e7032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:31.635548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a0f8d-b10b-4ebf-af05-16e99d8e7032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:31.635840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a0f8d-b10b-4ebf-af05-16e99d8e7032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:31.636114 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a0f8d-b10b-4ebf-af05-16e99d8e7032 admin admin] PATH_INFO: `/v3/users/4622d37dfe1b44ef95c46b8a24f55ac2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:31.637350 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a0f8d-b10b-4ebf-af05-16e99d8e7032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4622d37dfe1b44ef95c46b8a24f55ac2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:31.639358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a0f8d-b10b-4ebf-af05-16e99d8e7032 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:31.640265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbad24-8478-4e48-800b-a77df15f856d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:31.644457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:31.646875 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a40cfe-786c-4197-b269-ecacb4258e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:31.647449 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a40cfe-786c-4197-b269-ecacb4258e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:31.648144 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a40cfe-786c-4197-b269-ecacb4258e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:31.648792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a40cfe-786c-4197-b269-ecacb4258e7b admin admin] PATH_INFO: `/v3/users/1174b4051f71416583e13aaf95daecf7` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:31.650031 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a40cfe-786c-4197-b269-ecacb4258e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1174b4051f71416583e13aaf95daecf7)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:31.652005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a40cfe-786c-4197-b269-ecacb4258e7b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:31.696656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-475a0f8d-b10b-4ebf-af05-16e99d8e7032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4622d37dfe1b44ef95c46b8a24f55ac2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:31.707549 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-475a0f8d-b10b-4ebf-af05-16e99d8e7032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4622d37dfe1b44ef95c46b8a24f55ac2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:31.707800 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-64a40cfe-786c-4197-b269-ecacb4258e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1174b4051f71416583e13aaf95daecf7'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:31.708387 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-475a0f8d-b10b-4ebf-af05-16e99d8e7032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4622d37dfe1b44ef95c46b8a24f55ac2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:31.715505 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-64a40cfe-786c-4197-b269-ecacb4258e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1174b4051f71416583e13aaf95daecf7'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:31.716458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-64a40cfe-786c-4197-b269-ecacb4258e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1174b4051f71416583e13aaf95daecf7'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:31.726168 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-475a0f8d-b10b-4ebf-af05-16e99d8e7032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4622d37dfe1b44ef95c46b8a24f55ac2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:31.730445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-64a40cfe-786c-4197-b269-ecacb4258e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1174b4051f71416583e13aaf95daecf7'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:31.734691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-475a0f8d-b10b-4ebf-af05-16e99d8e7032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4622d37dfe1b44ef95c46b8a24f55ac2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:31.738185 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-64a40cfe-786c-4197-b269-ecacb4258e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1174b4051f71416583e13aaf95daecf7'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:31.741040 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1264/2548] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:31 2022] DELETE /identity/v3/users/4622d37dfe1b44ef95c46b8a24f55ac2 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:31.746054 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f42f9-f3ce-4de7-82f2-7c968d85949e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:31.746345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f42f9-f3ce-4de7-82f2-7c968d85949e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:31.746694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f42f9-f3ce-4de7-82f2-7c968d85949e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:31.748211 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1285/2549] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:31 2022] DELETE /identity/v3/users/1174b4051f71416583e13aaf95daecf7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:31.766210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cb6f42f9-f3ce-4de7-82f2-7c968d85949e None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:31.767469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cb6f42f9-f3ce-4de7-82f2-7c968d85949e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:31.835190 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1265/2550] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:31.849309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a40cfe-786c-4197-b269-ecacb4258e7b admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:31.851114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-64a40cfe-786c-4197-b269-ecacb4258e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:31.955116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a40cfe-786c-4197-b269-ecacb4258e7b admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:31.961544 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97d85d-d79d-423b-b8f7-3fd24830919c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:31.962235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97d85d-d79d-423b-b8f7-3fd24830919c service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:31.962658 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97d85d-d79d-423b-b8f7-3fd24830919c service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:31.962870 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97d85d-d79d-423b-b8f7-3fd24830919c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:31.975865 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97d85d-d79d-423b-b8f7-3fd24830919c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:31.977404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97d85d-d79d-423b-b8f7-3fd24830919c service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:31.991167 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1286/2551] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:27:32.084644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f42f9-f3ce-4de7-82f2-7c968d85949e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:32.086821 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cb6f42f9-f3ce-4de7-82f2-7c968d85949e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:32.105539 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f42f9-f3ce-4de7-82f2-7c968d85949e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:32.111087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0b72d-dad2-40a3-9652-28877dff4e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:32.111971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0b72d-dad2-40a3-9652-28877dff4e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:32.112256 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0b72d-dad2-40a3-9652-28877dff4e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:32.112531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0b72d-dad2-40a3-9652-28877dff4e22 admin admin] PATH_INFO: `/v3/projects/30caa1f109ff4aa289656d2ffdaf2c1e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:32.114758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0b72d-dad2-40a3-9652-28877dff4e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30caa1f109ff4aa289656d2ffdaf2c1e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:32.117501 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0b72d-dad2-40a3-9652-28877dff4e22 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:32.199883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8bf0b72d-dad2-40a3-9652-28877dff4e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30caa1f109ff4aa289656d2ffdaf2c1e', 'request_id': 'req-8bf0b72d-dad2-40a3-9652-28877dff4e22'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:32.207520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8bf0b72d-dad2-40a3-9652-28877dff4e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30caa1f109ff4aa289656d2ffdaf2c1e', 'request_id': 'req-8bf0b72d-dad2-40a3-9652-28877dff4e22'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:32.214739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8bf0b72d-dad2-40a3-9652-28877dff4e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30caa1f109ff4aa289656d2ffdaf2c1e', 'request_id': 'req-8bf0b72d-dad2-40a3-9652-28877dff4e22'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:32.231550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8bf0b72d-dad2-40a3-9652-28877dff4e22 admin admin] The token cache is being invalidate because project 30caa1f109ff4aa289656d2ffdaf2c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:32.232163 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8bf0b72d-dad2-40a3-9652-28877dff4e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:32.233072 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8bf0b72d-dad2-40a3-9652-28877dff4e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:32.235485 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1266/2552] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:32 2022] DELETE /identity/v3/projects/30caa1f109ff4aa289656d2ffdaf2c1e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:32.240744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51432a3a-c416-40cc-8d2f-4db89480befc None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:32.241034 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51432a3a-c416-40cc-8d2f-4db89480befc None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:32.241312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51432a3a-c416-40cc-8d2f-4db89480befc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:32.266044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-51432a3a-c416-40cc-8d2f-4db89480befc None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:32.267410 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-51432a3a-c416-40cc-8d2f-4db89480befc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:32.306462 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:32.355240 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1287/2553] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:32.360532 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9bda1-3314-4373-bf77-daa4ada960e1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:32.360907 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9bda1-3314-4373-bf77-daa4ada960e1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:32.361290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9bda1-3314-4373-bf77-daa4ada960e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:32.391985 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:32.406739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b6b9bda1-3314-4373-bf77-daa4ada960e1 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:32.408850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b6b9bda1-3314-4373-bf77-daa4ada960e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:32.423898 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1267/2554] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:32.428875 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51432a3a-c416-40cc-8d2f-4db89480befc None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:32.441492 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51432a3a-c416-40cc-8d2f-4db89480befc None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:32.449374 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53870003-47ef-449a-b2d4-a6d122915a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:32.450641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53870003-47ef-449a-b2d4-a6d122915a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:32.451356 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53870003-47ef-449a-b2d4-a6d122915a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:32.451840 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53870003-47ef-449a-b2d4-a6d122915a87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:32.452787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53870003-47ef-449a-b2d4-a6d122915a87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:27:32.453267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53870003-47ef-449a-b2d4-a6d122915a87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:32.456344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53870003-47ef-449a-b2d4-a6d122915a87 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:32.472442 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1288/2555] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:27:32.476894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9bda1-3314-4373-bf77-daa4ada960e1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:32.493023 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9bda1-3314-4373-bf77-daa4ada960e1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:32.511595 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53870003-47ef-449a-b2d4-a6d122915a87 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:32.511803 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1457173-bcbd-4f8c-8f3e-cd9cbdfdc184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:32.512581 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1457173-bcbd-4f8c-8f3e-cd9cbdfdc184 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:32.512963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1457173-bcbd-4f8c-8f3e-cd9cbdfdc184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:32.513471 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1457173-bcbd-4f8c-8f3e-cd9cbdfdc184 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:32.513836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-53870003-47ef-449a-b2d4-a6d122915a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:32.514500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1457173-bcbd-4f8c-8f3e-cd9cbdfdc184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:32.516634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1457173-bcbd-4f8c-8f3e-cd9cbdfdc184 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:32.535894 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53870003-47ef-449a-b2d4-a6d122915a87 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:32.541705 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980df8bc-c159-4058-b03e-978d8a4fa86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:32.543698 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980df8bc-c159-4058-b03e-978d8a4fa86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:32.544168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980df8bc-c159-4058-b03e-978d8a4fa86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:32.544633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980df8bc-c159-4058-b03e-978d8a4fa86b admin admin] PATH_INFO: `/v3/projects/99796cc6307a4359885eeb7b6f3eb2b5` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:32.546926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980df8bc-c159-4058-b03e-978d8a4fa86b admin admin] RBAC: Authorizing `identity:delete_project(project_id=99796cc6307a4359885eeb7b6f3eb2b5)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:32.549193 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980df8bc-c159-4058-b03e-978d8a4fa86b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:32.570339 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1268/2556] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:32 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:32.571950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1457173-bcbd-4f8c-8f3e-cd9cbdfdc184 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:32.640724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-980df8bc-c159-4058-b03e-978d8a4fa86b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99796cc6307a4359885eeb7b6f3eb2b5', 'request_id': 'req-980df8bc-c159-4058-b03e-978d8a4fa86b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:32.651270 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-980df8bc-c159-4058-b03e-978d8a4fa86b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99796cc6307a4359885eeb7b6f3eb2b5', 'request_id': 'req-980df8bc-c159-4058-b03e-978d8a4fa86b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:32.664121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-980df8bc-c159-4058-b03e-978d8a4fa86b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99796cc6307a4359885eeb7b6f3eb2b5', 'request_id': 'req-980df8bc-c159-4058-b03e-978d8a4fa86b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:32.673611 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1457173-bcbd-4f8c-8f3e-cd9cbdfdc184 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:32.696401 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-980df8bc-c159-4058-b03e-978d8a4fa86b admin admin] The token cache is being invalidate because project 99796cc6307a4359885eeb7b6f3eb2b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:32.696748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-980df8bc-c159-4058-b03e-978d8a4fa86b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:32.697428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-980df8bc-c159-4058-b03e-978d8a4fa86b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:32.699532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1289/2557] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:32 2022] DELETE /identity/v3/projects/99796cc6307a4359885eeb7b6f3eb2b5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:32.703293 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980df8bc-c159-4058-b03e-978d8a4fa86b admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:32.705430 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-980df8bc-c159-4058-b03e-978d8a4fa86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:32.777425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d33ec0-dc72-4a3d-b585-5cd07c870ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:32.778120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d33ec0-dc72-4a3d-b585-5cd07c870ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:32.779530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d33ec0-dc72-4a3d-b585-5cd07c870ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:32.779530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d33ec0-dc72-4a3d-b585-5cd07c870ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:32.779530 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d33ec0-dc72-4a3d-b585-5cd07c870ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:32.781421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d33ec0-dc72-4a3d-b585-5cd07c870ee8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:32.808314 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1269/2558] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:32 2022] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:32.812208 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d33ec0-dc72-4a3d-b585-5cd07c870ee8 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:32.814592 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-80d33ec0-dc72-4a3d-b585-5cd07c870ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:32.825883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980df8bc-c159-4058-b03e-978d8a4fa86b admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:32.828711 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d33ec0-dc72-4a3d-b585-5cd07c870ee8 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:32.834087 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da80c9-86c5-418d-b5ca-5498f6b2abcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:32.835278 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da80c9-86c5-418d-b5ca-5498f6b2abcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:32.835577 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da80c9-86c5-418d-b5ca-5498f6b2abcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:32.835857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da80c9-86c5-418d-b5ca-5498f6b2abcc admin admin] PATH_INFO: `/v3/users/7ca34e77c69a497f84786cd3f6e6ea6b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:32.836067 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07f960-9b2f-4f8d-9598-47bbb1193d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:32.836805 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07f960-9b2f-4f8d-9598-47bbb1193d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:32.837131 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da80c9-86c5-418d-b5ca-5498f6b2abcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca34e77c69a497f84786cd3f6e6ea6b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:32.837250 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07f960-9b2f-4f8d-9598-47bbb1193d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:32.837534 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07f960-9b2f-4f8d-9598-47bbb1193d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:32.838338 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07f960-9b2f-4f8d-9598-47bbb1193d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:32.840206 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07f960-9b2f-4f8d-9598-47bbb1193d3a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:32.844129 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da80c9-86c5-418d-b5ca-5498f6b2abcc admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:32.858735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1270/2559] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:27:32.859893 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07f960-9b2f-4f8d-9598-47bbb1193d3a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:32.862142 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9a07f960-9b2f-4f8d-9598-47bbb1193d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:32.902027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e9da80c9-86c5-418d-b5ca-5498f6b2abcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca34e77c69a497f84786cd3f6e6ea6b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:32.907023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:32.913590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e9da80c9-86c5-418d-b5ca-5498f6b2abcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca34e77c69a497f84786cd3f6e6ea6b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:32.913590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e9da80c9-86c5-418d-b5ca-5498f6b2abcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca34e77c69a497f84786cd3f6e6ea6b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:32.932778 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e9da80c9-86c5-418d-b5ca-5498f6b2abcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca34e77c69a497f84786cd3f6e6ea6b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:32.940454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e9da80c9-86c5-418d-b5ca-5498f6b2abcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca34e77c69a497f84786cd3f6e6ea6b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:32.947815 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1290/2560] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:32 2022] DELETE /identity/v3/users/7ca34e77c69a497f84786cd3f6e6ea6b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:32.948727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da80c9-86c5-418d-b5ca-5498f6b2abcc admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:32.950167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07f960-9b2f-4f8d-9598-47bbb1193d3a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:32.950688 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e9da80c9-86c5-418d-b5ca-5498f6b2abcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:32.953949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:33.025633 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79024bfa-e751-40d1-90dd-c5816fde9ca3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92b73e1a514148b19bb6a1d2a39e32cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:33.026301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024bfa-e751-40d1-90dd-c5816fde9ca3 service placement] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.026627 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024bfa-e751-40d1-90dd-c5816fde9ca3 service placement] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.026903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024bfa-e751-40d1-90dd-c5816fde9ca3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.029328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-79024bfa-e751-40d1-90dd-c5816fde9ca3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:33.041935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79024bfa-e751-40d1-90dd-c5816fde9ca3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:33.043631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79024bfa-e751-40d1-90dd-c5816fde9ca3 service placement] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:33.045611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da80c9-86c5-418d-b5ca-5498f6b2abcc admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:33.052030 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ea7e2-70e7-4800-8066-195f8fa7297d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:33.052955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ea7e2-70e7-4800-8066-195f8fa7297d admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.053380 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ea7e2-70e7-4800-8066-195f8fa7297d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.053919 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ea7e2-70e7-4800-8066-195f8fa7297d admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.054511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1271/2561] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:33.054943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ea7e2-70e7-4800-8066-195f8fa7297d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:33.055253 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79024bfa-e751-40d1-90dd-c5816fde9ca3 service placement] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:33.056914 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ea7e2-70e7-4800-8066-195f8fa7297d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:33.057041 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-79024bfa-e751-40d1-90dd-c5816fde9ca3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:33.070557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1291/2562] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:33.072879 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ea7e2-70e7-4800-8066-195f8fa7297d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:33.074194 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79024bfa-e751-40d1-90dd-c5816fde9ca3 service placement] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:33.080793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf22bd-cf06-44b3-9b6e-14c3ea84dee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:33.081943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf22bd-cf06-44b3-9b6e-14c3ea84dee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.082365 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf22bd-cf06-44b3-9b6e-14c3ea84dee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.082786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf22bd-cf06-44b3-9b6e-14c3ea84dee7 admin admin] PATH_INFO: `/v3/users/896e2214f4794e90a5f0416e016d0dde` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.085031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf22bd-cf06-44b3-9b6e-14c3ea84dee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=896e2214f4794e90a5f0416e016d0dde)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:33.087429 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf22bd-cf06-44b3-9b6e-14c3ea84dee7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:33.099440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ea7e2-70e7-4800-8066-195f8fa7297d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:33.104846 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4450c0-6f18-4c95-b580-466ef00df716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:33.106905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4450c0-6f18-4c95-b580-466ef00df716 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.107313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4450c0-6f18-4c95-b580-466ef00df716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.107722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4450c0-6f18-4c95-b580-466ef00df716 admin admin] PATH_INFO: `/v3/projects/8549b45f15d24934a9037dc285dbf74d/users/25b33e634bac4bb8bdd3a5bf5b6e1d53/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.134788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4450c0-6f18-4c95-b580-466ef00df716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8549b45f15d24934a9037dc285dbf74d, user_id=25b33e634bac4bb8bdd3a5bf5b6e1d53, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:33.138491 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4450c0-6f18-4c95-b580-466ef00df716 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:33.167579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1292/2563] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:33 2022] PUT /identity/v3/projects/8549b45f15d24934a9037dc285dbf74d/users/25b33e634bac4bb8bdd3a5bf5b6e1d53/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:27:33.173017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4adf22bd-cf06-44b3-9b6e-14c3ea84dee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896e2214f4794e90a5f0416e016d0dde'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:33.181147 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bc3bf-76d8-40fb-a01c-65c208dff4e8 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.181428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bc3bf-76d8-40fb-a01c-65c208dff4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.181738 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bc3bf-76d8-40fb-a01c-65c208dff4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.192059 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4adf22bd-cf06-44b3-9b6e-14c3ea84dee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896e2214f4794e90a5f0416e016d0dde'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:33.193897 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4adf22bd-cf06-44b3-9b6e-14c3ea84dee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896e2214f4794e90a5f0416e016d0dde'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:33.217598 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-f85bc3bf-76d8-40fb-a01c-65c208dff4e8 None None] MFA Rules not processed for user `25b33e634bac4bb8bdd3a5bf5b6e1d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:33.218632 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4adf22bd-cf06-44b3-9b6e-14c3ea84dee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896e2214f4794e90a5f0416e016d0dde'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:33.219025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f85bc3bf-76d8-40fb-a01c-65c208dff4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:33.231870 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4adf22bd-cf06-44b3-9b6e-14c3ea84dee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896e2214f4794e90a5f0416e016d0dde'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:33.241215 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1272/2564] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:33 2022] DELETE /identity/v3/users/896e2214f4794e90a5f0416e016d0dde => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:33.297839 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf22bd-cf06-44b3-9b6e-14c3ea84dee7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:33.299902 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4adf22bd-cf06-44b3-9b6e-14c3ea84dee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:33.320210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1293/2565] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:33.324461 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bc3bf-76d8-40fb-a01c-65c208dff4e8 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:33.326312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f85bc3bf-76d8-40fb-a01c-65c208dff4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:33.379112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:33.396251 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf22bd-cf06-44b3-9b6e-14c3ea84dee7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:33.401686 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a063d-2282-4e5c-925c-75aa5799c7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:33.402932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a063d-2282-4e5c-925c-75aa5799c7d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.403334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a063d-2282-4e5c-925c-75aa5799c7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.403629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a063d-2282-4e5c-925c-75aa5799c7d6 admin admin] PATH_INFO: `/v3/projects/063ca2fac2bd4c0a8ff1cc60927fab4a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.405123 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a063d-2282-4e5c-925c-75aa5799c7d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=063ca2fac2bd4c0a8ff1cc60927fab4a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:33.407128 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a063d-2282-4e5c-925c-75aa5799c7d6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:33.418335 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:33.424040 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bc3bf-76d8-40fb-a01c-65c208dff4e8 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:33.430127 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b9ce8-1bad-4a35-b475-4241ef987963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:33.430929 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b9ce8-1bad-4a35-b475-4241ef987963 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.431183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b9ce8-1bad-4a35-b475-4241ef987963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.431473 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b9ce8-1bad-4a35-b475-4241ef987963 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.432168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b9ce8-1bad-4a35-b475-4241ef987963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:33.434233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b9ce8-1bad-4a35-b475-4241ef987963 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:33.466455 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1294/2566] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:33 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:33.466455 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b9ce8-1bad-4a35-b475-4241ef987963 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:33.468112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-867b9ce8-1bad-4a35-b475-4241ef987963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:33.492502 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b31a063d-2282-4e5c-925c-75aa5799c7d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '063ca2fac2bd4c0a8ff1cc60927fab4a', 'request_id': 'req-b31a063d-2282-4e5c-925c-75aa5799c7d6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:33.498507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b31a063d-2282-4e5c-925c-75aa5799c7d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '063ca2fac2bd4c0a8ff1cc60927fab4a', 'request_id': 'req-b31a063d-2282-4e5c-925c-75aa5799c7d6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:33.504933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b31a063d-2282-4e5c-925c-75aa5799c7d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '063ca2fac2bd4c0a8ff1cc60927fab4a', 'request_id': 'req-b31a063d-2282-4e5c-925c-75aa5799c7d6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:33.518200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b31a063d-2282-4e5c-925c-75aa5799c7d6 admin admin] The token cache is being invalidate because project 063ca2fac2bd4c0a8ff1cc60927fab4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:33.518596 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b31a063d-2282-4e5c-925c-75aa5799c7d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:33.519237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b31a063d-2282-4e5c-925c-75aa5799c7d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:33.521034 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1273/2567] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:33 2022] DELETE /identity/v3/projects/063ca2fac2bd4c0a8ff1cc60927fab4a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:33.522008 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a063d-2282-4e5c-925c-75aa5799c7d6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:33.523434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b31a063d-2282-4e5c-925c-75aa5799c7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:33.540398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b9ce8-1bad-4a35-b475-4241ef987963 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:33.605749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a063d-2282-4e5c-925c-75aa5799c7d6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:33.606886 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d4713-7cbb-441c-ae98-d96c8602a44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:33.607776 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d4713-7cbb-441c-ae98-d96c8602a44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.608060 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d4713-7cbb-441c-ae98-d96c8602a44d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.608339 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d4713-7cbb-441c-ae98-d96c8602a44d admin admin] PATH_INFO: `/v3/projects/09b949fc3a4443e89d37de3256adb793` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.609560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d4713-7cbb-441c-ae98-d96c8602a44d admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b949fc3a4443e89d37de3256adb793)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:33.610781 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1f1ed-ee20-4d36-828a-518b7394416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:33.611489 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f1ed-ee20-4d36-828a-518b7394416c admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.611617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d4713-7cbb-441c-ae98-d96c8602a44d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:33.611772 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f1ed-ee20-4d36-828a-518b7394416c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.612049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1f1ed-ee20-4d36-828a-518b7394416c admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.612769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1f1ed-ee20-4d36-828a-518b7394416c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:33.614736 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1f1ed-ee20-4d36-828a-518b7394416c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:33.636732 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1274/2568] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:33 2022] POST /identity/v3/users => generated 300 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:33.638021 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6050a13-7469-4e7f-a4c1-5ef19a5951c5 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.638550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6050a13-7469-4e7f-a4c1-5ef19a5951c5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.638845 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6050a13-7469-4e7f-a4c1-5ef19a5951c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.657949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a6050a13-7469-4e7f-a4c1-5ef19a5951c5 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:33.659185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a6050a13-7469-4e7f-a4c1-5ef19a5951c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:33.662977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c75d4713-7cbb-441c-ae98-d96c8602a44d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b949fc3a4443e89d37de3256adb793', 'request_id': 'req-c75d4713-7cbb-441c-ae98-d96c8602a44d'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:33.669744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c75d4713-7cbb-441c-ae98-d96c8602a44d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b949fc3a4443e89d37de3256adb793', 'request_id': 'req-c75d4713-7cbb-441c-ae98-d96c8602a44d'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:33.676077 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c75d4713-7cbb-441c-ae98-d96c8602a44d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b949fc3a4443e89d37de3256adb793', 'request_id': 'req-c75d4713-7cbb-441c-ae98-d96c8602a44d'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:33.678543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:33.691010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c75d4713-7cbb-441c-ae98-d96c8602a44d admin admin] The token cache is being invalidate because project 09b949fc3a4443e89d37de3256adb793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:33.691410 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c75d4713-7cbb-441c-ae98-d96c8602a44d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:33.692224 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-c75d4713-7cbb-441c-ae98-d96c8602a44d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:33.693851 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1295/2569] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:33 2022] DELETE /identity/v3/projects/09b949fc3a4443e89d37de3256adb793 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:33.697677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d4713-7cbb-441c-ae98-d96c8602a44d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:33.697677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c75d4713-7cbb-441c-ae98-d96c8602a44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:33.725674 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1275/2570] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:33.727093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e52f3c-0b21-4b5d-b849-6ccbfaecb470 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.727388 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e52f3c-0b21-4b5d-b849-6ccbfaecb470 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.727676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e52f3c-0b21-4b5d-b849-6ccbfaecb470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.746722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-29e52f3c-0b21-4b5d-b849-6ccbfaecb470 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:33.747943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-29e52f3c-0b21-4b5d-b849-6ccbfaecb470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:33.756641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1276/2571] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:33.764209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b000fe-3803-4e7d-8667-c4c312bf938b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.764209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b000fe-3803-4e7d-8667-c4c312bf938b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.764209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b000fe-3803-4e7d-8667-c4c312bf938b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.765726 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d4713-7cbb-441c-ae98-d96c8602a44d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:33.770900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8dbcd4-0f2c-4b1c-b7e4-10b9337ba1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:33.771581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dbcd4-0f2c-4b1c-b7e4-10b9337ba1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.771868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dbcd4-0f2c-4b1c-b7e4-10b9337ba1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.772151 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dbcd4-0f2c-4b1c-b7e4-10b9337ba1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.772922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8dbcd4-0f2c-4b1c-b7e4-10b9337ba1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:33.774576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8dbcd4-0f2c-4b1c-b7e4-10b9337ba1f9 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:33.782219 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c5b000fe-3803-4e7d-8667-c4c312bf938b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:33.783480 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c5b000fe-3803-4e7d-8667-c4c312bf938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:33.785266 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1296/2572] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:33.786677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacd44f-5671-4bbc-aa4f-82fae2bbc95b None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.786963 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacd44f-5671-4bbc-aa4f-82fae2bbc95b None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.787237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacd44f-5671-4bbc-aa4f-82fae2bbc95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.793191 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1277/2573] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:33.793978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b000fe-3803-4e7d-8667-c4c312bf938b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:33.804118 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b000fe-3803-4e7d-8667-c4c312bf938b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:33.805903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-6cacd44f-5671-4bbc-aa4f-82fae2bbc95b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:33.807133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6cacd44f-5671-4bbc-aa4f-82fae2bbc95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:33.809619 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2854f1b-7c1a-4954-bde2-d6bd40368d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:33.810617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2854f1b-7c1a-4954-bde2-d6bd40368d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.810903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2854f1b-7c1a-4954-bde2-d6bd40368d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.811194 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2854f1b-7c1a-4954-bde2-d6bd40368d86 admin admin] PATH_INFO: `/v3/projects/40f9c2b2829047739a963edf1588dfa4/users/8a76a680ce464f68bb772d28887163c6/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.815655 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1297/2574] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:33.816482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacd44f-5671-4bbc-aa4f-82fae2bbc95b None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:33.824005 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:33.826407 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacd44f-5671-4bbc-aa4f-82fae2bbc95b None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:33.827719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2854f1b-7c1a-4954-bde2-d6bd40368d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f9c2b2829047739a963edf1588dfa4, user_id=8a76a680ce464f68bb772d28887163c6, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:33.831776 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9b338-17f5-4f23-936b-969ef882f1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:33.832318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2854f1b-7c1a-4954-bde2-d6bd40368d86 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:33.832449 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9b338-17f5-4f23-936b-969ef882f1ec admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.832715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9b338-17f5-4f23-936b-969ef882f1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.832991 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9b338-17f5-4f23-936b-969ef882f1ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.833733 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9b338-17f5-4f23-936b-969ef882f1ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:27:33.834039 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9b338-17f5-4f23-936b-969ef882f1ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:33.835713 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9b338-17f5-4f23-936b-969ef882f1ec admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:33.847666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1278/2575] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:33 2022] PUT /identity/v3/projects/40f9c2b2829047739a963edf1588dfa4/users/8a76a680ce464f68bb772d28887163c6/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:33.848158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1298/2576] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:27:33.848900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2854f1b-7c1a-4954-bde2-d6bd40368d86 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:33.852173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9b338-17f5-4f23-936b-969ef882f1ec admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:33.862319 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9b338-17f5-4f23-936b-969ef882f1ec admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:33.920899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2854f1b-7c1a-4954-bde2-d6bd40368d86 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:33.925639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f131cc-0903-4da8-8c07-9db363d8f47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:33.926382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f131cc-0903-4da8-8c07-9db363d8f47d admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.926656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f131cc-0903-4da8-8c07-9db363d8f47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.926943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f131cc-0903-4da8-8c07-9db363d8f47d admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.927698 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f131cc-0903-4da8-8c07-9db363d8f47d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:27:33.928006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f131cc-0903-4da8-8c07-9db363d8f47d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:33.928294 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cf1f1-4db5-44a5-a8c6-9b5879a2ef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:33.929031 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cf1f1-4db5-44a5-a8c6-9b5879a2ef59 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.929313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cf1f1-4db5-44a5-a8c6-9b5879a2ef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.929590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cf1f1-4db5-44a5-a8c6-9b5879a2ef59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.929688 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f131cc-0903-4da8-8c07-9db363d8f47d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:33.930415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cf1f1-4db5-44a5-a8c6-9b5879a2ef59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:33.932166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cf1f1-4db5-44a5-a8c6-9b5879a2ef59 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:33.941851 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1279/2577] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:27:33.942491 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1299/2578] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:27:33.942732 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f131cc-0903-4da8-8c07-9db363d8f47d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:33.946200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cf1f1-4db5-44a5-a8c6-9b5879a2ef59 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:33.955049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f131cc-0903-4da8-8c07-9db363d8f47d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:33.956166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cf1f1-4db5-44a5-a8c6-9b5879a2ef59 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:33.959885 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a3b85-5099-4722-914e-6270240abf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:33.960568 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a3b85-5099-4722-914e-6270240abf69 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.960857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a3b85-5099-4722-914e-6270240abf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.960979 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02d2c7-4791-48f5-8668-47eb62fc3569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:33.961137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a3b85-5099-4722-914e-6270240abf69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.961599 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02d2c7-4791-48f5-8668-47eb62fc3569 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:33.961883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02d2c7-4791-48f5-8668-47eb62fc3569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:33.961981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a3b85-5099-4722-914e-6270240abf69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:33.962162 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02d2c7-4791-48f5-8668-47eb62fc3569 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:33.962889 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02d2c7-4791-48f5-8668-47eb62fc3569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:33.963893 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a3b85-5099-4722-914e-6270240abf69 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:33.964824 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02d2c7-4791-48f5-8668-47eb62fc3569 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:33.991949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1280/2579] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:33 2022] POST /identity/v3/projects => generated 357 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:33.992602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1300/2580] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:33 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:33.992818 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a3b85-5099-4722-914e-6270240abf69 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:33.996043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02d2c7-4791-48f5-8668-47eb62fc3569 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.043154 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:34.059290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a3b85-5099-4722-914e-6270240abf69 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.062233 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02d2c7-4791-48f5-8668-47eb62fc3569 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.064006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad71561-ce0d-4ffe-bf41-8e500e38602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.064902 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad71561-ce0d-4ffe-bf41-8e500e38602b admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.065185 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad71561-ce0d-4ffe-bf41-8e500e38602b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.065514 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad71561-ce0d-4ffe-bf41-8e500e38602b admin admin] PATH_INFO: `/v3/projects/40f9c2b2829047739a963edf1588dfa4/users/8a76a680ce464f68bb772d28887163c6/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.067070 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb0f4d-e381-4db1-971f-3a93ef298700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.067442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad71561-ce0d-4ffe-bf41-8e500e38602b admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f9c2b2829047739a963edf1588dfa4, user_id=8a76a680ce464f68bb772d28887163c6, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.067737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb0f4d-e381-4db1-971f-3a93ef298700 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.068022 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb0f4d-e381-4db1-971f-3a93ef298700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.068297 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb0f4d-e381-4db1-971f-3a93ef298700 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.068999 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb0f4d-e381-4db1-971f-3a93ef298700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.070158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad71561-ce0d-4ffe-bf41-8e500e38602b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.071046 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb0f4d-e381-4db1-971f-3a93ef298700 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.081408 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1281/2581] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:33 2022] PUT /identity/v3/projects/40f9c2b2829047739a963edf1588dfa4/users/8a76a680ce464f68bb772d28887163c6/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:34.082007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad71561-ce0d-4ffe-bf41-8e500e38602b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.092161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1301/2582] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:33 2022] POST /identity/v3/users => generated 279 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:34.093594 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd416c-53f3-40bd-9590-e9063235ccad None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.093887 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd416c-53f3-40bd-9590-e9063235ccad None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.094164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd416c-53f3-40bd-9590-e9063235ccad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.122604 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-3abd416c-53f3-40bd-9590-e9063235ccad None None] MFA Rules not processed for user `8a76a680ce464f68bb772d28887163c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:34.122604 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3abd416c-53f3-40bd-9590-e9063235ccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:34.157328 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:34.161578 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad71561-ce0d-4ffe-bf41-8e500e38602b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.167782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e2d1c-c4df-4272-8659-17bd85eded1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.168717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e2d1c-c4df-4272-8659-17bd85eded1e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.169207 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e2d1c-c4df-4272-8659-17bd85eded1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.169719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e2d1c-c4df-4272-8659-17bd85eded1e admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.170353 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e2d1c-c4df-4272-8659-17bd85eded1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.172423 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e2d1c-c4df-4272-8659-17bd85eded1e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.200269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1282/2583] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:34 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:34.200269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e2d1c-c4df-4272-8659-17bd85eded1e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.210029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1302/2584] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:34.213801 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e2d1c-c4df-4272-8659-17bd85eded1e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.214934 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd416c-53f3-40bd-9590-e9063235ccad None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.217305 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b6321-acf0-47ae-9811-6b74805169d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.218024 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b6321-acf0-47ae-9811-6b74805169d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.218310 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b6321-acf0-47ae-9811-6b74805169d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.218616 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b6321-acf0-47ae-9811-6b74805169d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.219399 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b6321-acf0-47ae-9811-6b74805169d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.221517 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b6321-acf0-47ae-9811-6b74805169d4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.228354 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd416c-53f3-40bd-9590-e9063235ccad None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.233331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e97fda-9471-48f2-961e-6ae9622a4695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.234049 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e97fda-9471-48f2-961e-6ae9622a4695 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.234507 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e97fda-9471-48f2-961e-6ae9622a4695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.234790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e97fda-9471-48f2-961e-6ae9622a4695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.235532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e97fda-9471-48f2-961e-6ae9622a4695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.237489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e97fda-9471-48f2-961e-6ae9622a4695 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.237631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1283/2585] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:34.238469 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b6321-acf0-47ae-9811-6b74805169d4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.240265 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8d1b6321-acf0-47ae-9811-6b74805169d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:34.251810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1303/2586] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:34.252711 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e97fda-9471-48f2-961e-6ae9622a4695 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.263271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e97fda-9471-48f2-961e-6ae9622a4695 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.268728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7d1fe-c9e0-45bd-a788-f9fafc32da24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.269412 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7d1fe-c9e0-45bd-a788-f9fafc32da24 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.269694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7d1fe-c9e0-45bd-a788-f9fafc32da24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.269971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7d1fe-c9e0-45bd-a788-f9fafc32da24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.270757 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7d1fe-c9e0-45bd-a788-f9fafc32da24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.272366 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7d1fe-c9e0-45bd-a788-f9fafc32da24 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.283406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1304/2587] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:34.284225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7d1fe-c9e0-45bd-a788-f9fafc32da24 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.294739 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7d1fe-c9e0-45bd-a788-f9fafc32da24 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.299743 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31867788-cfe0-44e1-af3d-1f8b96c9c6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.300492 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31867788-cfe0-44e1-af3d-1f8b96c9c6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.300849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31867788-cfe0-44e1-af3d-1f8b96c9c6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.301204 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31867788-cfe0-44e1-af3d-1f8b96c9c6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.302010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31867788-cfe0-44e1-af3d-1f8b96c9c6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.303753 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31867788-cfe0-44e1-af3d-1f8b96c9c6d6 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.311947 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b6321-acf0-47ae-9811-6b74805169d4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.315437 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1305/2588] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:34.316230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc3ebc-5b90-4556-9b03-f89d41dae196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.316366 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31867788-cfe0-44e1-af3d-1f8b96c9c6d6 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.317179 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3ebc-5b90-4556-9b03-f89d41dae196 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.317554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3ebc-5b90-4556-9b03-f89d41dae196 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.317921 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc3ebc-5b90-4556-9b03-f89d41dae196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.327033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31867788-cfe0-44e1-af3d-1f8b96c9c6d6 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.329190 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc3ebc-5b90-4556-9b03-f89d41dae196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.330780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc3ebc-5b90-4556-9b03-f89d41dae196 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.333096 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167dbda-dd69-4d6f-9ffa-1d664e3a61c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.333955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167dbda-dd69-4d6f-9ffa-1d664e3a61c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.334241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167dbda-dd69-4d6f-9ffa-1d664e3a61c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.334556 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167dbda-dd69-4d6f-9ffa-1d664e3a61c8 admin admin] PATH_INFO: `/v3/projects/e4c20f47fe174856a2134e0ef0764a60/users/b1463e14b2584b5aa622ec44fa81f586/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.342978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1284/2589] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:34.344211 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc3ebc-5b90-4556-9b03-f89d41dae196 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.355709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc3ebc-5b90-4556-9b03-f89d41dae196 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.361458 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af561f1-faa3-4db6-ac37-1cd456ea2f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.362623 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167dbda-dd69-4d6f-9ffa-1d664e3a61c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c20f47fe174856a2134e0ef0764a60, user_id=b1463e14b2584b5aa622ec44fa81f586, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.362842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af561f1-faa3-4db6-ac37-1cd456ea2f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.363345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af561f1-faa3-4db6-ac37-1cd456ea2f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.363770 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af561f1-faa3-4db6-ac37-1cd456ea2f98 admin admin] PATH_INFO: `/v3/projects/00d2f62ed33c4ce0b4cd12dcbbdff170/users/c2c9f957a7654eb8b1a9ce0605b36b4c/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.365323 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167dbda-dd69-4d6f-9ffa-1d664e3a61c8 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.381619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1306/2590] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:34 2022] PUT /identity/v3/projects/e4c20f47fe174856a2134e0ef0764a60/users/b1463e14b2584b5aa622ec44fa81f586/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:34.383893 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af561f1-faa3-4db6-ac37-1cd456ea2f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d2f62ed33c4ce0b4cd12dcbbdff170, user_id=c2c9f957a7654eb8b1a9ce0605b36b4c, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.386774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af561f1-faa3-4db6-ac37-1cd456ea2f98 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.392637 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e72852-dfff-406a-9a99-109f599ab0d5 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.392967 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e72852-dfff-406a-9a99-109f599ab0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.393250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e72852-dfff-406a-9a99-109f599ab0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.407589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1285/2591] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:34 2022] PUT /identity/v3/projects/00d2f62ed33c4ce0b4cd12dcbbdff170/users/c2c9f957a7654eb8b1a9ce0605b36b4c/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:34.417914 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba31b4-805c-4e69-8027-960a9bcd4ca4 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.418220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba31b4-805c-4e69-8027-960a9bcd4ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.418512 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba31b4-805c-4e69-8027-960a9bcd4ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.427939 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-a9e72852-dfff-406a-9a99-109f599ab0d5 None None] MFA Rules not processed for user `b1463e14b2584b5aa622ec44fa81f586`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:34.429563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a9e72852-dfff-406a-9a99-109f599ab0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:34.477761 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d6ba31b4-805c-4e69-8027-960a9bcd4ca4 None None] MFA Rules not processed for user `c2c9f957a7654eb8b1a9ce0605b36b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:34.479495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d6ba31b4-805c-4e69-8027-960a9bcd4ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:34.482061 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:34.506720 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1307/2592] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:34 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:34.511059 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e72852-dfff-406a-9a99-109f599ab0d5 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.574809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1286/2593] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:34.579266 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba31b4-805c-4e69-8027-960a9bcd4ca4 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.597927 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e72852-dfff-406a-9a99-109f599ab0d5 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.604001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa89d7c-d1fc-4259-830d-dc9ec0244257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.605072 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa89d7c-d1fc-4259-830d-dc9ec0244257 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.605360 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa89d7c-d1fc-4259-830d-dc9ec0244257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.605639 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa89d7c-d1fc-4259-830d-dc9ec0244257 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.606344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa89d7c-d1fc-4259-830d-dc9ec0244257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.608413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa89d7c-d1fc-4259-830d-dc9ec0244257 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.630192 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:34.643070 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1308/2594] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:34 2022] POST /identity/v3/projects => generated 357 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:34.651409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa89d7c-d1fc-4259-830d-dc9ec0244257 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.655213 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba31b4-805c-4e69-8027-960a9bcd4ca4 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.720527 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3c6d6-3c0a-448a-b524-cd0fadf9e127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.721142 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3c6d6-3c0a-448a-b524-cd0fadf9e127 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.721438 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3c6d6-3c0a-448a-b524-cd0fadf9e127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.721718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3c6d6-3c0a-448a-b524-cd0fadf9e127 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.722465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3c6d6-3c0a-448a-b524-cd0fadf9e127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.724390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa89d7c-d1fc-4259-830d-dc9ec0244257 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.724953 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3c6d6-3c0a-448a-b524-cd0fadf9e127 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.729524 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee40669-3862-4f60-8576-5f1ac330fc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.730254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee40669-3862-4f60-8576-5f1ac330fc43 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.730574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee40669-3862-4f60-8576-5f1ac330fc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.730855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee40669-3862-4f60-8576-5f1ac330fc43 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.731683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee40669-3862-4f60-8576-5f1ac330fc43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.734111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee40669-3862-4f60-8576-5f1ac330fc43 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.760051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1287/2595] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:34 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:34.760981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1309/2596] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:34 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:34.761545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3c6d6-3c0a-448a-b524-cd0fadf9e127 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.761812 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee40669-3862-4f60-8576-5f1ac330fc43 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.772138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee40669-3862-4f60-8576-5f1ac330fc43 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.835709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823d0be-aea2-48d3-8676-05efe19ead12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.836471 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823d0be-aea2-48d3-8676-05efe19ead12 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.836975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823d0be-aea2-48d3-8676-05efe19ead12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.837328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823d0be-aea2-48d3-8676-05efe19ead12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.838134 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823d0be-aea2-48d3-8676-05efe19ead12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.838507 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3c6d6-3c0a-448a-b524-cd0fadf9e127 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.839994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823d0be-aea2-48d3-8676-05efe19ead12 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.843996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63308c-0e2f-4409-8eb7-61a774b73b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.844684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63308c-0e2f-4409-8eb7-61a774b73b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.845043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63308c-0e2f-4409-8eb7-61a774b73b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.845323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63308c-0e2f-4409-8eb7-61a774b73b0a admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.846433 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63308c-0e2f-4409-8eb7-61a774b73b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.848555 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63308c-0e2f-4409-8eb7-61a774b73b0a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.854363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1310/2597] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:34.856180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823d0be-aea2-48d3-8676-05efe19ead12 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.862353 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:34.869784 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823d0be-aea2-48d3-8676-05efe19ead12 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.872352 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1288/2598] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:34 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:34.880940 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63308c-0e2f-4409-8eb7-61a774b73b0a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.882944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fb67c-1c84-4640-8be3-2676fd07f54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.884136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fb67c-1c84-4640-8be3-2676fd07f54d admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.884537 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fb67c-1c84-4640-8be3-2676fd07f54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.884922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fb67c-1c84-4640-8be3-2676fd07f54d admin admin] PATH_INFO: `/v3/projects/5bfd3f5b7241451bb2e468ec9d6b78a1/users/afffa55f090d45bdb1bbb0bf8044b616/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.889590 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63308c-0e2f-4409-8eb7-61a774b73b0a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.895841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec3fda-38f0-40c4-b42a-de5e8ebe67b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.895841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec3fda-38f0-40c4-b42a-de5e8ebe67b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.895841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec3fda-38f0-40c4-b42a-de5e8ebe67b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.896230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec3fda-38f0-40c4-b42a-de5e8ebe67b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:34.897056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec3fda-38f0-40c4-b42a-de5e8ebe67b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.898884 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec3fda-38f0-40c4-b42a-de5e8ebe67b4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.902784 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fb67c-1c84-4640-8be3-2676fd07f54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfd3f5b7241451bb2e468ec9d6b78a1, user_id=afffa55f090d45bdb1bbb0bf8044b616, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:34.905715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fb67c-1c84-4640-8be3-2676fd07f54d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:34.911006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1289/2599] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:27:34.914153 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec3fda-38f0-40c4-b42a-de5e8ebe67b4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.924949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec3fda-38f0-40c4-b42a-de5e8ebe67b4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:34.926836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1311/2600] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:34 2022] PUT /identity/v3/projects/5bfd3f5b7241451bb2e468ec9d6b78a1/users/afffa55f090d45bdb1bbb0bf8044b616/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:34.930812 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fb67c-1c84-4640-8be3-2676fd07f54d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:34.985211 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:34.997210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de2239-a05d-41b2-8bfb-56c6f6eb1f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:34.998109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de2239-a05d-41b2-8bfb-56c6f6eb1f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:34.998662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de2239-a05d-41b2-8bfb-56c6f6eb1f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:34.999415 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de2239-a05d-41b2-8bfb-56c6f6eb1f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.000247 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de2239-a05d-41b2-8bfb-56c6f6eb1f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:35.002153 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de2239-a05d-41b2-8bfb-56c6f6eb1f67 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:35.007179 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fb67c-1c84-4640-8be3-2676fd07f54d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:35.012049 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fc285-7e62-437b-973c-ef6541918492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:35.012746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc285-7e62-437b-973c-ef6541918492 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.013029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc285-7e62-437b-973c-ef6541918492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.013305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc285-7e62-437b-973c-ef6541918492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.013411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1290/2601] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:27:35.014210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fc285-7e62-437b-973c-ef6541918492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:35.014344 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de2239-a05d-41b2-8bfb-56c6f6eb1f67 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:35.015933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fc285-7e62-437b-973c-ef6541918492 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:35.026637 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1312/2602] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:35.027118 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de2239-a05d-41b2-8bfb-56c6f6eb1f67 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:35.027465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fc285-7e62-437b-973c-ef6541918492 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:35.034029 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77644b17-3b68-4e3b-82ff-8f5c2eefba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:35.035071 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77644b17-3b68-4e3b-82ff-8f5c2eefba88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.035362 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77644b17-3b68-4e3b-82ff-8f5c2eefba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.035642 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77644b17-3b68-4e3b-82ff-8f5c2eefba88 admin admin] PATH_INFO: `/v3/users/25b33e634bac4bb8bdd3a5bf5b6e1d53` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.036908 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77644b17-3b68-4e3b-82ff-8f5c2eefba88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b33e634bac4bb8bdd3a5bf5b6e1d53)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:35.037320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fc285-7e62-437b-973c-ef6541918492 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:35.038977 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77644b17-3b68-4e3b-82ff-8f5c2eefba88 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:35.042288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97dc96-01b5-47d3-a430-820fcd19c65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:35.043226 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97dc96-01b5-47d3-a430-820fcd19c65c admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.043511 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97dc96-01b5-47d3-a430-820fcd19c65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.043790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97dc96-01b5-47d3-a430-820fcd19c65c admin admin] PATH_INFO: `/v3/projects/6dc04f1d1745448491aefee50b7f4a43/users/a43d2cd80172415794d3e0b298b14604/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.060295 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97dc96-01b5-47d3-a430-820fcd19c65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc04f1d1745448491aefee50b7f4a43, user_id=a43d2cd80172415794d3e0b298b14604, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:35.063309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97dc96-01b5-47d3-a430-820fcd19c65c admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:35.077754 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1313/2603] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:35 2022] PUT /identity/v3/projects/6dc04f1d1745448491aefee50b7f4a43/users/a43d2cd80172415794d3e0b298b14604/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:35.078661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97dc96-01b5-47d3-a430-820fcd19c65c admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:35.101204 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-77644b17-3b68-4e3b-82ff-8f5c2eefba88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b33e634bac4bb8bdd3a5bf5b6e1d53'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:35.110160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-77644b17-3b68-4e3b-82ff-8f5c2eefba88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b33e634bac4bb8bdd3a5bf5b6e1d53'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:35.111014 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-77644b17-3b68-4e3b-82ff-8f5c2eefba88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b33e634bac4bb8bdd3a5bf5b6e1d53'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:35.128149 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-77644b17-3b68-4e3b-82ff-8f5c2eefba88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b33e634bac4bb8bdd3a5bf5b6e1d53'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:35.135742 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-77644b17-3b68-4e3b-82ff-8f5c2eefba88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b33e634bac4bb8bdd3a5bf5b6e1d53'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:35.148141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1291/2604] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:35 2022] DELETE /identity/v3/users/25b33e634bac4bb8bdd3a5bf5b6e1d53 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:35.148141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91715508-4457-4638-8a7c-ae56c387c31a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.148141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91715508-4457-4638-8a7c-ae56c387c31a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.148141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91715508-4457-4638-8a7c-ae56c387c31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.161091 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97dc96-01b5-47d3-a430-820fcd19c65c admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:35.175348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-91715508-4457-4638-8a7c-ae56c387c31a None None] MFA Rules not processed for user `a43d2cd80172415794d3e0b298b14604`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:35.176629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-91715508-4457-4638-8a7c-ae56c387c31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:35.214005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:35.222267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048da3ab-f3a6-4a2c-bf12-590628e6cfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:35.223336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048da3ab-f3a6-4a2c-bf12-590628e6cfa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.223695 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048da3ab-f3a6-4a2c-bf12-590628e6cfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.224032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048da3ab-f3a6-4a2c-bf12-590628e6cfa8 admin admin] PATH_INFO: `/v3/projects/5bfd3f5b7241451bb2e468ec9d6b78a1/users/afffa55f090d45bdb1bbb0bf8044b616/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.226619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048da3ab-f3a6-4a2c-bf12-590628e6cfa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfd3f5b7241451bb2e468ec9d6b78a1, user_id=afffa55f090d45bdb1bbb0bf8044b616, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:35.229253 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048da3ab-f3a6-4a2c-bf12-590628e6cfa8 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:35.240534 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1314/2605] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:35 2022] PUT /identity/v3/projects/5bfd3f5b7241451bb2e468ec9d6b78a1/users/afffa55f090d45bdb1bbb0bf8044b616/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:35.252196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4c8ff-ea0b-43ab-ba1e-73cc66716538 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.252196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4c8ff-ea0b-43ab-ba1e-73cc66716538 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.252196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4c8ff-ea0b-43ab-ba1e-73cc66716538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.252462 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1292/2606] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:35.253760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9f8d3-6e83-4e8f-af1e-11754580dd47 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.253760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9f8d3-6e83-4e8f-af1e-11754580dd47 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.254090 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9f8d3-6e83-4e8f-af1e-11754580dd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.271571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-6dc4c8ff-ea0b-43ab-ba1e-73cc66716538 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:35.272873 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6dc4c8ff-ea0b-43ab-ba1e-73cc66716538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:35.283350 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-56c9f8d3-6e83-4e8f-af1e-11754580dd47 None None] MFA Rules not processed for user `afffa55f090d45bdb1bbb0bf8044b616`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:35.284642 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-56c9f8d3-6e83-4e8f-af1e-11754580dd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:35.334380 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:35.337376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1315/2607] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:35.338244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4c8ff-ea0b-43ab-ba1e-73cc66716538 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:35.339621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6dc4c8ff-ea0b-43ab-ba1e-73cc66716538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:35.352093 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4c8ff-ea0b-43ab-ba1e-73cc66716538 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:35.357196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a73e8-e5ee-4ea9-a432-c69d2b667941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:35.357859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a73e8-e5ee-4ea9-a432-c69d2b667941 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.358177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a73e8-e5ee-4ea9-a432-c69d2b667941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.358494 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a73e8-e5ee-4ea9-a432-c69d2b667941 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.359191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a73e8-e5ee-4ea9-a432-c69d2b667941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:35.361129 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a73e8-e5ee-4ea9-a432-c69d2b667941 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:35.370054 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1293/2608] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:35 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:35.375337 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9f8d3-6e83-4e8f-af1e-11754580dd47 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:35.376920 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-56c9f8d3-6e83-4e8f-af1e-11754580dd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:35.391265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1316/2609] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:35 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:35.392079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a73e8-e5ee-4ea9-a432-c69d2b667941 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:35.393687 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-7f3a73e8-e5ee-4ea9-a432-c69d2b667941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:35.441809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9f8d3-6e83-4e8f-af1e-11754580dd47 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:35.451421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a73e8-e5ee-4ea9-a432-c69d2b667941 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:35.455247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414abd7-5ae7-4a92-be9b-0ea1ceafe483 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:35.455979 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414abd7-5ae7-4a92-be9b-0ea1ceafe483 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.456244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414abd7-5ae7-4a92-be9b-0ea1ceafe483 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.456524 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414abd7-5ae7-4a92-be9b-0ea1ceafe483 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.490493 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37b479-4008-4efc-ae2d-9955acd9a414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:35.491275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37b479-4008-4efc-ae2d-9955acd9a414 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.491584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37b479-4008-4efc-ae2d-9955acd9a414 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.491857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37b479-4008-4efc-ae2d-9955acd9a414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.516867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414abd7-5ae7-4a92-be9b-0ea1ceafe483 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:35.518304 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414abd7-5ae7-4a92-be9b-0ea1ceafe483 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:35.528182 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1317/2610] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:35 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:35.529037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414abd7-5ae7-4a92-be9b-0ea1ceafe483 service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:35.550257 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:35.555587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37b479-4008-4efc-ae2d-9955acd9a414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:35.557326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37b479-4008-4efc-ae2d-9955acd9a414 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:35.582669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1294/2611] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:35.609461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37b479-4008-4efc-ae2d-9955acd9a414 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:35.609704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414abd7-5ae7-4a92-be9b-0ea1ceafe483 service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:35.614901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c3035-9cb3-4351-8e3f-5e342be26f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:35.615829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c3035-9cb3-4351-8e3f-5e342be26f5f admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.616105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c3035-9cb3-4351-8e3f-5e342be26f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.616842 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c3035-9cb3-4351-8e3f-5e342be26f5f admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.617529 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c3035-9cb3-4351-8e3f-5e342be26f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:35.619985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c3035-9cb3-4351-8e3f-5e342be26f5f admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:35.620646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37b479-4008-4efc-ae2d-9955acd9a414 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:35.624652 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea735455-5e1e-4db3-ad9f-ef36e9354d4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:35.625501 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea735455-5e1e-4db3-ad9f-ef36e9354d4b service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.625785 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea735455-5e1e-4db3-ad9f-ef36e9354d4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.626056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea735455-5e1e-4db3-ad9f-ef36e9354d4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.628088 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ea735455-5e1e-4db3-ad9f-ef36e9354d4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:35.647352 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1318/2612] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:35 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:35.651642 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c3035-9cb3-4351-8e3f-5e342be26f5f admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:35.663608 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c3035-9cb3-4351-8e3f-5e342be26f5f admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:35.669511 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40e6ad-5662-4c3f-aaa8-456bba98d9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:35.670857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40e6ad-5662-4c3f-aaa8-456bba98d9ae admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.671293 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40e6ad-5662-4c3f-aaa8-456bba98d9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.671807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40e6ad-5662-4c3f-aaa8-456bba98d9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.673144 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40e6ad-5662-4c3f-aaa8-456bba98d9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:35.674953 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40e6ad-5662-4c3f-aaa8-456bba98d9ae admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:35.684973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:35.689581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1319/2613] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:35.690756 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40e6ad-5662-4c3f-aaa8-456bba98d9ae admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:35.702557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40e6ad-5662-4c3f-aaa8-456bba98d9ae admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:35.705773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea735455-5e1e-4db3-ad9f-ef36e9354d4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:35.707602 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea735455-5e1e-4db3-ad9f-ef36e9354d4b service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:35.707878 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ada5d2-695e-4e65-95ce-01ac1ba97cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:35.708891 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ada5d2-695e-4e65-95ce-01ac1ba97cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.709181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ada5d2-695e-4e65-95ce-01ac1ba97cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.709463 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ada5d2-695e-4e65-95ce-01ac1ba97cbd admin admin] PATH_INFO: `/v3/projects/c76882a7dff644f7891ce7aba7b9e3b2/users/7956e1f9842c4ccfbb4cf3eb32709b9d/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.718063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1295/2614] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:35 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:27:35.727252 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ada5d2-695e-4e65-95ce-01ac1ba97cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76882a7dff644f7891ce7aba7b9e3b2, user_id=7956e1f9842c4ccfbb4cf3eb32709b9d, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:35.731854 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ada5d2-695e-4e65-95ce-01ac1ba97cbd admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:35.751452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1320/2615] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:35 2022] PUT /identity/v3/projects/c76882a7dff644f7891ce7aba7b9e3b2/users/7956e1f9842c4ccfbb4cf3eb32709b9d/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:35.756540 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea735455-5e1e-4db3-ad9f-ef36e9354d4b service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:35.768158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea735455-5e1e-4db3-ad9f-ef36e9354d4b service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:35.838678 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08e2b4-87c6-471c-9e37-c8149d05f250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:35.839371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08e2b4-87c6-471c-9e37-c8149d05f250 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.839663 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08e2b4-87c6-471c-9e37-c8149d05f250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.839944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08e2b4-87c6-471c-9e37-c8149d05f250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.840745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08e2b4-87c6-471c-9e37-c8149d05f250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:35.842685 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08e2b4-87c6-471c-9e37-c8149d05f250 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:35.854916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1296/2616] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:27:35.859757 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ada5d2-695e-4e65-95ce-01ac1ba97cbd admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:35.874155 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ada5d2-695e-4e65-95ce-01ac1ba97cbd admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:35.881483 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27220e-dcdd-4c8c-899f-7b3c3f45b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:35.882680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27220e-dcdd-4c8c-899f-7b3c3f45b1c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.883068 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27220e-dcdd-4c8c-899f-7b3c3f45b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.883346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27220e-dcdd-4c8c-899f-7b3c3f45b1c9 admin admin] PATH_INFO: `/v3/projects/c76882a7dff644f7891ce7aba7b9e3b2/users/7956e1f9842c4ccfbb4cf3eb32709b9d/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.886220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27220e-dcdd-4c8c-899f-7b3c3f45b1c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76882a7dff644f7891ce7aba7b9e3b2, user_id=7956e1f9842c4ccfbb4cf3eb32709b9d, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:35.889958 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27220e-dcdd-4c8c-899f-7b3c3f45b1c9 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:35.902912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1321/2617] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:35 2022] PUT /identity/v3/projects/c76882a7dff644f7891ce7aba7b9e3b2/users/7956e1f9842c4ccfbb4cf3eb32709b9d/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:35.914159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb8968-c3cc-4c78-895f-422f36724505 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:35.914488 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb8968-c3cc-4c78-895f-422f36724505 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:35.914774 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb8968-c3cc-4c78-895f-422f36724505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:35.918916 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27220e-dcdd-4c8c-899f-7b3c3f45b1c9 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:35.921044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6e27220e-dcdd-4c8c-899f-7b3c3f45b1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:35.945951 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-84bb8968-c3cc-4c78-895f-422f36724505 None None] MFA Rules not processed for user `7956e1f9842c4ccfbb4cf3eb32709b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:35.947174 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-84bb8968-c3cc-4c78-895f-422f36724505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:36.003320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27220e-dcdd-4c8c-899f-7b3c3f45b1c9 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:36.009593 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df91e45-2c74-4715-89ae-1cde2bb253a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:36.010495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df91e45-2c74-4715-89ae-1cde2bb253a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:36.010754 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df91e45-2c74-4715-89ae-1cde2bb253a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:36.011038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df91e45-2c74-4715-89ae-1cde2bb253a5 admin admin] PATH_INFO: `/v3/projects/8549b45f15d24934a9037dc285dbf74d` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:36.012263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df91e45-2c74-4715-89ae-1cde2bb253a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8549b45f15d24934a9037dc285dbf74d)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:36.014172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df91e45-2c74-4715-89ae-1cde2bb253a5 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:36.021449 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1297/2618] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:36.032520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb8968-c3cc-4c78-895f-422f36724505 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:36.062671 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-4df91e45-2c74-4715-89ae-1cde2bb253a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8549b45f15d24934a9037dc285dbf74d', 'request_id': 'req-4df91e45-2c74-4715-89ae-1cde2bb253a5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:36.068599 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-4df91e45-2c74-4715-89ae-1cde2bb253a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8549b45f15d24934a9037dc285dbf74d', 'request_id': 'req-4df91e45-2c74-4715-89ae-1cde2bb253a5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:36.076127 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-4df91e45-2c74-4715-89ae-1cde2bb253a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8549b45f15d24934a9037dc285dbf74d', 'request_id': 'req-4df91e45-2c74-4715-89ae-1cde2bb253a5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:36.077900 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:36.091578 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb8968-c3cc-4c78-895f-422f36724505 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:36.093699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-4df91e45-2c74-4715-89ae-1cde2bb253a5 admin admin] The token cache is being invalidate because project 8549b45f15d24934a9037dc285dbf74d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:36.094225 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-4df91e45-2c74-4715-89ae-1cde2bb253a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:36.095366 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-4df91e45-2c74-4715-89ae-1cde2bb253a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:36.098484 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1322/2619] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:35 2022] DELETE /identity/v3/projects/8549b45f15d24934a9037dc285dbf74d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:36.102628 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df91e45-2c74-4715-89ae-1cde2bb253a5 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:36.104061 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-4df91e45-2c74-4715-89ae-1cde2bb253a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:36.109334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:36.145295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede82ce-8af6-4363-8ea1-e88a9350856a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:36.146077 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede82ce-8af6-4363-8ea1-e88a9350856a service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:36.146463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede82ce-8af6-4363-8ea1-e88a9350856a service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:36.146811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede82ce-8af6-4363-8ea1-e88a9350856a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:36.148795 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5ede82ce-8af6-4363-8ea1-e88a9350856a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:36.173703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df91e45-2c74-4715-89ae-1cde2bb253a5 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:36.179183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc79fc2-ebba-4953-8c0d-3ce630845037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:36.180063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc79fc2-ebba-4953-8c0d-3ce630845037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:36.180351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc79fc2-ebba-4953-8c0d-3ce630845037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:36.180623 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc79fc2-ebba-4953-8c0d-3ce630845037 admin admin] PATH_INFO: `/v3/users/8a76a680ce464f68bb772d28887163c6` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:36.181957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc79fc2-ebba-4953-8c0d-3ce630845037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a76a680ce464f68bb772d28887163c6)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:36.183946 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc79fc2-ebba-4953-8c0d-3ce630845037 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:36.214529 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede82ce-8af6-4363-8ea1-e88a9350856a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:36.216064 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede82ce-8af6-4363-8ea1-e88a9350856a service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:36.226264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1298/2620] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:27:36.233378 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-bdc79fc2-ebba-4953-8c0d-3ce630845037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a76a680ce464f68bb772d28887163c6'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:36.241992 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-bdc79fc2-ebba-4953-8c0d-3ce630845037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a76a680ce464f68bb772d28887163c6'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:36.243086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-bdc79fc2-ebba-4953-8c0d-3ce630845037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a76a680ce464f68bb772d28887163c6'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:36.257392 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-bdc79fc2-ebba-4953-8c0d-3ce630845037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a76a680ce464f68bb772d28887163c6'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:36.265173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-bdc79fc2-ebba-4953-8c0d-3ce630845037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a76a680ce464f68bb772d28887163c6'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:36.271427 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1323/2621] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:36 2022] DELETE /identity/v3/users/8a76a680ce464f68bb772d28887163c6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:27:36.569056 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede82ce-8af6-4363-8ea1-e88a9350856a service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:36.588228 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede82ce-8af6-4363-8ea1-e88a9350856a service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:36.662213 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f770d-7c3d-46e8-a554-940eb014e1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:36.663155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f770d-7c3d-46e8-a554-940eb014e1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:36.663533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f770d-7c3d-46e8-a554-940eb014e1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:36.663810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f770d-7c3d-46e8-a554-940eb014e1ba admin admin] PATH_INFO: `/v3/projects/40f9c2b2829047739a963edf1588dfa4` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:36.665049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f770d-7c3d-46e8-a554-940eb014e1ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=40f9c2b2829047739a963edf1588dfa4)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:36.667098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f770d-7c3d-46e8-a554-940eb014e1ba admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:36.726342 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b17f770d-7c3d-46e8-a554-940eb014e1ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f9c2b2829047739a963edf1588dfa4', 'request_id': 'req-b17f770d-7c3d-46e8-a554-940eb014e1ba'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:36.732496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b17f770d-7c3d-46e8-a554-940eb014e1ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f9c2b2829047739a963edf1588dfa4', 'request_id': 'req-b17f770d-7c3d-46e8-a554-940eb014e1ba'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:36.739151 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b17f770d-7c3d-46e8-a554-940eb014e1ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f9c2b2829047739a963edf1588dfa4', 'request_id': 'req-b17f770d-7c3d-46e8-a554-940eb014e1ba'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:36.749467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:36.754270 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b17f770d-7c3d-46e8-a554-940eb014e1ba admin admin] The token cache is being invalidate because project 40f9c2b2829047739a963edf1588dfa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:36.754797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b17f770d-7c3d-46e8-a554-940eb014e1ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:36.755896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b17f770d-7c3d-46e8-a554-940eb014e1ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:36.758551 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1299/2622] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:36 2022] DELETE /identity/v3/projects/40f9c2b2829047739a963edf1588dfa4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:36.763286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba99d04-a23c-4535-8317-fc0cc4bf6efe None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:36.763761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba99d04-a23c-4535-8317-fc0cc4bf6efe None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:36.763761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba99d04-a23c-4535-8317-fc0cc4bf6efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:36.781788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-fba99d04-a23c-4535-8317-fc0cc4bf6efe None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:36.783038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-fba99d04-a23c-4535-8317-fc0cc4bf6efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:36.790083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f770d-7c3d-46e8-a554-940eb014e1ba admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:36.791550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b17f770d-7c3d-46e8-a554-940eb014e1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:36.842995 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1324/2623] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:36.849155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f770d-7c3d-46e8-a554-940eb014e1ba admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:36.850858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71278143-714f-400f-9f2c-b5e511dc493c None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:36.851127 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71278143-714f-400f-9f2c-b5e511dc493c None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:36.851403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71278143-714f-400f-9f2c-b5e511dc493c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:36.853074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925ea9c-c1f7-483d-8bd8-8f7fd5bcfe1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:36.853725 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925ea9c-c1f7-483d-8bd8-8f7fd5bcfe1f service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:36.854017 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925ea9c-c1f7-483d-8bd8-8f7fd5bcfe1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:36.854292 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925ea9c-c1f7-483d-8bd8-8f7fd5bcfe1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:36.856126 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c925ea9c-c1f7-483d-8bd8-8f7fd5bcfe1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:36.869467 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-71278143-714f-400f-9f2c-b5e511dc493c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:36.870683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-71278143-714f-400f-9f2c-b5e511dc493c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:36.878970 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1325/2624] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:36.883176 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71278143-714f-400f-9f2c-b5e511dc493c None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:36.888462 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:36.892653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71278143-714f-400f-9f2c-b5e511dc493c None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:36.899546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120b4da-3c68-49a8-8ee4-e672aac346be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:36.902528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120b4da-3c68-49a8-8ee4-e672aac346be admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:36.902883 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120b4da-3c68-49a8-8ee4-e672aac346be admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:36.903326 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120b4da-3c68-49a8-8ee4-e672aac346be admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:36.904341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120b4da-3c68-49a8-8ee4-e672aac346be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:27:36.904663 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120b4da-3c68-49a8-8ee4-e672aac346be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:36.906271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120b4da-3c68-49a8-8ee4-e672aac346be admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:36.918669 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1326/2625] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:27:36.921978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925ea9c-c1f7-483d-8bd8-8f7fd5bcfe1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:36.922700 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120b4da-3c68-49a8-8ee4-e672aac346be admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:36.923519 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925ea9c-c1f7-483d-8bd8-8f7fd5bcfe1f service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:36.932656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120b4da-3c68-49a8-8ee4-e672aac346be admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:36.933557 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1300/2626] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:27:36.939617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86038739-533e-422d-8c25-d3fea5cdcb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:36.939617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86038739-533e-422d-8c25-d3fea5cdcb23 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:36.939617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86038739-533e-422d-8c25-d3fea5cdcb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:36.939617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86038739-533e-422d-8c25-d3fea5cdcb23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:36.940009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86038739-533e-422d-8c25-d3fea5cdcb23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:36.941672 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86038739-533e-422d-8c25-d3fea5cdcb23 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:36.974146 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1327/2627] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:36 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:36.975355 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925ea9c-c1f7-483d-8bd8-8f7fd5bcfe1f service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:36.986880 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925ea9c-c1f7-483d-8bd8-8f7fd5bcfe1f service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:37.066559 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba545569-0bdd-4a10-bee0-7173867bd743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:37.067244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba545569-0bdd-4a10-bee0-7173867bd743 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:37.067526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba545569-0bdd-4a10-bee0-7173867bd743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:37.067797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba545569-0bdd-4a10-bee0-7173867bd743 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:37.068491 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba545569-0bdd-4a10-bee0-7173867bd743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:37.070737 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba545569-0bdd-4a10-bee0-7173867bd743 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:37.095854 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1301/2628] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:36 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:37.101784 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86038739-533e-422d-8c25-d3fea5cdcb23 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:37.112614 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86038739-533e-422d-8c25-d3fea5cdcb23 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:37.118174 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade79fe-1184-45f3-84f4-7803579d98d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:37.119805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade79fe-1184-45f3-84f4-7803579d98d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:37.120237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade79fe-1184-45f3-84f4-7803579d98d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:37.120575 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade79fe-1184-45f3-84f4-7803579d98d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:37.121408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade79fe-1184-45f3-84f4-7803579d98d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:37.123256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade79fe-1184-45f3-84f4-7803579d98d6 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:37.135179 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1328/2629] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:37.139724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba545569-0bdd-4a10-bee0-7173867bd743 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:37.150668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba545569-0bdd-4a10-bee0-7173867bd743 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:37.155463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233cebe-61f5-4243-9663-cd9973be6c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:37.156138 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233cebe-61f5-4243-9663-cd9973be6c2c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:37.156419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233cebe-61f5-4243-9663-cd9973be6c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:37.156736 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233cebe-61f5-4243-9663-cd9973be6c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:37.157480 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233cebe-61f5-4243-9663-cd9973be6c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:37.159067 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c233cebe-61f5-4243-9663-cd9973be6c2c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:37.170237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1302/2630] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:37.174621 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade79fe-1184-45f3-84f4-7803579d98d6 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:37.185033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade79fe-1184-45f3-84f4-7803579d98d6 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:37.190964 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dbeb3-1597-47d3-b401-d2fcba1a132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:37.191928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dbeb3-1597-47d3-b401-d2fcba1a132f admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:37.192275 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dbeb3-1597-47d3-b401-d2fcba1a132f admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:37.192585 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26dbeb3-1597-47d3-b401-d2fcba1a132f admin admin] PATH_INFO: `/v3/projects/9b9b356bab0e45029125d7e8f36336bd/users/9290af62806841e09077750b4616fcc9/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:37.209303 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26dbeb3-1597-47d3-b401-d2fcba1a132f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9b356bab0e45029125d7e8f36336bd, user_id=9290af62806841e09077750b4616fcc9, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:37.212122 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26dbeb3-1597-47d3-b401-d2fcba1a132f admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:37.229838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1329/2631] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:37 2022] PUT /identity/v3/projects/9b9b356bab0e45029125d7e8f36336bd/users/9290af62806841e09077750b4616fcc9/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:27:37.241744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601d5bd-c07a-4e46-b875-f6a4e9b06cfa None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:37.241744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601d5bd-c07a-4e46-b875-f6a4e9b06cfa None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:37.241744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601d5bd-c07a-4e46-b875-f6a4e9b06cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:37.272124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d601d5bd-c07a-4e46-b875-f6a4e9b06cfa None None] MFA Rules not processed for user `9290af62806841e09077750b4616fcc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:37.273585 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d601d5bd-c07a-4e46-b875-f6a4e9b06cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:37.296832 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:37.345184 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1303/2632] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:37.349819 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dbeb3-1597-47d3-b401-d2fcba1a132f admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:37.414666 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26dbeb3-1597-47d3-b401-d2fcba1a132f admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:37.419676 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4430e1f-2305-4f7f-bbef-177c115dc1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:37.420357 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4430e1f-2305-4f7f-bbef-177c115dc1fa admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:37.420636 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4430e1f-2305-4f7f-bbef-177c115dc1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:37.420906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4430e1f-2305-4f7f-bbef-177c115dc1fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:37.421728 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4430e1f-2305-4f7f-bbef-177c115dc1fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:37.423672 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4430e1f-2305-4f7f-bbef-177c115dc1fa admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:37.450413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1330/2633] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:37 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:37.454544 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601d5bd-c07a-4e46-b875-f6a4e9b06cfa None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:37.465344 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601d5bd-c07a-4e46-b875-f6a4e9b06cfa None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:37.524497 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86216-94cd-42d8-a1ab-0c0c630ef745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:37.525090 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86216-94cd-42d8-a1ab-0c0c630ef745 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:37.525377 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86216-94cd-42d8-a1ab-0c0c630ef745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:37.525656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86216-94cd-42d8-a1ab-0c0c630ef745 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:37.526358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f86216-94cd-42d8-a1ab-0c0c630ef745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:37.528346 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f86216-94cd-42d8-a1ab-0c0c630ef745 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:37.549249 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1304/2634] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:37 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:37.553455 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4430e1f-2305-4f7f-bbef-177c115dc1fa admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:37.564458 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4430e1f-2305-4f7f-bbef-177c115dc1fa admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:37.569523 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8091975-f3ae-413f-ab2e-6c28bdda083d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:37.570175 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8091975-f3ae-413f-ab2e-6c28bdda083d admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:37.570495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8091975-f3ae-413f-ab2e-6c28bdda083d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:37.570877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8091975-f3ae-413f-ab2e-6c28bdda083d admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:37.571618 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8091975-f3ae-413f-ab2e-6c28bdda083d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:37.573200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8091975-f3ae-413f-ab2e-6c28bdda083d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:37.583973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1331/2635] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:37.588459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86216-94cd-42d8-a1ab-0c0c630ef745 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:37.598887 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86216-94cd-42d8-a1ab-0c0c630ef745 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:37.603872 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4d9e7-b248-4e7a-bbf7-abf36a1818f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:37.604738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d9e7-b248-4e7a-bbf7-abf36a1818f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:37.605035 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d9e7-b248-4e7a-bbf7-abf36a1818f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:37.605358 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d9e7-b248-4e7a-bbf7-abf36a1818f9 admin admin] PATH_INFO: `/v3/projects/1d3be4f2ab05493599d0954d6ec7a6d1/users/332a3b6328e940aeb8b3ce69fb551eeb/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:37.621807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4d9e7-b248-4e7a-bbf7-abf36a1818f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3be4f2ab05493599d0954d6ec7a6d1, user_id=332a3b6328e940aeb8b3ce69fb551eeb, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:37.624743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4d9e7-b248-4e7a-bbf7-abf36a1818f9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:37.639457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1305/2636] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:37 2022] PUT /identity/v3/projects/1d3be4f2ab05493599d0954d6ec7a6d1/users/332a3b6328e940aeb8b3ce69fb551eeb/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:37.643710 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8091975-f3ae-413f-ab2e-6c28bdda083d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:37.655053 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8091975-f3ae-413f-ab2e-6c28bdda083d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:37.717569 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e79860-87dd-40d3-a65c-8a1da1b47549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:37.718247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e79860-87dd-40d3-a65c-8a1da1b47549 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:37.718683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e79860-87dd-40d3-a65c-8a1da1b47549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:37.719024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e79860-87dd-40d3-a65c-8a1da1b47549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:37.720114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e79860-87dd-40d3-a65c-8a1da1b47549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:37.722788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e79860-87dd-40d3-a65c-8a1da1b47549 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:37.738371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1332/2637] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:37.743643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4d9e7-b248-4e7a-bbf7-abf36a1818f9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:37.754422 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4d9e7-b248-4e7a-bbf7-abf36a1818f9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:37.759677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57bb02-739c-4795-8945-b0d234e2574f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:37.760606 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57bb02-739c-4795-8945-b0d234e2574f admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:37.760887 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57bb02-739c-4795-8945-b0d234e2574f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:37.761163 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57bb02-739c-4795-8945-b0d234e2574f admin admin] PATH_INFO: `/v3/projects/1d3be4f2ab05493599d0954d6ec7a6d1/users/332a3b6328e940aeb8b3ce69fb551eeb/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:37.763434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57bb02-739c-4795-8945-b0d234e2574f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3be4f2ab05493599d0954d6ec7a6d1, user_id=332a3b6328e940aeb8b3ce69fb551eeb, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:37.766096 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57bb02-739c-4795-8945-b0d234e2574f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:37.778108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1306/2638] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:37 2022] PUT /identity/v3/projects/1d3be4f2ab05493599d0954d6ec7a6d1/users/332a3b6328e940aeb8b3ce69fb551eeb/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:37.788752 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd7fb6-3c03-4180-ac23-8329aa4f5148 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:37.789237 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd7fb6-3c03-4180-ac23-8329aa4f5148 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:37.789342 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd7fb6-3c03-4180-ac23-8329aa4f5148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:37.796952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:37.818805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-26bd7fb6-3c03-4180-ac23-8329aa4f5148 None None] MFA Rules not processed for user `332a3b6328e940aeb8b3ce69fb551eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:37.820038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-26bd7fb6-3c03-4180-ac23-8329aa4f5148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:37.891051 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1333/2639] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:37.903506 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57bb02-739c-4795-8945-b0d234e2574f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:37.961506 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57bb02-739c-4795-8945-b0d234e2574f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:37.965436 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb311c-bae5-4fe8-9427-d60c49884338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:37.966080 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb311c-bae5-4fe8-9427-d60c49884338 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:37.966367 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb311c-bae5-4fe8-9427-d60c49884338 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:37.966678 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb311c-bae5-4fe8-9427-d60c49884338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:37.996188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:38.025697 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb311c-bae5-4fe8-9427-d60c49884338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:38.027198 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb311c-bae5-4fe8-9427-d60c49884338 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:38.036349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1307/2640] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:41.236527 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd7fb6-3c03-4180-ac23-8329aa4f5148 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:41.247965 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd7fb6-3c03-4180-ac23-8329aa4f5148 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:41.251576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d278610-196a-44c0-b8c0-08d4fe2e8347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:41.252247 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d278610-196a-44c0-b8c0-08d4fe2e8347 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:41.252532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d278610-196a-44c0-b8c0-08d4fe2e8347 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:41.252810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d278610-196a-44c0-b8c0-08d4fe2e8347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:41.254623 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5d278610-196a-44c0-b8c0-08d4fe2e8347 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:41.316677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d278610-196a-44c0-b8c0-08d4fe2e8347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:41.318119 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d278610-196a-44c0-b8c0-08d4fe2e8347 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:41.327944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1334/2641] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:42.392454 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb311c-bae5-4fe8-9427-d60c49884338 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:42.402084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb311c-bae5-4fe8-9427-d60c49884338 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:42.407136 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a65982-cc86-4b78-b434-40f056c68eeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:42.408093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a65982-cc86-4b78-b434-40f056c68eeb service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:42.408373 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a65982-cc86-4b78-b434-40f056c68eeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:42.408647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a65982-cc86-4b78-b434-40f056c68eeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:42.420778 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a65982-cc86-4b78-b434-40f056c68eeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:42.422274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a65982-cc86-4b78-b434-40f056c68eeb service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:42.433999 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1308/2642] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:43.458597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d278610-196a-44c0-b8c0-08d4fe2e8347 service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:43.460813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5d278610-196a-44c0-b8c0-08d4fe2e8347 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:43.528817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d278610-196a-44c0-b8c0-08d4fe2e8347 service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:43.533714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac297e-fbe3-4257-8952-8ce57283d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:43.534603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac297e-fbe3-4257-8952-8ce57283d313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:43.534882 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac297e-fbe3-4257-8952-8ce57283d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:43.535157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac297e-fbe3-4257-8952-8ce57283d313 admin admin] PATH_INFO: `/v3/users/c2c9f957a7654eb8b1a9ce0605b36b4c` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:43.536390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac297e-fbe3-4257-8952-8ce57283d313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c9f957a7654eb8b1a9ce0605b36b4c)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:43.538525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac297e-fbe3-4257-8952-8ce57283d313 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:43.575268 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:43.589619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-a9ac297e-fbe3-4257-8952-8ce57283d313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c9f957a7654eb8b1a9ce0605b36b4c'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:43.597220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-a9ac297e-fbe3-4257-8952-8ce57283d313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c9f957a7654eb8b1a9ce0605b36b4c'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:43.597909 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-a9ac297e-fbe3-4257-8952-8ce57283d313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c9f957a7654eb8b1a9ce0605b36b4c'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:43.610661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-a9ac297e-fbe3-4257-8952-8ce57283d313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c9f957a7654eb8b1a9ce0605b36b4c'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:43.621888 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-a9ac297e-fbe3-4257-8952-8ce57283d313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c9f957a7654eb8b1a9ce0605b36b4c'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:43.628888 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1335/2643] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:43 2022] DELETE /identity/v3/users/c2c9f957a7654eb8b1a9ce0605b36b4c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:43.633709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f0b8a-664f-465a-ac87-0af656b7dad7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:43.634205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f0b8a-664f-465a-ac87-0af656b7dad7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:43.634205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f0b8a-664f-465a-ac87-0af656b7dad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:43.651729 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8a5f0b8a-664f-465a-ac87-0af656b7dad7 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:43.652935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8a5f0b8a-664f-465a-ac87-0af656b7dad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:43.718382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1309/2644] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:43.729024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac297e-fbe3-4257-8952-8ce57283d313 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:43.730524 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a9ac297e-fbe3-4257-8952-8ce57283d313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:43.800482 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac297e-fbe3-4257-8952-8ce57283d313 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:43.804834 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53334513-083f-4b0f-9699-514f6ed9c740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:43.805483 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53334513-083f-4b0f-9699-514f6ed9c740 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:43.805764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53334513-083f-4b0f-9699-514f6ed9c740 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:43.806037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53334513-083f-4b0f-9699-514f6ed9c740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:43.815829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53334513-083f-4b0f-9699-514f6ed9c740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:43.817250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53334513-083f-4b0f-9699-514f6ed9c740 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:43.827252 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1336/2645] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:27:44.145214 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f0b8a-664f-465a-ac87-0af656b7dad7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:44.146626 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8a5f0b8a-664f-465a-ac87-0af656b7dad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:44.167336 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f0b8a-664f-465a-ac87-0af656b7dad7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:44.172699 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a456c58-d953-44ab-bed1-434383195f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:44.173478 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a456c58-d953-44ab-bed1-434383195f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:44.173816 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a456c58-d953-44ab-bed1-434383195f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:44.173983 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a456c58-d953-44ab-bed1-434383195f76 admin admin] PATH_INFO: `/v3/projects/00d2f62ed33c4ce0b4cd12dcbbdff170` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:44.176123 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a456c58-d953-44ab-bed1-434383195f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d2f62ed33c4ce0b4cd12dcbbdff170)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:44.178197 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a456c58-d953-44ab-bed1-434383195f76 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:44.231903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0a456c58-d953-44ab-bed1-434383195f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d2f62ed33c4ce0b4cd12dcbbdff170', 'request_id': 'req-0a456c58-d953-44ab-bed1-434383195f76'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:44.237340 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0a456c58-d953-44ab-bed1-434383195f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d2f62ed33c4ce0b4cd12dcbbdff170', 'request_id': 'req-0a456c58-d953-44ab-bed1-434383195f76'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:44.246300 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0a456c58-d953-44ab-bed1-434383195f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d2f62ed33c4ce0b4cd12dcbbdff170', 'request_id': 'req-0a456c58-d953-44ab-bed1-434383195f76'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:44.267384 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0a456c58-d953-44ab-bed1-434383195f76 admin admin] The token cache is being invalidate because project 00d2f62ed33c4ce0b4cd12dcbbdff170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:44.267768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0a456c58-d953-44ab-bed1-434383195f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:44.268500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0a456c58-d953-44ab-bed1-434383195f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:44.270152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1310/2646] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:44 2022] DELETE /identity/v3/projects/00d2f62ed33c4ce0b4cd12dcbbdff170 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:44.275214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53334513-083f-4b0f-9699-514f6ed9c740 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:44.286682 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53334513-083f-4b0f-9699-514f6ed9c740 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:44.366434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbf879-1166-4089-ab1a-2dc2af5d273e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:44.366434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbf879-1166-4089-ab1a-2dc2af5d273e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:44.366434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbf879-1166-4089-ab1a-2dc2af5d273e admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:44.366434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbf879-1166-4089-ab1a-2dc2af5d273e admin admin] PATH_INFO: `/v3/users/a43d2cd80172415794d3e0b298b14604` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:44.367038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbf879-1166-4089-ab1a-2dc2af5d273e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43d2cd80172415794d3e0b298b14604)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:44.367038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbf879-1166-4089-ab1a-2dc2af5d273e admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:44.411732 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-b1dbf879-1166-4089-ab1a-2dc2af5d273e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43d2cd80172415794d3e0b298b14604'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:44.415654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:44.420205 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-b1dbf879-1166-4089-ab1a-2dc2af5d273e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43d2cd80172415794d3e0b298b14604'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:44.421021 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-b1dbf879-1166-4089-ab1a-2dc2af5d273e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43d2cd80172415794d3e0b298b14604'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:44.437574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-b1dbf879-1166-4089-ab1a-2dc2af5d273e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43d2cd80172415794d3e0b298b14604'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:44.444634 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-b1dbf879-1166-4089-ab1a-2dc2af5d273e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43d2cd80172415794d3e0b298b14604'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:44.450730 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1337/2647] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:44 2022] DELETE /identity/v3/users/a43d2cd80172415794d3e0b298b14604 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:27:44.734216 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a456c58-d953-44ab-bed1-434383195f76 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:44.735622 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0a456c58-d953-44ab-bed1-434383195f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:44.749006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a456c58-d953-44ab-bed1-434383195f76 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:44.788086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:44.808150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dabf3e-2417-4229-a45a-4bcf09233a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:44.809029 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dabf3e-2417-4229-a45a-4bcf09233a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:44.809313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dabf3e-2417-4229-a45a-4bcf09233a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:44.809588 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dabf3e-2417-4229-a45a-4bcf09233a14 admin admin] PATH_INFO: `/v3/projects/6dc04f1d1745448491aefee50b7f4a43` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:44.810845 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dabf3e-2417-4229-a45a-4bcf09233a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc04f1d1745448491aefee50b7f4a43)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:44.813282 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dabf3e-2417-4229-a45a-4bcf09233a14 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:44.860002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-51dabf3e-2417-4229-a45a-4bcf09233a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc04f1d1745448491aefee50b7f4a43', 'request_id': 'req-51dabf3e-2417-4229-a45a-4bcf09233a14'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:44.865377 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-51dabf3e-2417-4229-a45a-4bcf09233a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc04f1d1745448491aefee50b7f4a43', 'request_id': 'req-51dabf3e-2417-4229-a45a-4bcf09233a14'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:44.872775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-51dabf3e-2417-4229-a45a-4bcf09233a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc04f1d1745448491aefee50b7f4a43', 'request_id': 'req-51dabf3e-2417-4229-a45a-4bcf09233a14'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:44.890335 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-51dabf3e-2417-4229-a45a-4bcf09233a14 admin admin] The token cache is being invalidate because project 6dc04f1d1745448491aefee50b7f4a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:44.890668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-51dabf3e-2417-4229-a45a-4bcf09233a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:44.895167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-51dabf3e-2417-4229-a45a-4bcf09233a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:44.896819 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1311/2648] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:44 2022] DELETE /identity/v3/projects/6dc04f1d1745448491aefee50b7f4a43 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:44.900916 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbf879-1166-4089-ab1a-2dc2af5d273e admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:44.902464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b1dbf879-1166-4089-ab1a-2dc2af5d273e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:44.916539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbf879-1166-4089-ab1a-2dc2af5d273e admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:44.975664 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714eb84-e6e7-4c6d-aa25-b558e7f544b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:44.976452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714eb84-e6e7-4c6d-aa25-b558e7f544b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:44.976759 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714eb84-e6e7-4c6d-aa25-b558e7f544b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:44.977040 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714eb84-e6e7-4c6d-aa25-b558e7f544b6 admin admin] PATH_INFO: `/v3/users/7956e1f9842c4ccfbb4cf3eb32709b9d` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:44.978276 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714eb84-e6e7-4c6d-aa25-b558e7f544b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7956e1f9842c4ccfbb4cf3eb32709b9d)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:44.980245 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714eb84-e6e7-4c6d-aa25-b558e7f544b6 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:45.031238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-b714eb84-e6e7-4c6d-aa25-b558e7f544b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7956e1f9842c4ccfbb4cf3eb32709b9d'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:45.038643 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-b714eb84-e6e7-4c6d-aa25-b558e7f544b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7956e1f9842c4ccfbb4cf3eb32709b9d'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:45.039259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-b714eb84-e6e7-4c6d-aa25-b558e7f544b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7956e1f9842c4ccfbb4cf3eb32709b9d'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:45.051406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-b714eb84-e6e7-4c6d-aa25-b558e7f544b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7956e1f9842c4ccfbb4cf3eb32709b9d'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:45.058651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-b714eb84-e6e7-4c6d-aa25-b558e7f544b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7956e1f9842c4ccfbb4cf3eb32709b9d'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:45.065821 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1338/2649] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:44 2022] DELETE /identity/v3/users/7956e1f9842c4ccfbb4cf3eb32709b9d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:45.368558 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dabf3e-2417-4229-a45a-4bcf09233a14 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:45.370482 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-51dabf3e-2417-4229-a45a-4bcf09233a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:45.384009 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dabf3e-2417-4229-a45a-4bcf09233a14 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:45.456526 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b226722-59f1-4df8-9f98-e0c3ccd6af5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:45.457410 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b226722-59f1-4df8-9f98-e0c3ccd6af5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:45.457729 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b226722-59f1-4df8-9f98-e0c3ccd6af5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:45.458018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b226722-59f1-4df8-9f98-e0c3ccd6af5b admin admin] PATH_INFO: `/v3/projects/c76882a7dff644f7891ce7aba7b9e3b2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:45.459354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b226722-59f1-4df8-9f98-e0c3ccd6af5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76882a7dff644f7891ce7aba7b9e3b2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:45.461334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b226722-59f1-4df8-9f98-e0c3ccd6af5b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:45.512132 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b226722-59f1-4df8-9f98-e0c3ccd6af5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76882a7dff644f7891ce7aba7b9e3b2', 'request_id': 'req-7b226722-59f1-4df8-9f98-e0c3ccd6af5b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:45.518434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b226722-59f1-4df8-9f98-e0c3ccd6af5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76882a7dff644f7891ce7aba7b9e3b2', 'request_id': 'req-7b226722-59f1-4df8-9f98-e0c3ccd6af5b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:45.525326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b226722-59f1-4df8-9f98-e0c3ccd6af5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76882a7dff644f7891ce7aba7b9e3b2', 'request_id': 'req-7b226722-59f1-4df8-9f98-e0c3ccd6af5b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:45.536048 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:45.540334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b226722-59f1-4df8-9f98-e0c3ccd6af5b admin admin] The token cache is being invalidate because project c76882a7dff644f7891ce7aba7b9e3b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:45.541083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b226722-59f1-4df8-9f98-e0c3ccd6af5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:45.542724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b226722-59f1-4df8-9f98-e0c3ccd6af5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:45.544965 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1312/2650] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:45 2022] DELETE /identity/v3/projects/c76882a7dff644f7891ce7aba7b9e3b2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:45.551487 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe648d-2e60-4970-ade2-7aca3d47cc30 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:45.551774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe648d-2e60-4970-ade2-7aca3d47cc30 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:45.552054 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe648d-2e60-4970-ade2-7aca3d47cc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:45.572092 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-bffe648d-2e60-4970-ade2-7aca3d47cc30 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:45.573768 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-bffe648d-2e60-4970-ade2-7aca3d47cc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:45.621454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:45.646696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1339/2651] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:45.652114 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686e680-fd71-459c-9316-bb95c78f246c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:45.652449 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686e680-fd71-459c-9316-bb95c78f246c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:45.652723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686e680-fd71-459c-9316-bb95c78f246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:45.674234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a686e680-fd71-459c-9316-bb95c78f246c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:45.675888 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a686e680-fd71-459c-9316-bb95c78f246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:45.685758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1313/2652] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:45.690785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe648d-2e60-4970-ade2-7aca3d47cc30 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:45.701202 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe648d-2e60-4970-ade2-7aca3d47cc30 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:45.709097 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da2aa9-b1e2-4c16-aa72-458ef645fd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:45.709846 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da2aa9-b1e2-4c16-aa72-458ef645fd1f admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:45.710366 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da2aa9-b1e2-4c16-aa72-458ef645fd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:45.710645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da2aa9-b1e2-4c16-aa72-458ef645fd1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:45.711467 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da2aa9-b1e2-4c16-aa72-458ef645fd1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:27:45.711789 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da2aa9-b1e2-4c16-aa72-458ef645fd1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:45.713430 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da2aa9-b1e2-4c16-aa72-458ef645fd1f admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:45.729724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1340/2653] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:27:45.731746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686e680-fd71-459c-9316-bb95c78f246c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:45.741798 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686e680-fd71-459c-9316-bb95c78f246c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:45.747400 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae952446-a949-4326-9828-5f506db8dfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:45.748342 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae952446-a949-4326-9828-5f506db8dfc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:45.748624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae952446-a949-4326-9828-5f506db8dfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:45.748875 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae952446-a949-4326-9828-5f506db8dfc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:45.749723 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae952446-a949-4326-9828-5f506db8dfc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:45.752170 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae952446-a949-4326-9828-5f506db8dfc2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:45.795117 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1314/2654] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:45 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:45.796411 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da2aa9-b1e2-4c16-aa72-458ef645fd1f admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:45.807092 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da2aa9-b1e2-4c16-aa72-458ef645fd1f admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:45.866704 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed97ce-8d5a-4dcb-ad9c-934ccc2ecaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:45.867400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed97ce-8d5a-4dcb-ad9c-934ccc2ecaf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:45.867683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed97ce-8d5a-4dcb-ad9c-934ccc2ecaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:45.867961 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed97ce-8d5a-4dcb-ad9c-934ccc2ecaf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:45.868671 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed97ce-8d5a-4dcb-ad9c-934ccc2ecaf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:45.870942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed97ce-8d5a-4dcb-ad9c-934ccc2ecaf9 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:45.890275 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1341/2655] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:45 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:45.894791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae952446-a949-4326-9828-5f506db8dfc2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:45.905645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae952446-a949-4326-9828-5f506db8dfc2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:45.911536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da7d63-d3b9-4681-9ed4-43d752aa02ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:45.912227 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da7d63-d3b9-4681-9ed4-43d752aa02ae admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:45.912522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da7d63-d3b9-4681-9ed4-43d752aa02ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:45.912805 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da7d63-d3b9-4681-9ed4-43d752aa02ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:45.913545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da7d63-d3b9-4681-9ed4-43d752aa02ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:45.915297 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da7d63-d3b9-4681-9ed4-43d752aa02ae admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:45.926158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1315/2656] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:45.930452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed97ce-8d5a-4dcb-ad9c-934ccc2ecaf9 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:45.941031 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed97ce-8d5a-4dcb-ad9c-934ccc2ecaf9 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:45.946813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d9b2b-9fc6-4906-93f2-101a9248ff74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:45.947513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d9b2b-9fc6-4906-93f2-101a9248ff74 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:45.947803 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d9b2b-9fc6-4906-93f2-101a9248ff74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:45.948071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d9b2b-9fc6-4906-93f2-101a9248ff74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:45.948813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d9b2b-9fc6-4906-93f2-101a9248ff74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:45.950498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d9b2b-9fc6-4906-93f2-101a9248ff74 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:45.961256 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1342/2657] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:45.965698 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da7d63-d3b9-4681-9ed4-43d752aa02ae admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:45.976442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da7d63-d3b9-4681-9ed4-43d752aa02ae admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:45.981833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6d94d-1ed0-44ed-85c0-9fbd8ecd6975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:45.982814 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6d94d-1ed0-44ed-85c0-9fbd8ecd6975 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:45.983101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6d94d-1ed0-44ed-85c0-9fbd8ecd6975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:45.983404 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6d94d-1ed0-44ed-85c0-9fbd8ecd6975 admin admin] PATH_INFO: `/v3/projects/10ce21cc46154faf9ff71db48789599d/users/5d907729d96f4b66acde01f7b621cd35/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:45.999709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6d94d-1ed0-44ed-85c0-9fbd8ecd6975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ce21cc46154faf9ff71db48789599d, user_id=5d907729d96f4b66acde01f7b621cd35, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:46.003294 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6d94d-1ed0-44ed-85c0-9fbd8ecd6975 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:46.017618 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1316/2658] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:45 2022] PUT /identity/v3/projects/10ce21cc46154faf9ff71db48789599d/users/5d907729d96f4b66acde01f7b621cd35/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:46.029145 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f116ca6-c653-4814-b444-e51080fa5a2e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:46.029435 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f116ca6-c653-4814-b444-e51080fa5a2e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:46.029733 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f116ca6-c653-4814-b444-e51080fa5a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:46.058651 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-1f116ca6-c653-4814-b444-e51080fa5a2e None None] MFA Rules not processed for user `5d907729d96f4b66acde01f7b621cd35`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:46.059859 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1f116ca6-c653-4814-b444-e51080fa5a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:46.131453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1343/2659] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:46.136199 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6d94d-1ed0-44ed-85c0-9fbd8ecd6975 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:46.200992 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6d94d-1ed0-44ed-85c0-9fbd8ecd6975 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:46.205787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e568b0-a7dc-47ed-bcd4-969b3aca83ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:46.206534 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e568b0-a7dc-47ed-bcd4-969b3aca83ee admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:46.206836 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e568b0-a7dc-47ed-bcd4-969b3aca83ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:46.207106 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e568b0-a7dc-47ed-bcd4-969b3aca83ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:46.207800 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e568b0-a7dc-47ed-bcd4-969b3aca83ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:46.209706 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e568b0-a7dc-47ed-bcd4-969b3aca83ee admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:46.237504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1317/2660] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:46 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:46.241675 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f116ca6-c653-4814-b444-e51080fa5a2e None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:46.252892 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f116ca6-c653-4814-b444-e51080fa5a2e None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:46.295950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:46.323412 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9eade-1f91-4e5a-baf3-733586ecfe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:46.324109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9eade-1f91-4e5a-baf3-733586ecfe86 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:46.324394 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9eade-1f91-4e5a-baf3-733586ecfe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:46.324668 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9eade-1f91-4e5a-baf3-733586ecfe86 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:46.325604 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9eade-1f91-4e5a-baf3-733586ecfe86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:46.327776 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9eade-1f91-4e5a-baf3-733586ecfe86 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:46.351856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1344/2661] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:46 2022] POST /identity/v3/users => generated 301 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:46.356063 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e568b0-a7dc-47ed-bcd4-969b3aca83ee admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:46.366547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e568b0-a7dc-47ed-bcd4-969b3aca83ee admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:46.372387 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e52a6-aa5c-46fc-a729-c90788ac7aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:46.373093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e52a6-aa5c-46fc-a729-c90788ac7aed admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:46.373397 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e52a6-aa5c-46fc-a729-c90788ac7aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:46.373679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e52a6-aa5c-46fc-a729-c90788ac7aed admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:46.374564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e52a6-aa5c-46fc-a729-c90788ac7aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:46.376271 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e52a6-aa5c-46fc-a729-c90788ac7aed admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:46.388559 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1318/2662] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:46.393180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9eade-1f91-4e5a-baf3-733586ecfe86 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:46.403765 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9eade-1f91-4e5a-baf3-733586ecfe86 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:46.409681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dba547-c33f-4d2f-b318-49d9f50d8fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:46.410677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dba547-c33f-4d2f-b318-49d9f50d8fce admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:46.411021 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dba547-c33f-4d2f-b318-49d9f50d8fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:46.411337 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dba547-c33f-4d2f-b318-49d9f50d8fce admin admin] PATH_INFO: `/v3/projects/c602fe23b85a4e97b0b48b0e5868549f/users/9c856ff9e5794e66ac0b7e3ebd08533c/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:46.427693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dba547-c33f-4d2f-b318-49d9f50d8fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c602fe23b85a4e97b0b48b0e5868549f, user_id=9c856ff9e5794e66ac0b7e3ebd08533c, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:46.430359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dba547-c33f-4d2f-b318-49d9f50d8fce admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:46.444581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1345/2663] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:46 2022] PUT /identity/v3/projects/c602fe23b85a4e97b0b48b0e5868549f/users/9c856ff9e5794e66ac0b7e3ebd08533c/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:27:46.448843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e52a6-aa5c-46fc-a729-c90788ac7aed admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:46.460457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e52a6-aa5c-46fc-a729-c90788ac7aed admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:46.520843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a69a89-9ab4-4d99-afbb-229bb7bdf8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:46.521432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a69a89-9ab4-4d99-afbb-229bb7bdf8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:46.521734 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a69a89-9ab4-4d99-afbb-229bb7bdf8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:46.522010 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a69a89-9ab4-4d99-afbb-229bb7bdf8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:46.522848 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a69a89-9ab4-4d99-afbb-229bb7bdf8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:46.524501 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a69a89-9ab4-4d99-afbb-229bb7bdf8b2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:46.526743 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:46.540083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1319/2664] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:46.541324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dba547-c33f-4d2f-b318-49d9f50d8fce admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:46.552160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dba547-c33f-4d2f-b318-49d9f50d8fce admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:46.557992 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c58dd3-2992-4001-a2fa-c18fba9c70eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:46.558972 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c58dd3-2992-4001-a2fa-c18fba9c70eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:46.559248 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c58dd3-2992-4001-a2fa-c18fba9c70eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:46.559519 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c58dd3-2992-4001-a2fa-c18fba9c70eb admin admin] PATH_INFO: `/v3/projects/c602fe23b85a4e97b0b48b0e5868549f/users/9c856ff9e5794e66ac0b7e3ebd08533c/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:46.561654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c58dd3-2992-4001-a2fa-c18fba9c70eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c602fe23b85a4e97b0b48b0e5868549f, user_id=9c856ff9e5794e66ac0b7e3ebd08533c, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:46.564394 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c58dd3-2992-4001-a2fa-c18fba9c70eb admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:46.575876 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1346/2665] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:46 2022] PUT /identity/v3/projects/c602fe23b85a4e97b0b48b0e5868549f/users/9c856ff9e5794e66ac0b7e3ebd08533c/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:46.586922 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3176473-4f51-4d81-8f0e-6b2d1a3a03b6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:46.587209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3176473-4f51-4d81-8f0e-6b2d1a3a03b6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:46.587490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3176473-4f51-4d81-8f0e-6b2d1a3a03b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:46.614933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b3176473-4f51-4d81-8f0e-6b2d1a3a03b6 None None] MFA Rules not processed for user `9c856ff9e5794e66ac0b7e3ebd08533c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:46.616187 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b3176473-4f51-4d81-8f0e-6b2d1a3a03b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:46.684604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1320/2666] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:46.695788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c58dd3-2992-4001-a2fa-c18fba9c70eb admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:46.697588 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-45c58dd3-2992-4001-a2fa-c18fba9c70eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:46.757361 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c58dd3-2992-4001-a2fa-c18fba9c70eb admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:46.761094 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663b9e9-ca64-4798-8648-0fb18122e3db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:46.761748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663b9e9-ca64-4798-8648-0fb18122e3db service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:46.762031 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663b9e9-ca64-4798-8648-0fb18122e3db service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:46.762310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663b9e9-ca64-4798-8648-0fb18122e3db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:46.772479 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663b9e9-ca64-4798-8648-0fb18122e3db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:46.773850 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663b9e9-ca64-4798-8648-0fb18122e3db service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:46.783875 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1347/2667] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:46.914642 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3176473-4f51-4d81-8f0e-6b2d1a3a03b6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:46.978797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3176473-4f51-4d81-8f0e-6b2d1a3a03b6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:46.983475 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ac983-6d81-43c6-80bd-9c1c24cd73c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:46.984359 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ac983-6d81-43c6-80bd-9c1c24cd73c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:46.984647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ac983-6d81-43c6-80bd-9c1c24cd73c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:46.984946 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ac983-6d81-43c6-80bd-9c1c24cd73c3 admin admin] PATH_INFO: `/v3/users/5d907729d96f4b66acde01f7b621cd35` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:46.986144 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ac983-6d81-43c6-80bd-9c1c24cd73c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d907729d96f4b66acde01f7b621cd35)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:46.988196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ac983-6d81-43c6-80bd-9c1c24cd73c3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:47.036399 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f00ac983-6d81-43c6-80bd-9c1c24cd73c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d907729d96f4b66acde01f7b621cd35'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.044161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f00ac983-6d81-43c6-80bd-9c1c24cd73c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d907729d96f4b66acde01f7b621cd35'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.044896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f00ac983-6d81-43c6-80bd-9c1c24cd73c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d907729d96f4b66acde01f7b621cd35'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.057617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f00ac983-6d81-43c6-80bd-9c1c24cd73c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d907729d96f4b66acde01f7b621cd35'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.064794 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f00ac983-6d81-43c6-80bd-9c1c24cd73c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d907729d96f4b66acde01f7b621cd35'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.071140 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1321/2668] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:46 2022] DELETE /identity/v3/users/5d907729d96f4b66acde01f7b621cd35 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:47.075902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ec507-12f5-4550-9fad-1017ed608587 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:47.076443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ec507-12f5-4550-9fad-1017ed608587 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:47.076443 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ec507-12f5-4550-9fad-1017ed608587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:47.095370 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-7d3ec507-12f5-4550-9fad-1017ed608587 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:47.096597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-7d3ec507-12f5-4550-9fad-1017ed608587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:47.159498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1348/2669] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:47.169653 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ac983-6d81-43c6-80bd-9c1c24cd73c3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:47.171209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f00ac983-6d81-43c6-80bd-9c1c24cd73c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:47.176733 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:47.232042 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ac983-6d81-43c6-80bd-9c1c24cd73c3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:47.236668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cadbd6-fcba-4059-bb24-48524b38398b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:47.237318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cadbd6-fcba-4059-bb24-48524b38398b service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:47.237601 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cadbd6-fcba-4059-bb24-48524b38398b service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:47.237874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cadbd6-fcba-4059-bb24-48524b38398b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:47.248007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cadbd6-fcba-4059-bb24-48524b38398b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:47.249451 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cadbd6-fcba-4059-bb24-48524b38398b service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:47.259288 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1322/2670] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:47.349263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ec507-12f5-4550-9fad-1017ed608587 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:47.351004 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-7d3ec507-12f5-4550-9fad-1017ed608587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:47.364629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ec507-12f5-4550-9fad-1017ed608587 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:47.371018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17390a-f38f-459a-ba03-62003c41929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:47.372094 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17390a-f38f-459a-ba03-62003c41929e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:47.372392 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17390a-f38f-459a-ba03-62003c41929e admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:47.372730 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e17390a-f38f-459a-ba03-62003c41929e admin admin] PATH_INFO: `/v3/users/9290af62806841e09077750b4616fcc9` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:47.374112 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17390a-f38f-459a-ba03-62003c41929e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9290af62806841e09077750b4616fcc9)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:47.376518 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e17390a-f38f-459a-ba03-62003c41929e admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:47.424309 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:47.437677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1e17390a-f38f-459a-ba03-62003c41929e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9290af62806841e09077750b4616fcc9'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.445893 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1e17390a-f38f-459a-ba03-62003c41929e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9290af62806841e09077750b4616fcc9'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.446693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1e17390a-f38f-459a-ba03-62003c41929e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9290af62806841e09077750b4616fcc9'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.459214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1e17390a-f38f-459a-ba03-62003c41929e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9290af62806841e09077750b4616fcc9'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.466508 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1e17390a-f38f-459a-ba03-62003c41929e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9290af62806841e09077750b4616fcc9'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.472741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1349/2671] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:47 2022] DELETE /identity/v3/users/9290af62806841e09077750b4616fcc9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:47.477334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bd9af-f8da-4dc1-beeb-81efc48e72b2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:47.477647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bd9af-f8da-4dc1-beeb-81efc48e72b2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:47.477928 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21bd9af-f8da-4dc1-beeb-81efc48e72b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:47.496142 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b21bd9af-f8da-4dc1-beeb-81efc48e72b2 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:47.497400 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b21bd9af-f8da-4dc1-beeb-81efc48e72b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:47.542036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17390a-f38f-459a-ba03-62003c41929e admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:47.543568 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1e17390a-f38f-459a-ba03-62003c41929e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:47.567188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1323/2672] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:47.578180 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bd9af-f8da-4dc1-beeb-81efc48e72b2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:47.579437 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b21bd9af-f8da-4dc1-beeb-81efc48e72b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:47.615619 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e17390a-f38f-459a-ba03-62003c41929e admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:47.621002 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54e3d7-3b94-4964-96a5-c34123f82daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:47.621881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54e3d7-3b94-4964-96a5-c34123f82daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:47.622172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54e3d7-3b94-4964-96a5-c34123f82daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:47.622772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54e3d7-3b94-4964-96a5-c34123f82daf admin admin] PATH_INFO: `/v3/projects/10ce21cc46154faf9ff71db48789599d` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:47.623746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54e3d7-3b94-4964-96a5-c34123f82daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ce21cc46154faf9ff71db48789599d)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:47.625703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54e3d7-3b94-4964-96a5-c34123f82daf admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:47.641354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21bd9af-f8da-4dc1-beeb-81efc48e72b2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:47.645288 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dadb16-9efc-41fa-b90c-c68459d1c11b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:47.645955 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dadb16-9efc-41fa-b90c-c68459d1c11b service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:47.646247 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dadb16-9efc-41fa-b90c-c68459d1c11b service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:47.646553 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dadb16-9efc-41fa-b90c-c68459d1c11b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:47.656692 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dadb16-9efc-41fa-b90c-c68459d1c11b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:47.658346 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dadb16-9efc-41fa-b90c-c68459d1c11b service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:47.668582 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1324/2673] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:27:47.675011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9a54e3d7-3b94-4964-96a5-c34123f82daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ce21cc46154faf9ff71db48789599d', 'request_id': 'req-9a54e3d7-3b94-4964-96a5-c34123f82daf'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.680953 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9a54e3d7-3b94-4964-96a5-c34123f82daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ce21cc46154faf9ff71db48789599d', 'request_id': 'req-9a54e3d7-3b94-4964-96a5-c34123f82daf'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.687745 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9a54e3d7-3b94-4964-96a5-c34123f82daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ce21cc46154faf9ff71db48789599d', 'request_id': 'req-9a54e3d7-3b94-4964-96a5-c34123f82daf'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.701407 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9a54e3d7-3b94-4964-96a5-c34123f82daf admin admin] The token cache is being invalidate because project 10ce21cc46154faf9ff71db48789599d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:47.701714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9a54e3d7-3b94-4964-96a5-c34123f82daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.702377 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-9a54e3d7-3b94-4964-96a5-c34123f82daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.704010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1350/2674] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:47 2022] DELETE /identity/v3/projects/10ce21cc46154faf9ff71db48789599d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:27:47.708436 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dadb16-9efc-41fa-b90c-c68459d1c11b service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:47.719026 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dadb16-9efc-41fa-b90c-c68459d1c11b service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:47.771195 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:47.785874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb10ab-012d-4d0e-8545-a6e40cac295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:47.787057 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb10ab-012d-4d0e-8545-a6e40cac295d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:47.787057 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb10ab-012d-4d0e-8545-a6e40cac295d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:47.787513 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb10ab-012d-4d0e-8545-a6e40cac295d admin admin] PATH_INFO: `/v3/users/9c856ff9e5794e66ac0b7e3ebd08533c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:47.788771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb10ab-012d-4d0e-8545-a6e40cac295d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c856ff9e5794e66ac0b7e3ebd08533c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:47.790739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb10ab-012d-4d0e-8545-a6e40cac295d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:47.848624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-eecb10ab-012d-4d0e-8545-a6e40cac295d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c856ff9e5794e66ac0b7e3ebd08533c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.861087 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-eecb10ab-012d-4d0e-8545-a6e40cac295d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c856ff9e5794e66ac0b7e3ebd08533c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.862156 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-eecb10ab-012d-4d0e-8545-a6e40cac295d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c856ff9e5794e66ac0b7e3ebd08533c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.879248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-eecb10ab-012d-4d0e-8545-a6e40cac295d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c856ff9e5794e66ac0b7e3ebd08533c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.886863 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-eecb10ab-012d-4d0e-8545-a6e40cac295d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c856ff9e5794e66ac0b7e3ebd08533c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:47.893789 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1325/2675] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:47 2022] DELETE /identity/v3/users/9c856ff9e5794e66ac0b7e3ebd08533c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:48.006417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54e3d7-3b94-4964-96a5-c34123f82daf admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:48.008108 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9a54e3d7-3b94-4964-96a5-c34123f82daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:48.038998 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54e3d7-3b94-4964-96a5-c34123f82daf admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:48.090810 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:48.112388 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513dd01-abcc-4368-8c9d-175d092f2761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:48.113379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513dd01-abcc-4368-8c9d-175d092f2761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:48.113825 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513dd01-abcc-4368-8c9d-175d092f2761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:48.114134 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513dd01-abcc-4368-8c9d-175d092f2761 admin admin] PATH_INFO: `/v3/projects/9b9b356bab0e45029125d7e8f36336bd` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:48.115855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513dd01-abcc-4368-8c9d-175d092f2761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9b356bab0e45029125d7e8f36336bd)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:48.117797 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513dd01-abcc-4368-8c9d-175d092f2761 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:48.183741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e513dd01-abcc-4368-8c9d-175d092f2761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9b356bab0e45029125d7e8f36336bd', 'request_id': 'req-e513dd01-abcc-4368-8c9d-175d092f2761'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.193470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e513dd01-abcc-4368-8c9d-175d092f2761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9b356bab0e45029125d7e8f36336bd', 'request_id': 'req-e513dd01-abcc-4368-8c9d-175d092f2761'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.201011 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e513dd01-abcc-4368-8c9d-175d092f2761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9b356bab0e45029125d7e8f36336bd', 'request_id': 'req-e513dd01-abcc-4368-8c9d-175d092f2761'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.214632 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb10ab-012d-4d0e-8545-a6e40cac295d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:48.217345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-eecb10ab-012d-4d0e-8545-a6e40cac295d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:48.224156 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e513dd01-abcc-4368-8c9d-175d092f2761 admin admin] The token cache is being invalidate because project 9b9b356bab0e45029125d7e8f36336bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:48.224452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e513dd01-abcc-4368-8c9d-175d092f2761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.226638 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e513dd01-abcc-4368-8c9d-175d092f2761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.228775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1351/2676] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:48 2022] DELETE /identity/v3/projects/9b9b356bab0e45029125d7e8f36336bd => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:48.238699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513dd01-abcc-4368-8c9d-175d092f2761 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:48.240702 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e513dd01-abcc-4368-8c9d-175d092f2761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:48.246759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb10ab-012d-4d0e-8545-a6e40cac295d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:48.322963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6baf8dc-cff7-40d2-b7e8-e8f85f0274c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:48.323876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baf8dc-cff7-40d2-b7e8-e8f85f0274c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:48.324159 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baf8dc-cff7-40d2-b7e8-e8f85f0274c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:48.324440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baf8dc-cff7-40d2-b7e8-e8f85f0274c2 admin admin] PATH_INFO: `/v3/projects/c602fe23b85a4e97b0b48b0e5868549f` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:48.325668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6baf8dc-cff7-40d2-b7e8-e8f85f0274c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c602fe23b85a4e97b0b48b0e5868549f)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:48.327073 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513dd01-abcc-4368-8c9d-175d092f2761 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:48.327771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6baf8dc-cff7-40d2-b7e8-e8f85f0274c2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:48.332788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063998c-3661-4c64-8774-cf837f844d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:48.333734 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063998c-3661-4c64-8774-cf837f844d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:48.334120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063998c-3661-4c64-8774-cf837f844d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:48.334527 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063998c-3661-4c64-8774-cf837f844d83 admin admin] PATH_INFO: `/v3/users/332a3b6328e940aeb8b3ce69fb551eeb` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:48.335951 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063998c-3661-4c64-8774-cf837f844d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=332a3b6328e940aeb8b3ce69fb551eeb)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:48.338190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7063998c-3661-4c64-8774-cf837f844d83 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:48.380860 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a6baf8dc-cff7-40d2-b7e8-e8f85f0274c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c602fe23b85a4e97b0b48b0e5868549f', 'request_id': 'req-a6baf8dc-cff7-40d2-b7e8-e8f85f0274c2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.386341 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a6baf8dc-cff7-40d2-b7e8-e8f85f0274c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c602fe23b85a4e97b0b48b0e5868549f', 'request_id': 'req-a6baf8dc-cff7-40d2-b7e8-e8f85f0274c2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.389083 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7063998c-3661-4c64-8774-cf837f844d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332a3b6328e940aeb8b3ce69fb551eeb'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.392642 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a6baf8dc-cff7-40d2-b7e8-e8f85f0274c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c602fe23b85a4e97b0b48b0e5868549f', 'request_id': 'req-a6baf8dc-cff7-40d2-b7e8-e8f85f0274c2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.397942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7063998c-3661-4c64-8774-cf837f844d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332a3b6328e940aeb8b3ce69fb551eeb'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.398727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7063998c-3661-4c64-8774-cf837f844d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332a3b6328e940aeb8b3ce69fb551eeb'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.401007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:48.405961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a6baf8dc-cff7-40d2-b7e8-e8f85f0274c2 admin admin] The token cache is being invalidate because project c602fe23b85a4e97b0b48b0e5868549f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:48.406332 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a6baf8dc-cff7-40d2-b7e8-e8f85f0274c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.407415 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a6baf8dc-cff7-40d2-b7e8-e8f85f0274c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.412588 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1326/2677] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:48 2022] DELETE /identity/v3/projects/c602fe23b85a4e97b0b48b0e5868549f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:48.414318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b60d0a-ce4e-4ace-8baa-9109ea2e497c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:48.415099 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b60d0a-ce4e-4ace-8baa-9109ea2e497c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:48.415440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7063998c-3661-4c64-8774-cf837f844d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332a3b6328e940aeb8b3ce69fb551eeb'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.415579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b60d0a-ce4e-4ace-8baa-9109ea2e497c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:48.417721 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:48.425116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-7063998c-3661-4c64-8774-cf837f844d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332a3b6328e940aeb8b3ce69fb551eeb'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.432455 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1352/2678] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:48 2022] DELETE /identity/v3/users/332a3b6328e940aeb8b3ce69fb551eeb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:48.436283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-69b60d0a-ce4e-4ace-8baa-9109ea2e497c None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:48.437553 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-69b60d0a-ce4e-4ace-8baa-9109ea2e497c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:48.508378 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1327/2679] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:48.517300 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645e3a4-016f-4ddc-bbcf-db153ff82940 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:48.517563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645e3a4-016f-4ddc-bbcf-db153ff82940 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:48.517849 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645e3a4-016f-4ddc-bbcf-db153ff82940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:48.537506 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-6645e3a4-016f-4ddc-bbcf-db153ff82940 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:48.538908 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6645e3a4-016f-4ddc-bbcf-db153ff82940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:48.548700 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1353/2680] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:48.553158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b60d0a-ce4e-4ace-8baa-9109ea2e497c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:48.564074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b60d0a-ce4e-4ace-8baa-9109ea2e497c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:48.569444 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a6671-8977-497e-91bd-57e2fdd5765b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:48.570116 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a6671-8977-497e-91bd-57e2fdd5765b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:48.570432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a6671-8977-497e-91bd-57e2fdd5765b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:48.570729 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a6671-8977-497e-91bd-57e2fdd5765b admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:48.571465 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a6671-8977-497e-91bd-57e2fdd5765b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:27:48.571778 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a6671-8977-497e-91bd-57e2fdd5765b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:48.573415 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a6671-8977-497e-91bd-57e2fdd5765b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:48.586655 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1328/2681] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:27:48.591350 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645e3a4-016f-4ddc-bbcf-db153ff82940 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:48.604872 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645e3a4-016f-4ddc-bbcf-db153ff82940 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:48.610062 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407fc42-dbc1-4f5c-8ae4-9624ec82deb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:48.610825 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407fc42-dbc1-4f5c-8ae4-9624ec82deb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:48.611120 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407fc42-dbc1-4f5c-8ae4-9624ec82deb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:48.611393 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407fc42-dbc1-4f5c-8ae4-9624ec82deb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:48.612144 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407fc42-dbc1-4f5c-8ae4-9624ec82deb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:48.614287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407fc42-dbc1-4f5c-8ae4-9624ec82deb4 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:48.648249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1354/2682] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:48 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:48.649280 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a6671-8977-497e-91bd-57e2fdd5765b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:48.659583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a6671-8977-497e-91bd-57e2fdd5765b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:48.718556 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ff4ee-55d8-4669-88e1-0d8bea0d35f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:48.719212 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ff4ee-55d8-4669-88e1-0d8bea0d35f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:48.719492 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ff4ee-55d8-4669-88e1-0d8bea0d35f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:48.719760 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ff4ee-55d8-4669-88e1-0d8bea0d35f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:48.720467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ff4ee-55d8-4669-88e1-0d8bea0d35f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:48.722401 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ff4ee-55d8-4669-88e1-0d8bea0d35f2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:48.730921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407fc42-dbc1-4f5c-8ae4-9624ec82deb4 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:48.734012 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8407fc42-dbc1-4f5c-8ae4-9624ec82deb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:48.751167 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407fc42-dbc1-4f5c-8ae4-9624ec82deb4 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:48.752836 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1329/2683] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:48 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:48.756716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb58d74-4dae-44ef-a3ee-8411941a998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:48.757628 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb58d74-4dae-44ef-a3ee-8411941a998d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:48.757912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb58d74-4dae-44ef-a3ee-8411941a998d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:48.758188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb58d74-4dae-44ef-a3ee-8411941a998d admin admin] PATH_INFO: `/v3/projects/1d3be4f2ab05493599d0954d6ec7a6d1` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:48.758883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ff4ee-55d8-4669-88e1-0d8bea0d35f2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:48.759520 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb58d74-4dae-44ef-a3ee-8411941a998d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3be4f2ab05493599d0954d6ec7a6d1)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:48.762656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb58d74-4dae-44ef-a3ee-8411941a998d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:48.769227 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ff4ee-55d8-4669-88e1-0d8bea0d35f2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:48.774886 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1cf31-42f9-4a43-a964-2d1cff3b3f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:48.775614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1cf31-42f9-4a43-a964-2d1cff3b3f83 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:48.775963 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1cf31-42f9-4a43-a964-2d1cff3b3f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:48.776300 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1cf31-42f9-4a43-a964-2d1cff3b3f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:48.777097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1cf31-42f9-4a43-a964-2d1cff3b3f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:48.778767 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1cf31-42f9-4a43-a964-2d1cff3b3f83 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:48.790021 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1330/2684] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:48.793969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1cf31-42f9-4a43-a964-2d1cff3b3f83 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:48.804503 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1cf31-42f9-4a43-a964-2d1cff3b3f83 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:48.816535 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fdb58d74-4dae-44ef-a3ee-8411941a998d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3be4f2ab05493599d0954d6ec7a6d1', 'request_id': 'req-fdb58d74-4dae-44ef-a3ee-8411941a998d'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.822613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fdb58d74-4dae-44ef-a3ee-8411941a998d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3be4f2ab05493599d0954d6ec7a6d1', 'request_id': 'req-fdb58d74-4dae-44ef-a3ee-8411941a998d'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.829439 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fdb58d74-4dae-44ef-a3ee-8411941a998d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3be4f2ab05493599d0954d6ec7a6d1', 'request_id': 'req-fdb58d74-4dae-44ef-a3ee-8411941a998d'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.842465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fdb58d74-4dae-44ef-a3ee-8411941a998d admin admin] The token cache is being invalidate because project 1d3be4f2ab05493599d0954d6ec7a6d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:48.842767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fdb58d74-4dae-44ef-a3ee-8411941a998d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.843390 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-fdb58d74-4dae-44ef-a3ee-8411941a998d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:48.845183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1355/2685] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:48 2022] DELETE /identity/v3/projects/1d3be4f2ab05493599d0954d6ec7a6d1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:27:48.850814 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc457557-402c-4025-9122-17aa1d6d0734 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:48.851103 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc457557-402c-4025-9122-17aa1d6d0734 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:48.851381 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc457557-402c-4025-9122-17aa1d6d0734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:48.864127 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ece25-e2ff-4d2f-b434-5661aa118df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:48.864793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ece25-e2ff-4d2f-b434-5661aa118df4 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:48.865076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ece25-e2ff-4d2f-b434-5661aa118df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:48.865349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ece25-e2ff-4d2f-b434-5661aa118df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:48.866250 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ece25-e2ff-4d2f-b434-5661aa118df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:48.867921 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ece25-e2ff-4d2f-b434-5661aa118df4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:48.869552 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-fc457557-402c-4025-9122-17aa1d6d0734 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:48.870793 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-fc457557-402c-4025-9122-17aa1d6d0734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:48.873379 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:48.879061 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1331/2686] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:27:48.880763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1356/2687] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:48.882970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ece25-e2ff-4d2f-b434-5661aa118df4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:48.888675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-313ece25-e2ff-4d2f-b434-5661aa118df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:48.889076 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3980a-19da-433f-8586-9b94af7619cb None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:48.889373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3980a-19da-433f-8586-9b94af7619cb None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:48.889786 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3980a-19da-433f-8586-9b94af7619cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:48.901413 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ece25-e2ff-4d2f-b434-5661aa118df4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:48.905955 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc59a05-f32b-4b75-841d-656f33cc0f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:48.906874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc59a05-f32b-4b75-841d-656f33cc0f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:48.907152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc59a05-f32b-4b75-841d-656f33cc0f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:48.908962 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc59a05-f32b-4b75-841d-656f33cc0f10 admin admin] PATH_INFO: `/v3/projects/5c84909e3ba44b829266a1789d7e8e57/users/e9d70299068f42269eacabcba08cdd3b/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:48.909970 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-b1a3980a-19da-433f-8586-9b94af7619cb None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:48.911336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b1a3980a-19da-433f-8586-9b94af7619cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:48.920469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1357/2688] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:48.924684 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3980a-19da-433f-8586-9b94af7619cb None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:48.926780 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc59a05-f32b-4b75-841d-656f33cc0f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c84909e3ba44b829266a1789d7e8e57, user_id=e9d70299068f42269eacabcba08cdd3b, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:48.929171 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc59a05-f32b-4b75-841d-656f33cc0f10 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:48.934412 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3980a-19da-433f-8586-9b94af7619cb None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:48.939446 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916aed6-73d5-4667-98ff-e05155ef3114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:48.940103 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916aed6-73d5-4667-98ff-e05155ef3114 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:48.940385 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916aed6-73d5-4667-98ff-e05155ef3114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:48.940656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916aed6-73d5-4667-98ff-e05155ef3114 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:48.941386 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916aed6-73d5-4667-98ff-e05155ef3114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:27:48.941690 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916aed6-73d5-4667-98ff-e05155ef3114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:48.943238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1332/2689] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:48 2022] PUT /identity/v3/projects/5c84909e3ba44b829266a1789d7e8e57/users/e9d70299068f42269eacabcba08cdd3b/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:48.943373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916aed6-73d5-4667-98ff-e05155ef3114 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:48.953413 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37a94-97e2-4805-8d3a-3ab9be9abb18 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:48.953937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37a94-97e2-4805-8d3a-3ab9be9abb18 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:48.954220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d37a94-97e2-4805-8d3a-3ab9be9abb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:48.958706 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1358/2690] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:27:48.959641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916aed6-73d5-4667-98ff-e05155ef3114 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:48.970824 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916aed6-73d5-4667-98ff-e05155ef3114 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:48.979996 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-63d37a94-97e2-4805-8d3a-3ab9be9abb18 None None] MFA Rules not processed for user `e9d70299068f42269eacabcba08cdd3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:48.981313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-63d37a94-97e2-4805-8d3a-3ab9be9abb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:49.031921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416e713-b942-41a4-b14b-e1c5c10d7699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:49.032594 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416e713-b942-41a4-b14b-e1c5c10d7699 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.032884 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416e713-b942-41a4-b14b-e1c5c10d7699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.033164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416e713-b942-41a4-b14b-e1c5c10d7699 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.033866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416e713-b942-41a4-b14b-e1c5c10d7699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:49.035868 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416e713-b942-41a4-b14b-e1c5c10d7699 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:49.048634 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1333/2691] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:49.060645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d37a94-97e2-4805-8d3a-3ab9be9abb18 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:49.062450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-63d37a94-97e2-4805-8d3a-3ab9be9abb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:49.066960 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1359/2692] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:48 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:49.067771 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416e713-b942-41a4-b14b-e1c5c10d7699 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:49.073248 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:49.124143 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d37a94-97e2-4805-8d3a-3ab9be9abb18 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:49.131838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416e713-b942-41a4-b14b-e1c5c10d7699 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:49.137270 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d599c39-29cb-4969-bc2d-0d441748ea32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:49.137955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d599c39-29cb-4969-bc2d-0d441748ea32 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.138254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d599c39-29cb-4969-bc2d-0d441748ea32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.138643 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d599c39-29cb-4969-bc2d-0d441748ea32 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.139250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d599c39-29cb-4969-bc2d-0d441748ea32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:49.141172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d599c39-29cb-4969-bc2d-0d441748ea32 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:49.166348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1360/2693] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:49 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:49.167295 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d599c39-29cb-4969-bc2d-0d441748ea32 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:49.176825 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d599c39-29cb-4969-bc2d-0d441748ea32 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:49.177728 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8f760-6a21-44be-8e47-80b6016d845e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '927543219de847b88b97fbe4f343d2be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:49.178451 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8f760-6a21-44be-8e47-80b6016d845e service glance] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.178827 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8f760-6a21-44be-8e47-80b6016d845e service glance] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.179136 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8f760-6a21-44be-8e47-80b6016d845e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.181527 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de7464-2e13-4cdb-aa7c-2a3ba3312c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:49.182173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de7464-2e13-4cdb-aa7c-2a3ba3312c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.182492 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de7464-2e13-4cdb-aa7c-2a3ba3312c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.182763 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de7464-2e13-4cdb-aa7c-2a3ba3312c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.183478 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de7464-2e13-4cdb-aa7c-2a3ba3312c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:49.185079 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de7464-2e13-4cdb-aa7c-2a3ba3312c3d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:49.197953 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1361/2694] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:27:49.198975 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de7464-2e13-4cdb-aa7c-2a3ba3312c3d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:49.208639 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de7464-2e13-4cdb-aa7c-2a3ba3312c3d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:49.213465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d114a-6a1b-4371-b51d-3ab9c0edf7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:49.214094 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d114a-6a1b-4371-b51d-3ab9c0edf7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.214417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d114a-6a1b-4371-b51d-3ab9c0edf7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.214574 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:49.214680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d114a-6a1b-4371-b51d-3ab9c0edf7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.215388 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d114a-6a1b-4371-b51d-3ab9c0edf7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:49.216969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d114a-6a1b-4371-b51d-3ab9c0edf7f4 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:49.228194 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1362/2695] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:49.232574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d114a-6a1b-4371-b51d-3ab9c0edf7f4 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:49.241653 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8f760-6a21-44be-8e47-80b6016d845e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:49.242657 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d114a-6a1b-4371-b51d-3ab9c0edf7f4 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:49.243149 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8f760-6a21-44be-8e47-80b6016d845e service glance] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:49.247662 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5d4f7-f14f-4bed-8204-3ee96208d0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:49.248517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5d4f7-f14f-4bed-8204-3ee96208d0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.248790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5d4f7-f14f-4bed-8204-3ee96208d0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.249059 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5d4f7-f14f-4bed-8204-3ee96208d0e2 admin admin] PATH_INFO: `/v3/projects/d845bdc789e64ca19c183e722637c4bf/users/0151f0a5bad141109234a69b6b302159/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.253272 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1334/2696] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:27:49.264895 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5d4f7-f14f-4bed-8204-3ee96208d0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d845bdc789e64ca19c183e722637c4bf, user_id=0151f0a5bad141109234a69b6b302159, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:49.267603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5d4f7-f14f-4bed-8204-3ee96208d0e2 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:49.285764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1363/2697] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:49 2022] PUT /identity/v3/projects/d845bdc789e64ca19c183e722637c4bf/users/0151f0a5bad141109234a69b6b302159/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:49.298074 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1579916-5774-4b31-a65e-aeff818d9c5a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.298510 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1579916-5774-4b31-a65e-aeff818d9c5a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.298832 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1579916-5774-4b31-a65e-aeff818d9c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.334144 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a1579916-5774-4b31-a65e-aeff818d9c5a None None] MFA Rules not processed for user `0151f0a5bad141109234a69b6b302159`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:49.335528 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a1579916-5774-4b31-a65e-aeff818d9c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:49.411819 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1335/2698] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:49.416613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5d4f7-f14f-4bed-8204-3ee96208d0e2 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:49.486926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5d4f7-f14f-4bed-8204-3ee96208d0e2 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:49.494597 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c14dbc-3f1d-4d9c-89d9-79972158b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:49.495369 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c14dbc-3f1d-4d9c-89d9-79972158b668 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.495748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c14dbc-3f1d-4d9c-89d9-79972158b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.496113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c14dbc-3f1d-4d9c-89d9-79972158b668 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.497044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c14dbc-3f1d-4d9c-89d9-79972158b668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:49.499811 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c14dbc-3f1d-4d9c-89d9-79972158b668 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:49.540629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1364/2699] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:49 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:49.542112 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1579916-5774-4b31-a65e-aeff818d9c5a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:49.555189 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1579916-5774-4b31-a65e-aeff818d9c5a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:49.624157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02106b61-eb0e-4c1c-97db-780231b1d97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:49.625073 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02106b61-eb0e-4c1c-97db-780231b1d97a admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.625426 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02106b61-eb0e-4c1c-97db-780231b1d97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.625775 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02106b61-eb0e-4c1c-97db-780231b1d97a admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.626604 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02106b61-eb0e-4c1c-97db-780231b1d97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:49.628799 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02106b61-eb0e-4c1c-97db-780231b1d97a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:49.651984 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1336/2700] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:49 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:49.656183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c14dbc-3f1d-4d9c-89d9-79972158b668 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:49.670263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c14dbc-3f1d-4d9c-89d9-79972158b668 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:49.675990 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e874d-bdca-4d92-b8f6-7cfd3f47dd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:49.676986 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e874d-bdca-4d92-b8f6-7cfd3f47dd34 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.677425 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e874d-bdca-4d92-b8f6-7cfd3f47dd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.677851 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e874d-bdca-4d92-b8f6-7cfd3f47dd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.679049 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e874d-bdca-4d92-b8f6-7cfd3f47dd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:49.680977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e874d-bdca-4d92-b8f6-7cfd3f47dd34 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:49.696464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1365/2701] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:49.701018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02106b61-eb0e-4c1c-97db-780231b1d97a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:49.715989 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02106b61-eb0e-4c1c-97db-780231b1d97a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:49.721754 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e283a-47a1-4add-82aa-ba47791ca370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:49.722938 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e283a-47a1-4add-82aa-ba47791ca370 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.723272 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e283a-47a1-4add-82aa-ba47791ca370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.723580 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e283a-47a1-4add-82aa-ba47791ca370 admin admin] PATH_INFO: `/v3/projects/1afa666fd7a0482790a61c20ae565792/users/de5a5da396cd4c83bf08a00cd766bdb5/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.740850 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e283a-47a1-4add-82aa-ba47791ca370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1afa666fd7a0482790a61c20ae565792, user_id=de5a5da396cd4c83bf08a00cd766bdb5, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:49.744167 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e283a-47a1-4add-82aa-ba47791ca370 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:49.768935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1337/2702] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:49 2022] PUT /identity/v3/projects/1afa666fd7a0482790a61c20ae565792/users/de5a5da396cd4c83bf08a00cd766bdb5/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:49.780606 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e874d-bdca-4d92-b8f6-7cfd3f47dd34 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:49.793541 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e874d-bdca-4d92-b8f6-7cfd3f47dd34 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:49.815042 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:49.857197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437fa75-3672-497f-ad40-f079c661fc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:49.858113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437fa75-3672-497f-ad40-f079c661fc99 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.858416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437fa75-3672-497f-ad40-f079c661fc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.858709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437fa75-3672-497f-ad40-f079c661fc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.859452 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437fa75-3672-497f-ad40-f079c661fc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:49.861118 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437fa75-3672-497f-ad40-f079c661fc99 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:49.871630 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1366/2703] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:49.875840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e283a-47a1-4add-82aa-ba47791ca370 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:49.887081 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e283a-47a1-4add-82aa-ba47791ca370 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:49.891751 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb67ee1-9904-42ca-9bfc-4db60ae2a31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:49.892625 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb67ee1-9904-42ca-9bfc-4db60ae2a31e admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.892909 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb67ee1-9904-42ca-9bfc-4db60ae2a31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.893181 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb67ee1-9904-42ca-9bfc-4db60ae2a31e admin admin] PATH_INFO: `/v3/projects/1afa666fd7a0482790a61c20ae565792/users/de5a5da396cd4c83bf08a00cd766bdb5/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.895173 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb67ee1-9904-42ca-9bfc-4db60ae2a31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1afa666fd7a0482790a61c20ae565792, user_id=de5a5da396cd4c83bf08a00cd766bdb5, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:49.897836 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb67ee1-9904-42ca-9bfc-4db60ae2a31e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:49.908175 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1338/2704] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:49 2022] PUT /identity/v3/projects/1afa666fd7a0482790a61c20ae565792/users/de5a5da396cd4c83bf08a00cd766bdb5/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:49.918937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764ec3f-7316-4859-be32-2d0405bc87bc None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:49.919191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764ec3f-7316-4859-be32-2d0405bc87bc None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:49.919457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764ec3f-7316-4859-be32-2d0405bc87bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:49.950526 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-c764ec3f-7316-4859-be32-2d0405bc87bc None None] MFA Rules not processed for user `de5a5da396cd4c83bf08a00cd766bdb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:49.951694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c764ec3f-7316-4859-be32-2d0405bc87bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:50.024818 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1367/2705] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:50.037785 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb67ee1-9904-42ca-9bfc-4db60ae2a31e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:50.040100 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-eeb67ee1-9904-42ca-9bfc-4db60ae2a31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:50.064311 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:50.108188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb67ee1-9904-42ca-9bfc-4db60ae2a31e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:50.111883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5efdd0-a5c9-4ade-8a2a-79cafef258bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:50.112537 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5efdd0-a5c9-4ade-8a2a-79cafef258bd service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:50.112819 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5efdd0-a5c9-4ade-8a2a-79cafef258bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:50.113093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5efdd0-a5c9-4ade-8a2a-79cafef258bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:50.173261 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5efdd0-a5c9-4ade-8a2a-79cafef258bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:50.174857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5efdd0-a5c9-4ade-8a2a-79cafef258bd service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:50.184811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1339/2706] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:51.087143 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764ec3f-7316-4859-be32-2d0405bc87bc None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:51.088820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c764ec3f-7316-4859-be32-2d0405bc87bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:51.158961 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764ec3f-7316-4859-be32-2d0405bc87bc None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:51.164166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24811a4-6cc2-4c63-a1ab-96cfce600e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:51.165056 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24811a4-6cc2-4c63-a1ab-96cfce600e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:51.165336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24811a4-6cc2-4c63-a1ab-96cfce600e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:51.165611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24811a4-6cc2-4c63-a1ab-96cfce600e73 admin admin] PATH_INFO: `/v3/users/b1463e14b2584b5aa622ec44fa81f586` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:51.166979 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24811a4-6cc2-4c63-a1ab-96cfce600e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1463e14b2584b5aa622ec44fa81f586)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:51.168961 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24811a4-6cc2-4c63-a1ab-96cfce600e73 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:51.215729 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:51.217380 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e24811a4-6cc2-4c63-a1ab-96cfce600e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1463e14b2584b5aa622ec44fa81f586'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:51.225757 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e24811a4-6cc2-4c63-a1ab-96cfce600e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1463e14b2584b5aa622ec44fa81f586'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:51.226366 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e24811a4-6cc2-4c63-a1ab-96cfce600e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1463e14b2584b5aa622ec44fa81f586'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:51.238062 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e24811a4-6cc2-4c63-a1ab-96cfce600e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1463e14b2584b5aa622ec44fa81f586'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:51.245243 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e24811a4-6cc2-4c63-a1ab-96cfce600e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1463e14b2584b5aa622ec44fa81f586'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:51.251706 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1368/2707] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:51 2022] DELETE /identity/v3/users/b1463e14b2584b5aa622ec44fa81f586 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:51.256427 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3a182-680e-4a1d-bff9-eb09c8b91697 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:51.256919 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3a182-680e-4a1d-bff9-eb09c8b91697 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:51.257019 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3a182-680e-4a1d-bff9-eb09c8b91697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:51.275224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-afb3a182-680e-4a1d-bff9-eb09c8b91697 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:51.276448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-afb3a182-680e-4a1d-bff9-eb09c8b91697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:51.342293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1340/2708] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:51.352396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24811a4-6cc2-4c63-a1ab-96cfce600e73 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:51.353994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e24811a4-6cc2-4c63-a1ab-96cfce600e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:51.416396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24811a4-6cc2-4c63-a1ab-96cfce600e73 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:51.420368 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821d12c-c833-4740-bb91-6bdd158aa37c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:51.421007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821d12c-c833-4740-bb91-6bdd158aa37c service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:51.421286 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821d12c-c833-4740-bb91-6bdd158aa37c service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:51.421563 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821d12c-c833-4740-bb91-6bdd158aa37c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:51.430741 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821d12c-c833-4740-bb91-6bdd158aa37c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:51.432456 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821d12c-c833-4740-bb91-6bdd158aa37c service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:51.441992 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1369/2709] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:51.731972 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3a182-680e-4a1d-bff9-eb09c8b91697 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:51.733513 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-afb3a182-680e-4a1d-bff9-eb09c8b91697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:51.747120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3a182-680e-4a1d-bff9-eb09c8b91697 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:51.752099 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cccfbe-5015-4490-8b3d-56eef49253b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:51.752976 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cccfbe-5015-4490-8b3d-56eef49253b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:51.753260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cccfbe-5015-4490-8b3d-56eef49253b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:51.753565 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cccfbe-5015-4490-8b3d-56eef49253b1 admin admin] PATH_INFO: `/v3/projects/e4c20f47fe174856a2134e0ef0764a60` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:51.754877 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cccfbe-5015-4490-8b3d-56eef49253b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4c20f47fe174856a2134e0ef0764a60)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:51.756843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cccfbe-5015-4490-8b3d-56eef49253b1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:51.807290 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-55cccfbe-5015-4490-8b3d-56eef49253b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4c20f47fe174856a2134e0ef0764a60', 'request_id': 'req-55cccfbe-5015-4490-8b3d-56eef49253b1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:51.812896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-55cccfbe-5015-4490-8b3d-56eef49253b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4c20f47fe174856a2134e0ef0764a60', 'request_id': 'req-55cccfbe-5015-4490-8b3d-56eef49253b1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:51.819758 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-55cccfbe-5015-4490-8b3d-56eef49253b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4c20f47fe174856a2134e0ef0764a60', 'request_id': 'req-55cccfbe-5015-4490-8b3d-56eef49253b1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:51.823742 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:51.835309 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-55cccfbe-5015-4490-8b3d-56eef49253b1 admin admin] The token cache is being invalidate because project e4c20f47fe174856a2134e0ef0764a60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:51.835643 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-55cccfbe-5015-4490-8b3d-56eef49253b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:51.836560 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-55cccfbe-5015-4490-8b3d-56eef49253b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:51.838275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1341/2710] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:51 2022] DELETE /identity/v3/projects/e4c20f47fe174856a2134e0ef0764a60 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:51.842293 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821d12c-c833-4740-bb91-6bdd158aa37c service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:51.852388 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821d12c-c833-4740-bb91-6bdd158aa37c service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:51.920160 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0ec56-919c-4d08-92c0-289d273c164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:51.921065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0ec56-919c-4d08-92c0-289d273c164b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:51.921512 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0ec56-919c-4d08-92c0-289d273c164b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:51.921869 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0ec56-919c-4d08-92c0-289d273c164b admin admin] PATH_INFO: `/v3/users/afffa55f090d45bdb1bbb0bf8044b616` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:51.923109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0ec56-919c-4d08-92c0-289d273c164b admin admin] RBAC: Authorizing `identity:delete_user(user_id=afffa55f090d45bdb1bbb0bf8044b616)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:51.925028 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0ec56-919c-4d08-92c0-289d273c164b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:51.971737 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-dfd0ec56-919c-4d08-92c0-289d273c164b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afffa55f090d45bdb1bbb0bf8044b616'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:51.980305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-dfd0ec56-919c-4d08-92c0-289d273c164b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afffa55f090d45bdb1bbb0bf8044b616'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:51.981061 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-dfd0ec56-919c-4d08-92c0-289d273c164b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afffa55f090d45bdb1bbb0bf8044b616'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:51.994260 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:51.996970 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-dfd0ec56-919c-4d08-92c0-289d273c164b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afffa55f090d45bdb1bbb0bf8044b616'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:52.006181 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-dfd0ec56-919c-4d08-92c0-289d273c164b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afffa55f090d45bdb1bbb0bf8044b616'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:52.012261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1370/2711] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:51 2022] DELETE /identity/v3/users/afffa55f090d45bdb1bbb0bf8044b616 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:52.298354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cccfbe-5015-4490-8b3d-56eef49253b1 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:52.299870 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-55cccfbe-5015-4490-8b3d-56eef49253b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:52.314157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cccfbe-5015-4490-8b3d-56eef49253b1 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:52.380482 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14999270-a777-4d1c-b6e6-405ddd700d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:52.381272 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14999270-a777-4d1c-b6e6-405ddd700d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:52.381555 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14999270-a777-4d1c-b6e6-405ddd700d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:52.382333 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14999270-a777-4d1c-b6e6-405ddd700d88 admin admin] PATH_INFO: `/v3/projects/5bfd3f5b7241451bb2e468ec9d6b78a1` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:52.383565 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14999270-a777-4d1c-b6e6-405ddd700d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bfd3f5b7241451bb2e468ec9d6b78a1)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:52.385524 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14999270-a777-4d1c-b6e6-405ddd700d88 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:52.432057 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14999270-a777-4d1c-b6e6-405ddd700d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bfd3f5b7241451bb2e468ec9d6b78a1', 'request_id': 'req-14999270-a777-4d1c-b6e6-405ddd700d88'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:52.440240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14999270-a777-4d1c-b6e6-405ddd700d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bfd3f5b7241451bb2e468ec9d6b78a1', 'request_id': 'req-14999270-a777-4d1c-b6e6-405ddd700d88'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:52.448520 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14999270-a777-4d1c-b6e6-405ddd700d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bfd3f5b7241451bb2e468ec9d6b78a1', 'request_id': 'req-14999270-a777-4d1c-b6e6-405ddd700d88'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:52.464591 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14999270-a777-4d1c-b6e6-405ddd700d88 admin admin] The token cache is being invalidate because project 5bfd3f5b7241451bb2e468ec9d6b78a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:52.464881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14999270-a777-4d1c-b6e6-405ddd700d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:52.465521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14999270-a777-4d1c-b6e6-405ddd700d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:52.468083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1342/2712] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:52 2022] DELETE /identity/v3/projects/5bfd3f5b7241451bb2e468ec9d6b78a1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:52.473906 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0d5f1-83ff-44f2-b71d-5cc6775dbfb5 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:52.474465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0d5f1-83ff-44f2-b71d-5cc6775dbfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:52.474590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0d5f1-83ff-44f2-b71d-5cc6775dbfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:52.494215 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-d2b0d5f1-83ff-44f2-b71d-5cc6775dbfb5 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:52.495455 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d2b0d5f1-83ff-44f2-b71d-5cc6775dbfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:52.567033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1371/2713] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:52.575319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d5a2d-8538-473a-8dcc-87d864b6fbc9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:52.575609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d5a2d-8538-473a-8dcc-87d864b6fbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:52.575891 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d5a2d-8538-473a-8dcc-87d864b6fbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:52.596695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-084d5a2d-8538-473a-8dcc-87d864b6fbc9 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:52.598029 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-084d5a2d-8538-473a-8dcc-87d864b6fbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:52.607450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1343/2714] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:52.612594 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0d5f1-83ff-44f2-b71d-5cc6775dbfb5 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:52.625557 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0d5f1-83ff-44f2-b71d-5cc6775dbfb5 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:52.631075 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b6243-c2d5-4b39-8e34-4c77c763ee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:52.631685 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b6243-c2d5-4b39-8e34-4c77c763ee2c admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:52.632099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b6243-c2d5-4b39-8e34-4c77c763ee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:52.632380 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b6243-c2d5-4b39-8e34-4c77c763ee2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:52.633124 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b6243-c2d5-4b39-8e34-4c77c763ee2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:27:52.633432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b6243-c2d5-4b39-8e34-4c77c763ee2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:52.635071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b6243-c2d5-4b39-8e34-4c77c763ee2c admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:52.648089 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1372/2715] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:27:52.652714 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d5a2d-8538-473a-8dcc-87d864b6fbc9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:52.662536 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d5a2d-8538-473a-8dcc-87d864b6fbc9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:52.667910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ec037-a2bc-48a7-823b-5bec90001c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:52.668583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ec037-a2bc-48a7-823b-5bec90001c02 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:52.668860 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ec037-a2bc-48a7-823b-5bec90001c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:52.669134 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ec037-a2bc-48a7-823b-5bec90001c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:52.669858 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ec037-a2bc-48a7-823b-5bec90001c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:52.671864 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ec037-a2bc-48a7-823b-5bec90001c02 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:52.699720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1344/2716] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:52 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:52.704019 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b6243-c2d5-4b39-8e34-4c77c763ee2c admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:52.714697 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b6243-c2d5-4b39-8e34-4c77c763ee2c admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:52.731338 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ec037-a2bc-48a7-823b-5bec90001c02 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:52.733238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b48ec037-a2bc-48a7-823b-5bec90001c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:52.776115 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938a373-93d3-4dd5-9a6a-f762c9aeabf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:52.776780 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938a373-93d3-4dd5-9a6a-f762c9aeabf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:52.777063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938a373-93d3-4dd5-9a6a-f762c9aeabf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:52.777371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938a373-93d3-4dd5-9a6a-f762c9aeabf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:52.778032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938a373-93d3-4dd5-9a6a-f762c9aeabf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:52.780015 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938a373-93d3-4dd5-9a6a-f762c9aeabf9 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:52.798318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:52.805497 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1373/2717] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:52 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:52.805696 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ec037-a2bc-48a7-823b-5bec90001c02 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:52.807857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938a373-93d3-4dd5-9a6a-f762c9aeabf9 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:52.809072 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686a588-458a-4ca0-aee9-d9d34bc6f883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:52.810047 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686a588-458a-4ca0-aee9-d9d34bc6f883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:52.810335 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686a588-458a-4ca0-aee9-d9d34bc6f883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:52.811793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686a588-458a-4ca0-aee9-d9d34bc6f883 admin admin] PATH_INFO: `/v3/users/0151f0a5bad141109234a69b6b302159` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:52.813414 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686a588-458a-4ca0-aee9-d9d34bc6f883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0151f0a5bad141109234a69b6b302159)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:52.815575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c686a588-458a-4ca0-aee9-d9d34bc6f883 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:52.820140 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938a373-93d3-4dd5-9a6a-f762c9aeabf9 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:52.825363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec26dbf-5825-49e9-8099-40d63425a10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:52.826057 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec26dbf-5825-49e9-8099-40d63425a10e admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:52.826336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec26dbf-5825-49e9-8099-40d63425a10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:52.826716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec26dbf-5825-49e9-8099-40d63425a10e admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:52.827474 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec26dbf-5825-49e9-8099-40d63425a10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:52.829510 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec26dbf-5825-49e9-8099-40d63425a10e admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:52.842413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1374/2718] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:27:52.846375 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec26dbf-5825-49e9-8099-40d63425a10e admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:52.866758 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec26dbf-5825-49e9-8099-40d63425a10e admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:52.872123 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74e7d6-083b-43fb-bb30-dd9debf448f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:52.872824 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74e7d6-083b-43fb-bb30-dd9debf448f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:52.873113 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74e7d6-083b-43fb-bb30-dd9debf448f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:52.873396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74e7d6-083b-43fb-bb30-dd9debf448f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:52.874152 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74e7d6-083b-43fb-bb30-dd9debf448f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:52.875913 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74e7d6-083b-43fb-bb30-dd9debf448f0 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:52.881472 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c686a588-458a-4ca0-aee9-d9d34bc6f883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0151f0a5bad141109234a69b6b302159'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:52.893338 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c686a588-458a-4ca0-aee9-d9d34bc6f883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0151f0a5bad141109234a69b6b302159'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:52.894224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c686a588-458a-4ca0-aee9-d9d34bc6f883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0151f0a5bad141109234a69b6b302159'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:52.899450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1375/2719] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:52.900574 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74e7d6-083b-43fb-bb30-dd9debf448f0 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:52.902503 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-bb74e7d6-083b-43fb-bb30-dd9debf448f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:52.910749 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c686a588-458a-4ca0-aee9-d9d34bc6f883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0151f0a5bad141109234a69b6b302159'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:52.917086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74e7d6-083b-43fb-bb30-dd9debf448f0 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:52.918461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c686a588-458a-4ca0-aee9-d9d34bc6f883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0151f0a5bad141109234a69b6b302159'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:52.925248 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd533d3-e383-4acc-aa3c-666bdadefc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:52.926238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd533d3-e383-4acc-aa3c-666bdadefc8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:52.926600 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd533d3-e383-4acc-aa3c-666bdadefc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:52.930125 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd533d3-e383-4acc-aa3c-666bdadefc8b admin admin] PATH_INFO: `/v3/projects/4bf7aab115d64f92bbc8793a8f89794a/users/fcd65b15b6a7453b988764ee249b73fc/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:52.930938 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1345/2720] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:52 2022] DELETE /identity/v3/users/0151f0a5bad141109234a69b6b302159 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:52.935940 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302c3b0-ef09-43f3-a131-68596554c688 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:52.936319 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302c3b0-ef09-43f3-a131-68596554c688 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:52.936639 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302c3b0-ef09-43f3-a131-68596554c688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:52.945211 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd533d3-e383-4acc-aa3c-666bdadefc8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf7aab115d64f92bbc8793a8f89794a, user_id=fcd65b15b6a7453b988764ee249b73fc, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:52.948447 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd533d3-e383-4acc-aa3c-666bdadefc8b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:52.955747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0302c3b0-ef09-43f3-a131-68596554c688 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:52.956964 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0302c3b0-ef09-43f3-a131-68596554c688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:52.961743 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1376/2721] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:52 2022] PUT /identity/v3/projects/4bf7aab115d64f92bbc8793a8f89794a/users/fcd65b15b6a7453b988764ee249b73fc/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:27:53.027727 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1346/2722] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:53.032141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328c3c1-0e90-4e75-af8c-c5ef44415a09 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:53.032358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328c3c1-0e90-4e75-af8c-c5ef44415a09 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:53.032635 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328c3c1-0e90-4e75-af8c-c5ef44415a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:53.038719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302c3b0-ef09-43f3-a131-68596554c688 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:53.040338 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0302c3b0-ef09-43f3-a131-68596554c688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:53.059678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-3328c3c1-0e90-4e75-af8c-c5ef44415a09 None None] MFA Rules not processed for user `fcd65b15b6a7453b988764ee249b73fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:53.060894 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3328c3c1-0e90-4e75-af8c-c5ef44415a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:53.065178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:53.099014 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302c3b0-ef09-43f3-a131-68596554c688 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:53.102791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73c010-074b-4d15-972a-647d8b9d0d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:53.103548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73c010-074b-4d15-972a-647d8b9d0d7a service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:53.104070 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73c010-074b-4d15-972a-647d8b9d0d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:53.104349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73c010-074b-4d15-972a-647d8b9d0d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:53.114274 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73c010-074b-4d15-972a-647d8b9d0d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:53.115785 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73c010-074b-4d15-972a-647d8b9d0d7a service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:53.130677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1347/2723] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:27:53.148724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1377/2724] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:53.153349 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73c010-074b-4d15-972a-647d8b9d0d7a service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:53.163677 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73c010-074b-4d15-972a-647d8b9d0d7a service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:53.168573 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3689d-e229-4356-8cb0-9468ff568741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:53.169335 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3689d-e229-4356-8cb0-9468ff568741 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:53.169623 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3689d-e229-4356-8cb0-9468ff568741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:53.169902 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3689d-e229-4356-8cb0-9468ff568741 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:53.170624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3689d-e229-4356-8cb0-9468ff568741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:53.172572 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3689d-e229-4356-8cb0-9468ff568741 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:53.192971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:53.202000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1348/2725] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:53 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:53.206498 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328c3c1-0e90-4e75-af8c-c5ef44415a09 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:53.219867 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328c3c1-0e90-4e75-af8c-c5ef44415a09 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:53.288173 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8969152-b935-4e74-82ad-1760d8259c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:53.289435 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8969152-b935-4e74-82ad-1760d8259c37 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:53.290328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8969152-b935-4e74-82ad-1760d8259c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:53.290328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8969152-b935-4e74-82ad-1760d8259c37 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:53.291455 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8969152-b935-4e74-82ad-1760d8259c37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:53.293473 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8969152-b935-4e74-82ad-1760d8259c37 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:53.316780 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1378/2726] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:53 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:53.321086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3689d-e229-4356-8cb0-9468ff568741 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:53.332057 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3689d-e229-4356-8cb0-9468ff568741 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:53.336977 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81f7b6-44c3-4093-be8e-b020fc1cde26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:53.337675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81f7b6-44c3-4093-be8e-b020fc1cde26 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:53.337955 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81f7b6-44c3-4093-be8e-b020fc1cde26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:53.338295 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81f7b6-44c3-4093-be8e-b020fc1cde26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:53.338992 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81f7b6-44c3-4093-be8e-b020fc1cde26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:53.340602 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81f7b6-44c3-4093-be8e-b020fc1cde26 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:53.352644 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1349/2727] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:53.356854 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8969152-b935-4e74-82ad-1760d8259c37 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:53.368071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8969152-b935-4e74-82ad-1760d8259c37 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:53.374732 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db9fc5-0889-4284-a969-c601afc088fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:53.375502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db9fc5-0889-4284-a969-c601afc088fb admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:53.375902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db9fc5-0889-4284-a969-c601afc088fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:53.376171 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db9fc5-0889-4284-a969-c601afc088fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:53.377257 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db9fc5-0889-4284-a969-c601afc088fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:53.382097 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db9fc5-0889-4284-a969-c601afc088fb admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:53.395464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1379/2728] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:53.400928 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81f7b6-44c3-4093-be8e-b020fc1cde26 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:53.411598 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81f7b6-44c3-4093-be8e-b020fc1cde26 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:53.416635 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269a4dd-aa86-4157-a1cd-c96f1f7be9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:53.417572 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269a4dd-aa86-4157-a1cd-c96f1f7be9a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:53.417853 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269a4dd-aa86-4157-a1cd-c96f1f7be9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:53.418130 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269a4dd-aa86-4157-a1cd-c96f1f7be9a6 admin admin] PATH_INFO: `/v3/projects/18f53c28b0214207b062285e5c32f40d/users/cb52239b861d4a1cb5249472bcc80468/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:53.432770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db9fc5-0889-4284-a969-c601afc088fb admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:53.434910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-13db9fc5-0889-4284-a969-c601afc088fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:53.437069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269a4dd-aa86-4157-a1cd-c96f1f7be9a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f53c28b0214207b062285e5c32f40d, user_id=cb52239b861d4a1cb5249472bcc80468, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:53.440381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269a4dd-aa86-4157-a1cd-c96f1f7be9a6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:53.450089 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db9fc5-0889-4284-a969-c601afc088fb admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:53.458269 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1350/2729] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:53 2022] PUT /identity/v3/projects/18f53c28b0214207b062285e5c32f40d/users/cb52239b861d4a1cb5249472bcc80468/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:53.468452 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719523e7-0a9e-430b-b080-219eb286ae65 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:53.468746 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719523e7-0a9e-430b-b080-219eb286ae65 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:53.469027 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719523e7-0a9e-430b-b080-219eb286ae65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:53.495897 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-719523e7-0a9e-430b-b080-219eb286ae65 None None] MFA Rules not processed for user `cb52239b861d4a1cb5249472bcc80468`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:53.497135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-719523e7-0a9e-430b-b080-219eb286ae65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:53.510006 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:53.510918 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:53.511207 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:53.511486 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9 admin admin] PATH_INFO: `/v3/projects/d845bdc789e64ca19c183e722637c4bf` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:53.512680 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d845bdc789e64ca19c183e722637c4bf)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:53.514662 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:53.547768 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:53.564684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1351/2730] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:53.568066 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd845bdc789e64ca19c183e722637c4bf', 'request_id': 'req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:53.569548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719523e7-0a9e-430b-b080-219eb286ae65 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:53.575090 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd845bdc789e64ca19c183e722637c4bf', 'request_id': 'req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:53.582203 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719523e7-0a9e-430b-b080-219eb286ae65 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:53.582812 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd845bdc789e64ca19c183e722637c4bf', 'request_id': 'req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:53.596645 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9 admin admin] The token cache is being invalidate because project d845bdc789e64ca19c183e722637c4bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:53.596928 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:53.597552 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:53.599169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1380/2731] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:53 2022] DELETE /identity/v3/projects/d845bdc789e64ca19c183e722637c4bf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:27:53.603135 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:53.604419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:53.645457 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84bfec-dc3d-4600-8623-1960b650f124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:53.646651 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84bfec-dc3d-4600-8623-1960b650f124 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:53.647002 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84bfec-dc3d-4600-8623-1960b650f124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:53.647312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84bfec-dc3d-4600-8623-1960b650f124 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:53.648333 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84bfec-dc3d-4600-8623-1960b650f124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:53.650744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84bfec-dc3d-4600-8623-1960b650f124 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:53.677613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfd6f3-38dd-4b0d-93cc-51f41c8331d9 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:53.679303 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1352/2732] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:53 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:53.683152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84bfec-dc3d-4600-8623-1960b650f124 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:53.684811 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-aa84bfec-dc3d-4600-8623-1960b650f124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:53.731496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:53.740340 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f706d-e874-455d-b979-3dff54ad388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:53.741319 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f706d-e874-455d-b979-3dff54ad388b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:53.741601 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f706d-e874-455d-b979-3dff54ad388b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:53.741874 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f706d-e874-455d-b979-3dff54ad388b admin admin] PATH_INFO: `/v3/users/de5a5da396cd4c83bf08a00cd766bdb5` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:53.743117 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f706d-e874-455d-b979-3dff54ad388b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5a5da396cd4c83bf08a00cd766bdb5)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:53.745372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f706d-e874-455d-b979-3dff54ad388b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:53.755308 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84bfec-dc3d-4600-8623-1960b650f124 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:53.760534 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faaa84-d667-487e-bafb-d6b0992bb43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:53.761220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faaa84-d667-487e-bafb-d6b0992bb43e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:53.761509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faaa84-d667-487e-bafb-d6b0992bb43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:53.761792 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faaa84-d667-487e-bafb-d6b0992bb43e admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:53.762543 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faaa84-d667-487e-bafb-d6b0992bb43e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:53.764529 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faaa84-d667-487e-bafb-d6b0992bb43e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:53.785660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1353/2733] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:53 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:53.789672 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faaa84-d667-487e-bafb-d6b0992bb43e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:53.796421 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-996f706d-e874-455d-b979-3dff54ad388b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5a5da396cd4c83bf08a00cd766bdb5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:53.799645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faaa84-d667-487e-bafb-d6b0992bb43e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:53.804449 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-996f706d-e874-455d-b979-3dff54ad388b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5a5da396cd4c83bf08a00cd766bdb5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:53.804681 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc023e64-8b45-47ac-a6ca-d84aa23c1baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:53.805283 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-996f706d-e874-455d-b979-3dff54ad388b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5a5da396cd4c83bf08a00cd766bdb5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:53.805487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc023e64-8b45-47ac-a6ca-d84aa23c1baf admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:53.805599 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc023e64-8b45-47ac-a6ca-d84aa23c1baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:53.805871 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc023e64-8b45-47ac-a6ca-d84aa23c1baf admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:53.806636 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc023e64-8b45-47ac-a6ca-d84aa23c1baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:53.808248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc023e64-8b45-47ac-a6ca-d84aa23c1baf admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:53.812699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:53.818786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1354/2734] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:27:53.819097 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-996f706d-e874-455d-b979-3dff54ad388b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5a5da396cd4c83bf08a00cd766bdb5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:53.823422 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc023e64-8b45-47ac-a6ca-d84aa23c1baf admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:53.825423 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fc023e64-8b45-47ac-a6ca-d84aa23c1baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:53.827586 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-996f706d-e874-455d-b979-3dff54ad388b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5a5da396cd4c83bf08a00cd766bdb5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:53.833947 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1381/2735] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:27:53 2022] DELETE /identity/v3/users/de5a5da396cd4c83bf08a00cd766bdb5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:53.838099 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc023e64-8b45-47ac-a6ca-d84aa23c1baf admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:53.908438 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39843bb-bbd5-45ca-83f7-b83edab79002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:53.910186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39843bb-bbd5-45ca-83f7-b83edab79002 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:53.910949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39843bb-bbd5-45ca-83f7-b83edab79002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:53.911497 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39843bb-bbd5-45ca-83f7-b83edab79002 admin admin] PATH_INFO: `/v3/projects/0ea0a3d3b3454fafb2c2aadcb00f9182/users/b2f5d1db36d74334beaa5f3d6c27f412/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:53.939646 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39843bb-bbd5-45ca-83f7-b83edab79002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea0a3d3b3454fafb2c2aadcb00f9182, user_id=b2f5d1db36d74334beaa5f3d6c27f412, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:53.942714 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39843bb-bbd5-45ca-83f7-b83edab79002 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:53.960097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1355/2736] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:53 2022] PUT /identity/v3/projects/0ea0a3d3b3454fafb2c2aadcb00f9182/users/b2f5d1db36d74334beaa5f3d6c27f412/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:53.963893 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f706d-e874-455d-b979-3dff54ad388b admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:53.975098 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f706d-e874-455d-b979-3dff54ad388b admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:54.046282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1f038-7f66-423d-9b2f-cb1e7e8b54e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:54.046997 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1f038-7f66-423d-9b2f-cb1e7e8b54e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:54.047278 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1f038-7f66-423d-9b2f-cb1e7e8b54e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:54.047555 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1f038-7f66-423d-9b2f-cb1e7e8b54e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:54.048310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1f038-7f66-423d-9b2f-cb1e7e8b54e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:54.049920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1f038-7f66-423d-9b2f-cb1e7e8b54e2 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:54.060641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1382/2737] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:54.064905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39843bb-bbd5-45ca-83f7-b83edab79002 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:54.075292 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39843bb-bbd5-45ca-83f7-b83edab79002 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:54.079903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149545a-83ea-4237-85c3-71f07370d746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:54.080789 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149545a-83ea-4237-85c3-71f07370d746 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:54.081069 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149545a-83ea-4237-85c3-71f07370d746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:54.081343 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149545a-83ea-4237-85c3-71f07370d746 admin admin] PATH_INFO: `/v3/projects/0ea0a3d3b3454fafb2c2aadcb00f9182/users/b2f5d1db36d74334beaa5f3d6c27f412/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:54.083331 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149545a-83ea-4237-85c3-71f07370d746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea0a3d3b3454fafb2c2aadcb00f9182, user_id=b2f5d1db36d74334beaa5f3d6c27f412, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:54.086097 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6149545a-83ea-4237-85c3-71f07370d746 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:54.097482 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1356/2738] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:54 2022] PUT /identity/v3/projects/0ea0a3d3b3454fafb2c2aadcb00f9182/users/b2f5d1db36d74334beaa5f3d6c27f412/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:54.108198 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0779f7-c661-466d-849e-d5a03e03fba4 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:54.108488 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0779f7-c661-466d-849e-d5a03e03fba4 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:54.108772 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0779f7-c661-466d-849e-d5a03e03fba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:54.139169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-9b0779f7-c661-466d-849e-d5a03e03fba4 None None] MFA Rules not processed for user `b2f5d1db36d74334beaa5f3d6c27f412`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:54.141172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9b0779f7-c661-466d-849e-d5a03e03fba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:54.142158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149545a-83ea-4237-85c3-71f07370d746 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:54.148020 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6149545a-83ea-4237-85c3-71f07370d746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:54.223324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1383/2739] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:54.239792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0779f7-c661-466d-849e-d5a03e03fba4 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:54.241278 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9b0779f7-c661-466d-849e-d5a03e03fba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:54.248099 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149545a-83ea-4237-85c3-71f07370d746 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:54.253397 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586c3a6-ae34-45d4-b78d-de50752a316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:54.254500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586c3a6-ae34-45d4-b78d-de50752a316a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:54.254875 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586c3a6-ae34-45d4-b78d-de50752a316a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:54.255204 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586c3a6-ae34-45d4-b78d-de50752a316a admin admin] PATH_INFO: `/v3/projects/1afa666fd7a0482790a61c20ae565792` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:54.256570 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586c3a6-ae34-45d4-b78d-de50752a316a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1afa666fd7a0482790a61c20ae565792)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:54.258783 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586c3a6-ae34-45d4-b78d-de50752a316a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:54.293431 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:54.299422 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0779f7-c661-466d-849e-d5a03e03fba4 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:54.310547 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c586c3a6-ae34-45d4-b78d-de50752a316a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1afa666fd7a0482790a61c20ae565792', 'request_id': 'req-c586c3a6-ae34-45d4-b78d-de50752a316a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:54.311926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:54.316544 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c586c3a6-ae34-45d4-b78d-de50752a316a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1afa666fd7a0482790a61c20ae565792', 'request_id': 'req-c586c3a6-ae34-45d4-b78d-de50752a316a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:54.322863 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c586c3a6-ae34-45d4-b78d-de50752a316a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1afa666fd7a0482790a61c20ae565792', 'request_id': 'req-c586c3a6-ae34-45d4-b78d-de50752a316a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:54.335776 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c586c3a6-ae34-45d4-b78d-de50752a316a admin admin] The token cache is being invalidate because project 1afa666fd7a0482790a61c20ae565792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:27:54.336091 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c586c3a6-ae34-45d4-b78d-de50752a316a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:54.336692 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c586c3a6-ae34-45d4-b78d-de50752a316a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:27:54.338224 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1357/2740] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:27:54 2022] DELETE /identity/v3/projects/1afa666fd7a0482790a61c20ae565792 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:27:54.343135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd0f62-f59a-49ba-b104-dfb0a86cb4c8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:54.343509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd0f62-f59a-49ba-b104-dfb0a86cb4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:54.343789 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd0f62-f59a-49ba-b104-dfb0a86cb4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:54.351653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117332d9-4e93-4a2a-b21e-bc69c264c165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:54.352303 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117332d9-4e93-4a2a-b21e-bc69c264c165 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:54.352583 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117332d9-4e93-4a2a-b21e-bc69c264c165 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:54.352855 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117332d9-4e93-4a2a-b21e-bc69c264c165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:54.354646 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-117332d9-4e93-4a2a-b21e-bc69c264c165 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:54.361722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-bbcd0f62-f59a-49ba-b104-dfb0a86cb4c8 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:54.362923 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bbcd0f62-f59a-49ba-b104-dfb0a86cb4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:54.416683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117332d9-4e93-4a2a-b21e-bc69c264c165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:54.418221 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117332d9-4e93-4a2a-b21e-bc69c264c165 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:54.428830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1384/2741] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:27:54.432870 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1358/2742] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:27:54.440940 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9181484-880b-4f41-b775-feb235f45d9f None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:54.441303 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9181484-880b-4f41-b775-feb235f45d9f None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:54.441646 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9181484-880b-4f41-b775-feb235f45d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:54.464977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-d9181484-880b-4f41-b775-feb235f45d9f None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:54.466942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-d9181484-880b-4f41-b775-feb235f45d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:54.479845 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1385/2743] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:54.484231 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd0f62-f59a-49ba-b104-dfb0a86cb4c8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:54.494493 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd0f62-f59a-49ba-b104-dfb0a86cb4c8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:54.499769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3a067-3812-4a0b-8bcc-f215e9b57ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:54.500435 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3a067-3812-4a0b-8bcc-f215e9b57ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:54.500842 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3a067-3812-4a0b-8bcc-f215e9b57ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:54.501093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3a067-3812-4a0b-8bcc-f215e9b57ba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:54.501833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3a067-3812-4a0b-8bcc-f215e9b57ba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:27:54.502142 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3a067-3812-4a0b-8bcc-f215e9b57ba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:54.503858 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3a067-3812-4a0b-8bcc-f215e9b57ba7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:54.516733 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1359/2744] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:27:54.521114 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9181484-880b-4f41-b775-feb235f45d9f None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:54.533331 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9181484-880b-4f41-b775-feb235f45d9f None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:54.538618 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c3b89-1b70-44da-8fc6-a1deeb5382b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:54.539288 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c3b89-1b70-44da-8fc6-a1deeb5382b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:54.539571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c3b89-1b70-44da-8fc6-a1deeb5382b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:54.539829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c3b89-1b70-44da-8fc6-a1deeb5382b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:54.540525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c3b89-1b70-44da-8fc6-a1deeb5382b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:54.542491 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c3b89-1b70-44da-8fc6-a1deeb5382b9 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:54.573760 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1386/2745] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:27:54 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:27:54.578101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3a067-3812-4a0b-8bcc-f215e9b57ba7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:54.590237 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3a067-3812-4a0b-8bcc-f215e9b57ba7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:54.656709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ea149-bbbe-4040-a2af-d3bbdd9a38af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:54.657394 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ea149-bbbe-4040-a2af-d3bbdd9a38af admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:54.657688 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ea149-bbbe-4040-a2af-d3bbdd9a38af admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:54.658630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ea149-bbbe-4040-a2af-d3bbdd9a38af admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:54.659351 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ea149-bbbe-4040-a2af-d3bbdd9a38af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:54.661371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ea149-bbbe-4040-a2af-d3bbdd9a38af admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:54.693479 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1360/2746] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:27:54 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:27:54.702689 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c3b89-1b70-44da-8fc6-a1deeb5382b9 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:54.714678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c3b89-1b70-44da-8fc6-a1deeb5382b9 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:54.718999 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a326b-ddc3-4916-8c3c-6e56eeffa94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:54.719743 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a326b-ddc3-4916-8c3c-6e56eeffa94d admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:54.720089 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a326b-ddc3-4916-8c3c-6e56eeffa94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:54.720432 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a326b-ddc3-4916-8c3c-6e56eeffa94d admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:54.721476 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a326b-ddc3-4916-8c3c-6e56eeffa94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:54.726083 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a326b-ddc3-4916-8c3c-6e56eeffa94d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:54.737922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1387/2747] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:54.744533 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ea149-bbbe-4040-a2af-d3bbdd9a38af admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:54.755926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ea149-bbbe-4040-a2af-d3bbdd9a38af admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:54.763532 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93b8eb-203d-4374-9534-47c4e9c0b719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:54.764219 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93b8eb-203d-4374-9534-47c4e9c0b719 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:54.770754 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93b8eb-203d-4374-9534-47c4e9c0b719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:54.771177 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93b8eb-203d-4374-9534-47c4e9c0b719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:54.772246 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93b8eb-203d-4374-9534-47c4e9c0b719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:54.773773 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93b8eb-203d-4374-9534-47c4e9c0b719 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:54.788787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1361/2748] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:27:54.790033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a326b-ddc3-4916-8c3c-6e56eeffa94d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:54.800500 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a326b-ddc3-4916-8c3c-6e56eeffa94d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:54.805239 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274586b-f58a-4204-8b02-b10771302035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:54.806130 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274586b-f58a-4204-8b02-b10771302035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:54.806445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274586b-f58a-4204-8b02-b10771302035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:54.806727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274586b-f58a-4204-8b02-b10771302035 admin admin] PATH_INFO: `/v3/projects/d6cb839a203e4563a32a89f00cd46de2/users/5573b731b15744c699bcb023323ade33/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:54.821659 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274586b-f58a-4204-8b02-b10771302035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cb839a203e4563a32a89f00cd46de2, user_id=5573b731b15744c699bcb023323ade33, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:54.824639 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274586b-f58a-4204-8b02-b10771302035 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:54.837739 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1388/2749] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:27:54 2022] PUT /identity/v3/projects/d6cb839a203e4563a32a89f00cd46de2/users/5573b731b15744c699bcb023323ade33/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:27:54.903983 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc8b79-d468-4bd5-8ede-df139f43b140 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:54.904370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc8b79-d468-4bd5-8ede-df139f43b140 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:54.904669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc8b79-d468-4bd5-8ede-df139f43b140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:54.933254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f9bc8b79-d468-4bd5-8ede-df139f43b140 None None] MFA Rules not processed for user `5573b731b15744c699bcb023323ade33`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:27:54.934556 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f9bc8b79-d468-4bd5-8ede-df139f43b140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:54.943881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:55.005288 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1362/2750] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:27:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:27:55.017539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274586b-f58a-4204-8b02-b10771302035 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:55.019368 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c274586b-f58a-4204-8b02-b10771302035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:55.078938 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274586b-f58a-4204-8b02-b10771302035 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:55.082922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be6b79-81d8-4ab9-85f4-441e245c4c61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:55.083630 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be6b79-81d8-4ab9-85f4-441e245c4c61 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:55.083943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be6b79-81d8-4ab9-85f4-441e245c4c61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:55.084223 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be6b79-81d8-4ab9-85f4-441e245c4c61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:55.096093 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be6b79-81d8-4ab9-85f4-441e245c4c61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:55.097894 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be6b79-81d8-4ab9-85f4-441e245c4c61 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:55.108107 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1389/2751] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:56.004342 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc8b79-d468-4bd5-8ede-df139f43b140 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:56.005804 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f9bc8b79-d468-4bd5-8ede-df139f43b140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:56.018496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc8b79-d468-4bd5-8ede-df139f43b140 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:56.022204 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da926d22-3e3c-4ce7-9ab1-a526b546c67b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:56.022896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da926d22-3e3c-4ce7-9ab1-a526b546c67b service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:56.023150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da926d22-3e3c-4ce7-9ab1-a526b546c67b service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:56.023426 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da926d22-3e3c-4ce7-9ab1-a526b546c67b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:56.025248 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-da926d22-3e3c-4ce7-9ab1-a526b546c67b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:56.107565 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da926d22-3e3c-4ce7-9ab1-a526b546c67b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:56.109048 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da926d22-3e3c-4ce7-9ab1-a526b546c67b service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:56.119961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1363/2752] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:27:56.685312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be6b79-81d8-4ab9-85f4-441e245c4c61 service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:27:56.694835 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be6b79-81d8-4ab9-85f4-441e245c4c61 service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:27:56.698831 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e1138-cf98-4b80-addf-998982611416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:27:56.699595 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e1138-cf98-4b80-addf-998982611416 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:27:56.699970 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e1138-cf98-4b80-addf-998982611416 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:27:56.700318 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e1138-cf98-4b80-addf-998982611416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:27:56.702277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c17e1138-cf98-4b80-addf-998982611416 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:27:56.712748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:56.773453 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e1138-cf98-4b80-addf-998982611416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:27:56.774866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e1138-cf98-4b80-addf-998982611416 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:27:56.784513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1390/2753] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:27:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:00.667016 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da926d22-3e3c-4ce7-9ab1-a526b546c67b service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:00.668593 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-da926d22-3e3c-4ce7-9ab1-a526b546c67b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:00.735425 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da926d22-3e3c-4ce7-9ab1-a526b546c67b service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:00.741207 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0d5d7-1b4b-4ab8-9fb8-d8ed9f0dfcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:00.742111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0d5d7-1b4b-4ab8-9fb8-d8ed9f0dfcbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:00.742411 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0d5d7-1b4b-4ab8-9fb8-d8ed9f0dfcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:00.742721 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0d5d7-1b4b-4ab8-9fb8-d8ed9f0dfcbd admin admin] PATH_INFO: `/v3/users/fcd65b15b6a7453b988764ee249b73fc` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:00.744303 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0d5d7-1b4b-4ab8-9fb8-d8ed9f0dfcbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd65b15b6a7453b988764ee249b73fc)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:00.746244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0d5d7-1b4b-4ab8-9fb8-d8ed9f0dfcbd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:00.794259 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c4e0d5d7-1b4b-4ab8-9fb8-d8ed9f0dfcbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd65b15b6a7453b988764ee249b73fc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:00.797826 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:00.802509 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c4e0d5d7-1b4b-4ab8-9fb8-d8ed9f0dfcbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd65b15b6a7453b988764ee249b73fc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:00.803834 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c4e0d5d7-1b4b-4ab8-9fb8-d8ed9f0dfcbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd65b15b6a7453b988764ee249b73fc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:00.816735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c4e0d5d7-1b4b-4ab8-9fb8-d8ed9f0dfcbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd65b15b6a7453b988764ee249b73fc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:00.823468 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c4e0d5d7-1b4b-4ab8-9fb8-d8ed9f0dfcbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd65b15b6a7453b988764ee249b73fc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:00.829905 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1364/2754] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:28:00 2022] DELETE /identity/v3/users/fcd65b15b6a7453b988764ee249b73fc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:00.834926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec2844-341b-4aa3-b212-f2b09dc99ef6 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:00.835441 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec2844-341b-4aa3-b212-f2b09dc99ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:00.835547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec2844-341b-4aa3-b212-f2b09dc99ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:00.853252 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-ddec2844-341b-4aa3-b212-f2b09dc99ef6 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:00.854376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ddec2844-341b-4aa3-b212-f2b09dc99ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:00.913334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1391/2755] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:00.923188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0d5d7-1b4b-4ab8-9fb8-d8ed9f0dfcbd admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:00.924797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c4e0d5d7-1b4b-4ab8-9fb8-d8ed9f0dfcbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:00.994292 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0d5d7-1b4b-4ab8-9fb8-d8ed9f0dfcbd admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:00.998616 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb631e-3e97-4491-a90f-6599eb576649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:00.999554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb631e-3e97-4491-a90f-6599eb576649 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:00.999837 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb631e-3e97-4491-a90f-6599eb576649 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:01.000110 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb631e-3e97-4491-a90f-6599eb576649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:01.009843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb631e-3e97-4491-a90f-6599eb576649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:01.011306 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb631e-3e97-4491-a90f-6599eb576649 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:01.021139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1365/2756] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:01.610238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec2844-341b-4aa3-b212-f2b09dc99ef6 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:01.611801 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ddec2844-341b-4aa3-b212-f2b09dc99ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:01.624865 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec2844-341b-4aa3-b212-f2b09dc99ef6 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:01.630186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a8d0b-fadd-42d5-a732-05714e00170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:01.632295 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a8d0b-fadd-42d5-a732-05714e00170f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:01.632877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a8d0b-fadd-42d5-a732-05714e00170f admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:01.633384 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a8d0b-fadd-42d5-a732-05714e00170f admin admin] PATH_INFO: `/v3/projects/4bf7aab115d64f92bbc8793a8f89794a` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:01.634881 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a8d0b-fadd-42d5-a732-05714e00170f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf7aab115d64f92bbc8793a8f89794a)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:01.636990 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a8d0b-fadd-42d5-a732-05714e00170f admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:01.693210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-ae9a8d0b-fadd-42d5-a732-05714e00170f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf7aab115d64f92bbc8793a8f89794a', 'request_id': 'req-ae9a8d0b-fadd-42d5-a732-05714e00170f'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:01.700973 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-ae9a8d0b-fadd-42d5-a732-05714e00170f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf7aab115d64f92bbc8793a8f89794a', 'request_id': 'req-ae9a8d0b-fadd-42d5-a732-05714e00170f'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:01.707665 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-ae9a8d0b-fadd-42d5-a732-05714e00170f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf7aab115d64f92bbc8793a8f89794a', 'request_id': 'req-ae9a8d0b-fadd-42d5-a732-05714e00170f'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:01.726133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-ae9a8d0b-fadd-42d5-a732-05714e00170f admin admin] The token cache is being invalidate because project 4bf7aab115d64f92bbc8793a8f89794a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:28:01.726133 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-ae9a8d0b-fadd-42d5-a732-05714e00170f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:01.727005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-ae9a8d0b-fadd-42d5-a732-05714e00170f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:01.728960 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1392/2757] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:28:01 2022] DELETE /identity/v3/projects/4bf7aab115d64f92bbc8793a8f89794a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:01.733027 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb631e-3e97-4491-a90f-6599eb576649 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:01.746876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb631e-3e97-4491-a90f-6599eb576649 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:01.812521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ced25-57fc-4c52-b5dc-7b2ae64f694e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:01.813418 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ced25-57fc-4c52-b5dc-7b2ae64f694e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:01.813704 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ced25-57fc-4c52-b5dc-7b2ae64f694e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:01.813980 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ced25-57fc-4c52-b5dc-7b2ae64f694e admin admin] PATH_INFO: `/v3/users/cb52239b861d4a1cb5249472bcc80468` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:01.815260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ced25-57fc-4c52-b5dc-7b2ae64f694e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb52239b861d4a1cb5249472bcc80468)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:01.817253 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ced25-57fc-4c52-b5dc-7b2ae64f694e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:01.867382 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3a7ced25-57fc-4c52-b5dc-7b2ae64f694e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb52239b861d4a1cb5249472bcc80468'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:01.877169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3a7ced25-57fc-4c52-b5dc-7b2ae64f694e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb52239b861d4a1cb5249472bcc80468'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:01.877859 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3a7ced25-57fc-4c52-b5dc-7b2ae64f694e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb52239b861d4a1cb5249472bcc80468'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:01.890872 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3a7ced25-57fc-4c52-b5dc-7b2ae64f694e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb52239b861d4a1cb5249472bcc80468'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:01.892874 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:01.900092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3a7ced25-57fc-4c52-b5dc-7b2ae64f694e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb52239b861d4a1cb5249472bcc80468'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:01.907098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1366/2758] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:28:01 2022] DELETE /identity/v3/users/cb52239b861d4a1cb5249472bcc80468 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:02.217824 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a8d0b-fadd-42d5-a732-05714e00170f admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:02.219464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ae9a8d0b-fadd-42d5-a732-05714e00170f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:02.234582 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a8d0b-fadd-42d5-a732-05714e00170f admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:02.264531 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:02.302937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:02.304472 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:02.304966 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:02.305451 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5 admin admin] PATH_INFO: `/v3/projects/18f53c28b0214207b062285e5c32f40d` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:02.307546 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f53c28b0214207b062285e5c32f40d)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:02.311559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:02.373774 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f53c28b0214207b062285e5c32f40d', 'request_id': 'req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:02.379396 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f53c28b0214207b062285e5c32f40d', 'request_id': 'req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:02.385744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f53c28b0214207b062285e5c32f40d', 'request_id': 'req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:02.400813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5 admin admin] The token cache is being invalidate because project 18f53c28b0214207b062285e5c32f40d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:28:02.401184 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:02.401921 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:02.403607 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1393/2759] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:28:02 2022] DELETE /identity/v3/projects/18f53c28b0214207b062285e5c32f40d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:28:02.407833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ced25-57fc-4c52-b5dc-7b2ae64f694e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:02.409470 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3a7ced25-57fc-4c52-b5dc-7b2ae64f694e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:02.424096 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ced25-57fc-4c52-b5dc-7b2ae64f694e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:02.485130 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad24b3-0e1b-43dd-ac77-3b56d0a0f1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:02.486013 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad24b3-0e1b-43dd-ac77-3b56d0a0f1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:02.486322 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad24b3-0e1b-43dd-ac77-3b56d0a0f1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:02.486628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad24b3-0e1b-43dd-ac77-3b56d0a0f1b3 admin admin] PATH_INFO: `/v3/users/b2f5d1db36d74334beaa5f3d6c27f412` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:02.487851 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad24b3-0e1b-43dd-ac77-3b56d0a0f1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f5d1db36d74334beaa5f3d6c27f412)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:02.489786 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad24b3-0e1b-43dd-ac77-3b56d0a0f1b3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:02.541669 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-06ad24b3-0e1b-43dd-ac77-3b56d0a0f1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f5d1db36d74334beaa5f3d6c27f412'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:02.548797 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-06ad24b3-0e1b-43dd-ac77-3b56d0a0f1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f5d1db36d74334beaa5f3d6c27f412'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:02.549548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-06ad24b3-0e1b-43dd-ac77-3b56d0a0f1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f5d1db36d74334beaa5f3d6c27f412'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:02.561824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-06ad24b3-0e1b-43dd-ac77-3b56d0a0f1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f5d1db36d74334beaa5f3d6c27f412'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:02.576213 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-06ad24b3-0e1b-43dd-ac77-3b56d0a0f1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f5d1db36d74334beaa5f3d6c27f412'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:02.589006 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1367/2760] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:28:02 2022] DELETE /identity/v3/users/b2f5d1db36d74334beaa5f3d6c27f412 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:02.887010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:02.888692 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:02.905073 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f0984-c1ad-417b-a3ff-3eaa8acf13c5 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:02.972764 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159a82e-b6f4-4235-a71c-8fb1a89d086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:02.973550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159a82e-b6f4-4235-a71c-8fb1a89d086b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:02.973838 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159a82e-b6f4-4235-a71c-8fb1a89d086b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:02.974119 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159a82e-b6f4-4235-a71c-8fb1a89d086b admin admin] PATH_INFO: `/v3/projects/0ea0a3d3b3454fafb2c2aadcb00f9182` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:02.975366 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159a82e-b6f4-4235-a71c-8fb1a89d086b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea0a3d3b3454fafb2c2aadcb00f9182)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:02.977285 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159a82e-b6f4-4235-a71c-8fb1a89d086b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:03.026434 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2159a82e-b6f4-4235-a71c-8fb1a89d086b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea0a3d3b3454fafb2c2aadcb00f9182', 'request_id': 'req-2159a82e-b6f4-4235-a71c-8fb1a89d086b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:03.032579 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2159a82e-b6f4-4235-a71c-8fb1a89d086b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea0a3d3b3454fafb2c2aadcb00f9182', 'request_id': 'req-2159a82e-b6f4-4235-a71c-8fb1a89d086b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:03.034454 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:03.039675 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2159a82e-b6f4-4235-a71c-8fb1a89d086b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea0a3d3b3454fafb2c2aadcb00f9182', 'request_id': 'req-2159a82e-b6f4-4235-a71c-8fb1a89d086b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:03.053968 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2159a82e-b6f4-4235-a71c-8fb1a89d086b admin admin] The token cache is being invalidate because project 0ea0a3d3b3454fafb2c2aadcb00f9182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:28:03.054254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2159a82e-b6f4-4235-a71c-8fb1a89d086b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:03.055028 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2159a82e-b6f4-4235-a71c-8fb1a89d086b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:03.056755 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1394/2761] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:28:02 2022] DELETE /identity/v3/projects/0ea0a3d3b3454fafb2c2aadcb00f9182 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:03.062072 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482ddf0-80a3-4964-970a-baa4b18beb07 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:03.062607 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482ddf0-80a3-4964-970a-baa4b18beb07 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:03.062709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482ddf0-80a3-4964-970a-baa4b18beb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:03.080825 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d482ddf0-80a3-4964-970a-baa4b18beb07 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:03.082048 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d482ddf0-80a3-4964-970a-baa4b18beb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:03.145587 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1368/2762] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:03.155672 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096e642-d8f0-48c1-b593-d30ffc34e9e6 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:03.155955 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096e642-d8f0-48c1-b593-d30ffc34e9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:03.156235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096e642-d8f0-48c1-b593-d30ffc34e9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:03.176158 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-f096e642-d8f0-48c1-b593-d30ffc34e9e6 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:03.177441 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f096e642-d8f0-48c1-b593-d30ffc34e9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:03.187166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1395/2763] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:03.191473 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482ddf0-80a3-4964-970a-baa4b18beb07 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:03.201093 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482ddf0-80a3-4964-970a-baa4b18beb07 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:03.205908 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510e44e-d504-4e50-8a91-8d3e17096c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:03.206589 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510e44e-d504-4e50-8a91-8d3e17096c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:03.206869 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510e44e-d504-4e50-8a91-8d3e17096c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:03.207123 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510e44e-d504-4e50-8a91-8d3e17096c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:03.207868 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510e44e-d504-4e50-8a91-8d3e17096c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:28:03.208169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510e44e-d504-4e50-8a91-8d3e17096c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:03.209838 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510e44e-d504-4e50-8a91-8d3e17096c69 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:03.216517 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:03.222621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1369/2764] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:28:03.227238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096e642-d8f0-48c1-b593-d30ffc34e9e6 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:03.239328 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096e642-d8f0-48c1-b593-d30ffc34e9e6 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:03.246066 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfdac4-e3cd-4772-bce8-7f5f91966725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:03.246853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfdac4-e3cd-4772-bce8-7f5f91966725 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:03.247208 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfdac4-e3cd-4772-bce8-7f5f91966725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:03.247493 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfdac4-e3cd-4772-bce8-7f5f91966725 admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:03.248418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfdac4-e3cd-4772-bce8-7f5f91966725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:03.250740 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfdac4-e3cd-4772-bce8-7f5f91966725 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:03.280392 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1396/2765] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:28:03 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:28:03.284640 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510e44e-d504-4e50-8a91-8d3e17096c69 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:03.294924 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510e44e-d504-4e50-8a91-8d3e17096c69 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:03.354699 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fed755-6cc8-4445-98df-8c7f3cbfe5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:03.355370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fed755-6cc8-4445-98df-8c7f3cbfe5e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:03.355676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fed755-6cc8-4445-98df-8c7f3cbfe5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:03.355958 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fed755-6cc8-4445-98df-8c7f3cbfe5e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:03.356675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fed755-6cc8-4445-98df-8c7f3cbfe5e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:03.358641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fed755-6cc8-4445-98df-8c7f3cbfe5e3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:03.379663 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1370/2766] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:28:03 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:03.384295 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfdac4-e3cd-4772-bce8-7f5f91966725 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:03.394980 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfdac4-e3cd-4772-bce8-7f5f91966725 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:03.400123 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15459fdc-f4db-44cb-b442-f0c934d62f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:03.400794 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15459fdc-f4db-44cb-b442-f0c934d62f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:03.401081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15459fdc-f4db-44cb-b442-f0c934d62f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:03.401362 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15459fdc-f4db-44cb-b442-f0c934d62f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:03.402101 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15459fdc-f4db-44cb-b442-f0c934d62f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:03.403761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15459fdc-f4db-44cb-b442-f0c934d62f6f admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:03.414987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1397/2767] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:03.419076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fed755-6cc8-4445-98df-8c7f3cbfe5e3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:03.429510 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fed755-6cc8-4445-98df-8c7f3cbfe5e3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:03.435983 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f0da5-8e81-4ec8-9b68-af1e0e4c5712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:03.436784 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0da5-8e81-4ec8-9b68-af1e0e4c5712 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:03.437043 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0da5-8e81-4ec8-9b68-af1e0e4c5712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:03.437326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0da5-8e81-4ec8-9b68-af1e0e4c5712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:03.438235 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f0da5-8e81-4ec8-9b68-af1e0e4c5712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:03.439782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f0da5-8e81-4ec8-9b68-af1e0e4c5712 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:03.450679 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1371/2768] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:03.454937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15459fdc-f4db-44cb-b442-f0c934d62f6f admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:03.465024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15459fdc-f4db-44cb-b442-f0c934d62f6f admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:03.470417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b950caf-fda5-46c9-8f3a-c1982408b199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:03.471317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b950caf-fda5-46c9-8f3a-c1982408b199 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:03.471611 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b950caf-fda5-46c9-8f3a-c1982408b199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:03.471878 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b950caf-fda5-46c9-8f3a-c1982408b199 admin admin] PATH_INFO: `/v3/projects/18d4af6db39946e7850746bf8edca3f3/users/42ad97b236f9465e82c57ceede53f0d3/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:03.490486 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b950caf-fda5-46c9-8f3a-c1982408b199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d4af6db39946e7850746bf8edca3f3, user_id=42ad97b236f9465e82c57ceede53f0d3, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:03.493326 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b950caf-fda5-46c9-8f3a-c1982408b199 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:03.507551 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1398/2769] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:03 2022] PUT /identity/v3/projects/18d4af6db39946e7850746bf8edca3f3/users/42ad97b236f9465e82c57ceede53f0d3/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:03.512754 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d03287-bd14-4153-81b4-07707e042f04 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:03.513397 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d03287-bd14-4153-81b4-07707e042f04 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:03.513397 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d03287-bd14-4153-81b4-07707e042f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:03.534523 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-90d03287-bd14-4153-81b4-07707e042f04 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:03.535769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-90d03287-bd14-4153-81b4-07707e042f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:03.602075 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1372/2770] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:03.612046 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b950caf-fda5-46c9-8f3a-c1982408b199 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:03.614326 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2b950caf-fda5-46c9-8f3a-c1982408b199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:03.675254 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b950caf-fda5-46c9-8f3a-c1982408b199 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:03.679371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dbd1b-f7df-4fb5-b8c3-b7acc5ab7950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:03.680034 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dbd1b-f7df-4fb5-b8c3-b7acc5ab7950 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:03.680347 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dbd1b-f7df-4fb5-b8c3-b7acc5ab7950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:03.680628 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dbd1b-f7df-4fb5-b8c3-b7acc5ab7950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:03.690270 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dbd1b-f7df-4fb5-b8c3-b7acc5ab7950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:03.691748 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dbd1b-f7df-4fb5-b8c3-b7acc5ab7950 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:03.701836 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1399/2771] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:04.349140 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1282f4f-c2dc-47f6-a6ce-9fe659d7884e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:04.349671 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1282f4f-c2dc-47f6-a6ce-9fe659d7884e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:04.349784 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1282f4f-c2dc-47f6-a6ce-9fe659d7884e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:04.377614 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d1282f4f-c2dc-47f6-a6ce-9fe659d7884e None None] MFA Rules not processed for user `42ad97b236f9465e82c57ceede53f0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:04.378870 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d1282f4f-c2dc-47f6-a6ce-9fe659d7884e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:04.445910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1373/2772] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:04.457350 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dbd1b-f7df-4fb5-b8c3-b7acc5ab7950 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:04.458897 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f01dbd1b-f7df-4fb5-b8c3-b7acc5ab7950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:04.539761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dbd1b-f7df-4fb5-b8c3-b7acc5ab7950 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:04.543381 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987deb6-05cd-4910-bbec-341262d282c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:04.544050 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987deb6-05cd-4910-bbec-341262d282c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:04.544335 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987deb6-05cd-4910-bbec-341262d282c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:04.544612 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987deb6-05cd-4910-bbec-341262d282c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:04.553513 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987deb6-05cd-4910-bbec-341262d282c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:04.555002 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987deb6-05cd-4910-bbec-341262d282c4 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:04.563749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1400/2773] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:05.918001 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757b51f-82af-456c-b36d-e6ed03d4999b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:05.918597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757b51f-82af-456c-b36d-e6ed03d4999b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:05.918597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757b51f-82af-456c-b36d-e6ed03d4999b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:05.931369 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:05.939095 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c757b51f-82af-456c-b36d-e6ed03d4999b None None] MFA Rules not processed for user `42ad97b236f9465e82c57ceede53f0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:05.941353 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c757b51f-82af-456c-b36d-e6ed03d4999b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:05.950207 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1374/2774] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:05.988418 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987deb6-05cd-4910-bbec-341262d282c4 service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:05.989978 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-3987deb6-05cd-4910-bbec-341262d282c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:06.029172 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:06.054662 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987deb6-05cd-4910-bbec-341262d282c4 service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:06.058530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100ea91-55c5-44e8-af1f-d0cfe6f96bcf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '927543219de847b88b97fbe4f343d2be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:06.059209 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100ea91-55c5-44e8-af1f-d0cfe6f96bcf service glance] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:06.059786 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100ea91-55c5-44e8-af1f-d0cfe6f96bcf service glance] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:06.059786 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100ea91-55c5-44e8-af1f-d0cfe6f96bcf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:06.061957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f100ea91-55c5-44e8-af1f-d0cfe6f96bcf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:06.134911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100ea91-55c5-44e8-af1f-d0cfe6f96bcf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:06.136282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100ea91-55c5-44e8-af1f-d0cfe6f96bcf service glance] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:06.150942 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1401/2775] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:06.711824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757b51f-82af-456c-b36d-e6ed03d4999b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:06.713371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c757b51f-82af-456c-b36d-e6ed03d4999b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:06.725550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757b51f-82af-456c-b36d-e6ed03d4999b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:06.729207 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee0541-7ff6-43ca-b15b-baaa8cc50269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:06.729824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee0541-7ff6-43ca-b15b-baaa8cc50269 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:06.730160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee0541-7ff6-43ca-b15b-baaa8cc50269 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:06.730481 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee0541-7ff6-43ca-b15b-baaa8cc50269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:06.732588 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-72ee0541-7ff6-43ca-b15b-baaa8cc50269 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:06.746964 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee0541-7ff6-43ca-b15b-baaa8cc50269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:06.748406 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee0541-7ff6-43ca-b15b-baaa8cc50269 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:06.760160 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1375/2776] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:09.812530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100ea91-55c5-44e8-af1f-d0cfe6f96bcf service glance] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:09.814150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f100ea91-55c5-44e8-af1f-d0cfe6f96bcf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:09.828417 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100ea91-55c5-44e8-af1f-d0cfe6f96bcf service glance] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:09.833747 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbf867-060e-44cf-b204-b8fa776b1c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:09.834701 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbf867-060e-44cf-b204-b8fa776b1c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:09.834982 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbf867-060e-44cf-b204-b8fa776b1c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:09.835253 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbf867-060e-44cf-b204-b8fa776b1c5c admin admin] PATH_INFO: `/v3/users/5573b731b15744c699bcb023323ade33` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:09.836550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbf867-060e-44cf-b204-b8fa776b1c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5573b731b15744c699bcb023323ade33)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:09.838514 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbf867-060e-44cf-b204-b8fa776b1c5c admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:09.886792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-a3cbf867-060e-44cf-b204-b8fa776b1c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5573b731b15744c699bcb023323ade33'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:09.895951 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-a3cbf867-060e-44cf-b204-b8fa776b1c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5573b731b15744c699bcb023323ade33'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:09.896584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-a3cbf867-060e-44cf-b204-b8fa776b1c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5573b731b15744c699bcb023323ade33'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:09.908495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-a3cbf867-060e-44cf-b204-b8fa776b1c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5573b731b15744c699bcb023323ade33'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:09.915159 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-a3cbf867-060e-44cf-b204-b8fa776b1c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5573b731b15744c699bcb023323ade33'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:09.921336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1402/2777] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:28:09 2022] DELETE /identity/v3/users/5573b731b15744c699bcb023323ade33 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:09.926088 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66373529-a92e-4b4c-bde1-3f05b9f2071f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:09.926616 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66373529-a92e-4b4c-bde1-3f05b9f2071f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:09.926717 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66373529-a92e-4b4c-bde1-3f05b9f2071f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:09.945493 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-66373529-a92e-4b4c-bde1-3f05b9f2071f None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:09.946698 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-66373529-a92e-4b4c-bde1-3f05b9f2071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:10.011719 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1376/2778] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:10.021609 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbf867-060e-44cf-b204-b8fa776b1c5c admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:10.023222 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-a3cbf867-060e-44cf-b204-b8fa776b1c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:10.070054 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:10.081746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbf867-060e-44cf-b204-b8fa776b1c5c admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:10.086413 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc139e-b844-4c24-ae24-b281e81f354c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:10.087104 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc139e-b844-4c24-ae24-b281e81f354c service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:10.087388 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc139e-b844-4c24-ae24-b281e81f354c service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:10.087664 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc139e-b844-4c24-ae24-b281e81f354c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:10.097366 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc139e-b844-4c24-ae24-b281e81f354c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:10.098860 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc139e-b844-4c24-ae24-b281e81f354c service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:10.109346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1403/2779] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:10.478405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66373529-a92e-4b4c-bde1-3f05b9f2071f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:10.480042 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-66373529-a92e-4b4c-bde1-3f05b9f2071f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:10.496525 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66373529-a92e-4b4c-bde1-3f05b9f2071f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:10.502823 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f406993-86bd-4f47-8854-05574826616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:10.503735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f406993-86bd-4f47-8854-05574826616e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:10.503976 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f406993-86bd-4f47-8854-05574826616e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:10.504301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f406993-86bd-4f47-8854-05574826616e admin admin] PATH_INFO: `/v3/projects/d6cb839a203e4563a32a89f00cd46de2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:10.505524 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f406993-86bd-4f47-8854-05574826616e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6cb839a203e4563a32a89f00cd46de2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:10.507511 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f406993-86bd-4f47-8854-05574826616e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:10.555830 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1f406993-86bd-4f47-8854-05574826616e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6cb839a203e4563a32a89f00cd46de2', 'request_id': 'req-1f406993-86bd-4f47-8854-05574826616e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:10.561837 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1f406993-86bd-4f47-8854-05574826616e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6cb839a203e4563a32a89f00cd46de2', 'request_id': 'req-1f406993-86bd-4f47-8854-05574826616e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:10.568460 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1f406993-86bd-4f47-8854-05574826616e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6cb839a203e4563a32a89f00cd46de2', 'request_id': 'req-1f406993-86bd-4f47-8854-05574826616e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:10.582046 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1f406993-86bd-4f47-8854-05574826616e admin admin] The token cache is being invalidate because project d6cb839a203e4563a32a89f00cd46de2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:28:10.582335 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1f406993-86bd-4f47-8854-05574826616e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:10.583079 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1f406993-86bd-4f47-8854-05574826616e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:10.584841 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1377/2780] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:28:10 2022] DELETE /identity/v3/projects/d6cb839a203e4563a32a89f00cd46de2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:28:10.589996 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a252954-b4d8-4e6e-8104-fa79fa89d2f5 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:10.590282 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a252954-b4d8-4e6e-8104-fa79fa89d2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:10.590591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a252954-b4d8-4e6e-8104-fa79fa89d2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:10.609178 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-8a252954-b4d8-4e6e-8104-fa79fa89d2f5 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:10.610398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8a252954-b4d8-4e6e-8104-fa79fa89d2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:10.670985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1404/2781] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:10.679169 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f318ae-af1c-4281-962c-fd8c5384acab None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:10.679648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f318ae-af1c-4281-962c-fd8c5384acab None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:10.680092 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f318ae-af1c-4281-962c-fd8c5384acab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:10.703270 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-46f318ae-af1c-4281-962c-fd8c5384acab None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:10.704466 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-46f318ae-af1c-4281-962c-fd8c5384acab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:10.712715 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1378/2782] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:10.717071 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a252954-b4d8-4e6e-8104-fa79fa89d2f5 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:10.727444 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a252954-b4d8-4e6e-8104-fa79fa89d2f5 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:10.733420 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabce64-2358-4f17-be9d-f02b640c34ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:10.734080 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabce64-2358-4f17-be9d-f02b640c34ab admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:10.734363 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabce64-2358-4f17-be9d-f02b640c34ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:10.734675 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabce64-2358-4f17-be9d-f02b640c34ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:10.735406 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabce64-2358-4f17-be9d-f02b640c34ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:28:10.735709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabce64-2358-4f17-be9d-f02b640c34ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:10.737317 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabce64-2358-4f17-be9d-f02b640c34ab admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:10.749938 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1405/2783] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:28:10.754490 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f318ae-af1c-4281-962c-fd8c5384acab None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:10.767521 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f318ae-af1c-4281-962c-fd8c5384acab None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:10.772659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6a98-160c-43c4-b59d-ead68c1293c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:10.773312 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6a98-160c-43c4-b59d-ead68c1293c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:10.773594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6a98-160c-43c4-b59d-ead68c1293c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:10.773866 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6a98-160c-43c4-b59d-ead68c1293c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:10.774595 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac6a98-160c-43c4-b59d-ead68c1293c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:10.776504 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac6a98-160c-43c4-b59d-ead68c1293c6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:10.804815 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1379/2784] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:28:10 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:10.809213 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabce64-2358-4f17-be9d-f02b640c34ab admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:10.819777 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabce64-2358-4f17-be9d-f02b640c34ab admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:10.879957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496fea1-6465-47fb-8269-73463d85298b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:10.880620 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496fea1-6465-47fb-8269-73463d85298b admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:10.880901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496fea1-6465-47fb-8269-73463d85298b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:10.881179 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496fea1-6465-47fb-8269-73463d85298b admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:10.881898 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496fea1-6465-47fb-8269-73463d85298b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:10.883844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496fea1-6465-47fb-8269-73463d85298b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:10.905241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1406/2785] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:28:10 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:10.907896 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6a98-160c-43c4-b59d-ead68c1293c6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:10.919050 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6a98-160c-43c4-b59d-ead68c1293c6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:10.924882 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5cf3f-6518-4712-a3fc-dfd7b1a9667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:10.925624 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5cf3f-6518-4712-a3fc-dfd7b1a9667c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:10.925928 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5cf3f-6518-4712-a3fc-dfd7b1a9667c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:10.926205 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5cf3f-6518-4712-a3fc-dfd7b1a9667c admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:10.926988 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5cf3f-6518-4712-a3fc-dfd7b1a9667c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:10.928607 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5cf3f-6518-4712-a3fc-dfd7b1a9667c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:10.940230 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1380/2786] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:10.944647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496fea1-6465-47fb-8269-73463d85298b admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:10.955377 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496fea1-6465-47fb-8269-73463d85298b admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:10.961303 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a250af-e4ff-42d6-a09d-4c3e15568637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:10.962262 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a250af-e4ff-42d6-a09d-4c3e15568637 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:10.962673 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a250af-e4ff-42d6-a09d-4c3e15568637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:10.962949 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a250af-e4ff-42d6-a09d-4c3e15568637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:10.963682 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a250af-e4ff-42d6-a09d-4c3e15568637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:10.965283 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a250af-e4ff-42d6-a09d-4c3e15568637 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:10.975958 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1407/2787] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:10.980395 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5cf3f-6518-4712-a3fc-dfd7b1a9667c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:10.991631 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5cf3f-6518-4712-a3fc-dfd7b1a9667c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:10.998843 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b430da-3809-4338-bdc9-2fdb6a769429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:11.000191 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b430da-3809-4338-bdc9-2fdb6a769429 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:11.000487 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b430da-3809-4338-bdc9-2fdb6a769429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:11.000867 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b430da-3809-4338-bdc9-2fdb6a769429 admin admin] PATH_INFO: `/v3/projects/66bf7592c0a14502933108ca27cd3937/users/3c961c8ab4c74a48a1208521b56997a6/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:11.017481 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b430da-3809-4338-bdc9-2fdb6a769429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66bf7592c0a14502933108ca27cd3937, user_id=3c961c8ab4c74a48a1208521b56997a6, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:11.020210 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b430da-3809-4338-bdc9-2fdb6a769429 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:11.034961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1381/2788] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:10 2022] PUT /identity/v3/projects/66bf7592c0a14502933108ca27cd3937/users/3c961c8ab4c74a48a1208521b56997a6/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:11.046747 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38eed4-795c-488c-b8f9-921e658fc411 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:11.047038 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38eed4-795c-488c-b8f9-921e658fc411 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:11.047315 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38eed4-795c-488c-b8f9-921e658fc411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:11.074157 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-2f38eed4-795c-488c-b8f9-921e658fc411 None None] MFA Rules not processed for user `3c961c8ab4c74a48a1208521b56997a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:11.075400 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2f38eed4-795c-488c-b8f9-921e658fc411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:11.119349 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:11.145067 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1408/2789] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:11.156440 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b430da-3809-4338-bdc9-2fdb6a769429 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:11.158234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e8b430da-3809-4338-bdc9-2fdb6a769429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:11.168794 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:11.216545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b430da-3809-4338-bdc9-2fdb6a769429 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:11.220656 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb918080-3435-4020-bfdb-ac24e5b4c1d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:11.221550 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918080-3435-4020-bfdb-ac24e5b4c1d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:11.221833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918080-3435-4020-bfdb-ac24e5b4c1d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:11.222150 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb918080-3435-4020-bfdb-ac24e5b4c1d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:11.230745 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb918080-3435-4020-bfdb-ac24e5b4c1d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:11.232127 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb918080-3435-4020-bfdb-ac24e5b4c1d0 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:11.241040 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1382/2790] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:13.795672 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38eed4-795c-488c-b8f9-921e658fc411 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:13.864101 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38eed4-795c-488c-b8f9-921e658fc411 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:13.869431 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f173a78-f649-439a-8244-2af51ce5eb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:13.870445 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f173a78-f649-439a-8244-2af51ce5eb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:13.873049 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f173a78-f649-439a-8244-2af51ce5eb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:13.873649 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f173a78-f649-439a-8244-2af51ce5eb5f admin admin] PATH_INFO: `/v3/users/3c961c8ab4c74a48a1208521b56997a6` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:13.875141 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f173a78-f649-439a-8244-2af51ce5eb5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c961c8ab4c74a48a1208521b56997a6)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:13.877183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f173a78-f649-439a-8244-2af51ce5eb5f admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:13.926639 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1f173a78-f649-439a-8244-2af51ce5eb5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c961c8ab4c74a48a1208521b56997a6'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:13.949840 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1f173a78-f649-439a-8244-2af51ce5eb5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c961c8ab4c74a48a1208521b56997a6'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:13.949840 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1f173a78-f649-439a-8244-2af51ce5eb5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c961c8ab4c74a48a1208521b56997a6'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:13.958602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1f173a78-f649-439a-8244-2af51ce5eb5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c961c8ab4c74a48a1208521b56997a6'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:13.966044 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-1f173a78-f649-439a-8244-2af51ce5eb5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c961c8ab4c74a48a1208521b56997a6'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:13.972127 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1409/2791] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:28:13 2022] DELETE /identity/v3/users/3c961c8ab4c74a48a1208521b56997a6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:13.976911 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f2281-b5dc-4598-b418-1f35badf4ffe None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:13.977385 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f2281-b5dc-4598-b418-1f35badf4ffe None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:13.977516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f2281-b5dc-4598-b418-1f35badf4ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:13.995667 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5c2f2281-b5dc-4598-b418-1f35badf4ffe None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:13.996889 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5c2f2281-b5dc-4598-b418-1f35badf4ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:14.061194 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1383/2792] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:14.068193 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f173a78-f649-439a-8244-2af51ce5eb5f admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:14.069866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-1f173a78-f649-439a-8244-2af51ce5eb5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:14.151343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f173a78-f649-439a-8244-2af51ce5eb5f admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:14.159481 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c3a40-492e-4f3f-b816-f4b75f4685b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:14.163496 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c3a40-492e-4f3f-b816-f4b75f4685b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:14.164056 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c3a40-492e-4f3f-b816-f4b75f4685b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:14.164528 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c3a40-492e-4f3f-b816-f4b75f4685b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:14.180170 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c3a40-492e-4f3f-b816-f4b75f4685b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:14.182940 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c3a40-492e-4f3f-b816-f4b75f4685b3 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:14.199306 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1410/2793] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:14.482916 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f2281-b5dc-4598-b418-1f35badf4ffe None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:14.484548 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5c2f2281-b5dc-4598-b418-1f35badf4ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:14.498699 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f2281-b5dc-4598-b418-1f35badf4ffe None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:14.504114 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa26e0-4e58-494f-805c-988956dc369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:14.505051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa26e0-4e58-494f-805c-988956dc369f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:14.505522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa26e0-4e58-494f-805c-988956dc369f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:14.505864 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa26e0-4e58-494f-805c-988956dc369f admin admin] PATH_INFO: `/v3/projects/66bf7592c0a14502933108ca27cd3937` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:14.507620 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa26e0-4e58-494f-805c-988956dc369f admin admin] RBAC: Authorizing `identity:delete_project(project_id=66bf7592c0a14502933108ca27cd3937)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:14.509974 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa26e0-4e58-494f-805c-988956dc369f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:14.557422 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4baa26e0-4e58-494f-805c-988956dc369f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66bf7592c0a14502933108ca27cd3937', 'request_id': 'req-4baa26e0-4e58-494f-805c-988956dc369f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:14.562767 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4baa26e0-4e58-494f-805c-988956dc369f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66bf7592c0a14502933108ca27cd3937', 'request_id': 'req-4baa26e0-4e58-494f-805c-988956dc369f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:14.568962 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4baa26e0-4e58-494f-805c-988956dc369f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66bf7592c0a14502933108ca27cd3937', 'request_id': 'req-4baa26e0-4e58-494f-805c-988956dc369f'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:14.582139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4baa26e0-4e58-494f-805c-988956dc369f admin admin] The token cache is being invalidate because project 66bf7592c0a14502933108ca27cd3937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:28:14.582461 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4baa26e0-4e58-494f-805c-988956dc369f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:14.583078 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4baa26e0-4e58-494f-805c-988956dc369f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:14.584747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1384/2794] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:28:14 2022] DELETE /identity/v3/projects/66bf7592c0a14502933108ca27cd3937 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:15.379287 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c3a40-492e-4f3f-b816-f4b75f4685b3 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:15.380981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8b1c3a40-492e-4f3f-b816-f4b75f4685b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:15.390937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:15.395718 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c3a40-492e-4f3f-b816-f4b75f4685b3 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:15.455902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87082d3c-b3a9-4d47-b444-555089f72526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:15.456775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87082d3c-b3a9-4d47-b444-555089f72526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:15.457065 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87082d3c-b3a9-4d47-b444-555089f72526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:15.457336 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87082d3c-b3a9-4d47-b444-555089f72526 admin admin] PATH_INFO: `/v3/users/e9d70299068f42269eacabcba08cdd3b` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:15.458617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87082d3c-b3a9-4d47-b444-555089f72526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9d70299068f42269eacabcba08cdd3b)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:15.460602 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87082d3c-b3a9-4d47-b444-555089f72526 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:15.509088 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-87082d3c-b3a9-4d47-b444-555089f72526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9d70299068f42269eacabcba08cdd3b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:15.517805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-87082d3c-b3a9-4d47-b444-555089f72526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9d70299068f42269eacabcba08cdd3b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:15.518487 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-87082d3c-b3a9-4d47-b444-555089f72526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9d70299068f42269eacabcba08cdd3b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:15.530822 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-87082d3c-b3a9-4d47-b444-555089f72526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9d70299068f42269eacabcba08cdd3b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:15.538102 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-87082d3c-b3a9-4d47-b444-555089f72526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9d70299068f42269eacabcba08cdd3b'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:15.544561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1411/2795] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:28:15 2022] DELETE /identity/v3/users/e9d70299068f42269eacabcba08cdd3b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:15.549324 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95ce96-fb6e-4df8-b66a-61ffab262c36 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:15.549810 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95ce96-fb6e-4df8-b66a-61ffab262c36 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:15.549894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95ce96-fb6e-4df8-b66a-61ffab262c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:15.569724 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-dc95ce96-fb6e-4df8-b66a-61ffab262c36 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:15.571073 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dc95ce96-fb6e-4df8-b66a-61ffab262c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:15.601244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:15.638135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1385/2796] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:15.648674 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87082d3c-b3a9-4d47-b444-555089f72526 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:15.650326 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-87082d3c-b3a9-4d47-b444-555089f72526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:15.713099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87082d3c-b3a9-4d47-b444-555089f72526 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:15.717140 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6e304-b542-4d81-912b-50ac194ab8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:15.717899 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6e304-b542-4d81-912b-50ac194ab8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:15.718183 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6e304-b542-4d81-912b-50ac194ab8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:15.718516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6e304-b542-4d81-912b-50ac194ab8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:15.728273 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6e304-b542-4d81-912b-50ac194ab8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:15.729709 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6e304-b542-4d81-912b-50ac194ab8e5 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:15.740042 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1412/2797] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:16.026051 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95ce96-fb6e-4df8-b66a-61ffab262c36 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:16.028142 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dc95ce96-fb6e-4df8-b66a-61ffab262c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:16.043154 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95ce96-fb6e-4df8-b66a-61ffab262c36 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:16.048668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a5c41-31d9-4818-93b9-66d2bba430ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:16.049670 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a5c41-31d9-4818-93b9-66d2bba430ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:16.050099 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a5c41-31d9-4818-93b9-66d2bba430ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:16.050524 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a5c41-31d9-4818-93b9-66d2bba430ec admin admin] PATH_INFO: `/v3/projects/5c84909e3ba44b829266a1789d7e8e57` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:16.051935 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a5c41-31d9-4818-93b9-66d2bba430ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c84909e3ba44b829266a1789d7e8e57)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:16.055085 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a5c41-31d9-4818-93b9-66d2bba430ec admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:16.104420 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-481a5c41-31d9-4818-93b9-66d2bba430ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c84909e3ba44b829266a1789d7e8e57', 'request_id': 'req-481a5c41-31d9-4818-93b9-66d2bba430ec'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:16.110467 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-481a5c41-31d9-4818-93b9-66d2bba430ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c84909e3ba44b829266a1789d7e8e57', 'request_id': 'req-481a5c41-31d9-4818-93b9-66d2bba430ec'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:16.116787 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-481a5c41-31d9-4818-93b9-66d2bba430ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c84909e3ba44b829266a1789d7e8e57', 'request_id': 'req-481a5c41-31d9-4818-93b9-66d2bba430ec'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:16.134221 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-481a5c41-31d9-4818-93b9-66d2bba430ec admin admin] The token cache is being invalidate because project 5c84909e3ba44b829266a1789d7e8e57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:28:16.134668 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-481a5c41-31d9-4818-93b9-66d2bba430ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:16.135486 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-481a5c41-31d9-4818-93b9-66d2bba430ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:16.137654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1386/2798] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:28:16 2022] DELETE /identity/v3/projects/5c84909e3ba44b829266a1789d7e8e57 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:16.143580 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ffbea-df6d-4159-8dd7-f60b80bb0e22 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:16.143805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ffbea-df6d-4159-8dd7-f60b80bb0e22 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:16.144080 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ffbea-df6d-4159-8dd7-f60b80bb0e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:16.164668 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-c62ffbea-df6d-4159-8dd7-f60b80bb0e22 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:16.166353 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c62ffbea-df6d-4159-8dd7-f60b80bb0e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:16.188428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:16.231530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1413/2799] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:16.240250 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771de5c6-dcec-4c85-97b0-31ed671903ac None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:16.240967 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771de5c6-dcec-4c85-97b0-31ed671903ac None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:16.242168 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771de5c6-dcec-4c85-97b0-31ed671903ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:16.261569 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-771de5c6-dcec-4c85-97b0-31ed671903ac None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:16.262971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-771de5c6-dcec-4c85-97b0-31ed671903ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:16.271183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1387/2800] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:16.275532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ffbea-df6d-4159-8dd7-f60b80bb0e22 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:16.285438 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ffbea-df6d-4159-8dd7-f60b80bb0e22 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:16.291678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e64e3f-02cf-4563-ae47-3121595544be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:16.292373 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e64e3f-02cf-4563-ae47-3121595544be admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:16.292656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e64e3f-02cf-4563-ae47-3121595544be admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:16.292935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e64e3f-02cf-4563-ae47-3121595544be admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:16.293681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e64e3f-02cf-4563-ae47-3121595544be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:28:16.293985 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e64e3f-02cf-4563-ae47-3121595544be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:16.295625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e64e3f-02cf-4563-ae47-3121595544be admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:16.307378 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1414/2801] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 14:28:16.313594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771de5c6-dcec-4c85-97b0-31ed671903ac None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:16.323115 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771de5c6-dcec-4c85-97b0-31ed671903ac None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:16.327899 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d721561-61a6-4468-bcf3-5b7c7e6eb96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:16.328555 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d721561-61a6-4468-bcf3-5b7c7e6eb96e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:16.328840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d721561-61a6-4468-bcf3-5b7c7e6eb96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:16.329118 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d721561-61a6-4468-bcf3-5b7c7e6eb96e admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:16.329825 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d721561-61a6-4468-bcf3-5b7c7e6eb96e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:16.331782 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d721561-61a6-4468-bcf3-5b7c7e6eb96e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:16.359658 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1388/2802] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:28:16 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:16.364168 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e64e3f-02cf-4563-ae47-3121595544be admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:16.374857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e64e3f-02cf-4563-ae47-3121595544be admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:16.434457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b49430-ab96-4886-9cc0-6127c4ee2545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:16.435140 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b49430-ab96-4886-9cc0-6127c4ee2545 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:16.435140 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b49430-ab96-4886-9cc0-6127c4ee2545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:16.435140 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b49430-ab96-4886-9cc0-6127c4ee2545 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:16.435856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b49430-ab96-4886-9cc0-6127c4ee2545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:16.437791 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b49430-ab96-4886-9cc0-6127c4ee2545 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:16.459656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1415/2803] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:28:16 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:28:16.463936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d721561-61a6-4468-bcf3-5b7c7e6eb96e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:16.474463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d721561-61a6-4468-bcf3-5b7c7e6eb96e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:16.479443 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d7e8e-a3bb-4035-8abd-48f1758021b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:16.480103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7e8e-a3bb-4035-8abd-48f1758021b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:16.480389 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7e8e-a3bb-4035-8abd-48f1758021b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:16.480701 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7e8e-a3bb-4035-8abd-48f1758021b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:16.481408 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d7e8e-a3bb-4035-8abd-48f1758021b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:16.483094 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d7e8e-a3bb-4035-8abd-48f1758021b1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:16.494296 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1389/2804] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:16.498576 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b49430-ab96-4886-9cc0-6127c4ee2545 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:16.509139 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b49430-ab96-4886-9cc0-6127c4ee2545 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:16.515006 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c9219-a773-45b9-8dee-29989681df00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:16.515676 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c9219-a773-45b9-8dee-29989681df00 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:16.516001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c9219-a773-45b9-8dee-29989681df00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:16.516271 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c9219-a773-45b9-8dee-29989681df00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:16.517028 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c9219-a773-45b9-8dee-29989681df00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:16.518719 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c9219-a773-45b9-8dee-29989681df00 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:16.529474 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1416/2805] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:16.533860 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d7e8e-a3bb-4035-8abd-48f1758021b1 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:16.544354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d7e8e-a3bb-4035-8abd-48f1758021b1 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:16.549525 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be44f-4927-493d-adb3-ac9b0a203cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:16.550446 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be44f-4927-493d-adb3-ac9b0a203cda admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:16.550738 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be44f-4927-493d-adb3-ac9b0a203cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:16.551018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7be44f-4927-493d-adb3-ac9b0a203cda admin admin] PATH_INFO: `/v3/projects/8c7d87a10ff14f1dbe0d8ec54aea16f1/users/79e215a779ed4cc784b31fa5da339442/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:16.566718 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7be44f-4927-493d-adb3-ac9b0a203cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7d87a10ff14f1dbe0d8ec54aea16f1, user_id=79e215a779ed4cc784b31fa5da339442, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:16.569401 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7be44f-4927-493d-adb3-ac9b0a203cda admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:16.584084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1390/2806] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:16 2022] PUT /identity/v3/projects/8c7d87a10ff14f1dbe0d8ec54aea16f1/users/79e215a779ed4cc784b31fa5da339442/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:16.594613 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07c44e-a39b-4df8-b9ac-26b536a8bdba None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:16.594911 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07c44e-a39b-4df8-b9ac-26b536a8bdba None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:16.595196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07c44e-a39b-4df8-b9ac-26b536a8bdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:16.623958 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-8c07c44e-a39b-4df8-b9ac-26b536a8bdba None None] MFA Rules not processed for user `79e215a779ed4cc784b31fa5da339442`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:16.625210 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-8c07c44e-a39b-4df8-b9ac-26b536a8bdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:16.697812 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1417/2807] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:16.702545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be44f-4927-493d-adb3-ac9b0a203cda admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:16.755013 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:16.765978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7be44f-4927-493d-adb3-ac9b0a203cda admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:16.772973 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb3536-82b5-45d6-b91e-a0e0f8465e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:16.773674 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3536-82b5-45d6-b91e-a0e0f8465e28 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:16.773960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3536-82b5-45d6-b91e-a0e0f8465e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:16.774234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3536-82b5-45d6-b91e-a0e0f8465e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:16.774971 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb3536-82b5-45d6-b91e-a0e0f8465e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:16.776895 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb3536-82b5-45d6-b91e-a0e0f8465e28 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:16.805376 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1391/2808] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:28:16 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:16.810007 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07c44e-a39b-4df8-b9ac-26b536a8bdba None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:16.825125 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07c44e-a39b-4df8-b9ac-26b536a8bdba None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:16.849261 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:16.895062 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a22109-6be7-48a0-af82-586f76261f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:16.895746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a22109-6be7-48a0-af82-586f76261f30 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:16.896052 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a22109-6be7-48a0-af82-586f76261f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:16.896310 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a22109-6be7-48a0-af82-586f76261f30 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:16.897040 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a22109-6be7-48a0-af82-586f76261f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:16.899015 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a22109-6be7-48a0-af82-586f76261f30 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:16.924806 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1418/2809] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:28:16 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:16.926301 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb3536-82b5-45d6-b91e-a0e0f8465e28 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:16.938129 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb3536-82b5-45d6-b91e-a0e0f8465e28 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:16.943428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b5348-0807-4aa4-b830-d984772645ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:16.944137 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b5348-0807-4aa4-b830-d984772645ed admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:16.944421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b5348-0807-4aa4-b830-d984772645ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:16.944695 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b5348-0807-4aa4-b830-d984772645ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:16.945432 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b5348-0807-4aa4-b830-d984772645ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:16.947073 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b5348-0807-4aa4-b830-d984772645ed admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:16.958985 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1392/2810] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:16.964273 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a22109-6be7-48a0-af82-586f76261f30 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:16.975596 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a22109-6be7-48a0-af82-586f76261f30 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:16.980564 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b465e0c-c594-4068-b67e-0065183d3472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:16.981234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b465e0c-c594-4068-b67e-0065183d3472 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:16.981512 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b465e0c-c594-4068-b67e-0065183d3472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:16.981790 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b465e0c-c594-4068-b67e-0065183d3472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:16.982559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b465e0c-c594-4068-b67e-0065183d3472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:16.984165 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b465e0c-c594-4068-b67e-0065183d3472 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:16.995196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1419/2811] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:16.999799 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b5348-0807-4aa4-b830-d984772645ed admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:17.010415 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b5348-0807-4aa4-b830-d984772645ed admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:17.016976 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645508f-89f6-49ac-8df1-80fb9d76fce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:17.017865 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645508f-89f6-49ac-8df1-80fb9d76fce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:17.018148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645508f-89f6-49ac-8df1-80fb9d76fce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:17.018452 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645508f-89f6-49ac-8df1-80fb9d76fce9 admin admin] PATH_INFO: `/v3/projects/4edb56883dad4786b473e3bea65e5453/users/4b81aa7848f34a4ca38e86020c795e22/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:17.036360 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645508f-89f6-49ac-8df1-80fb9d76fce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4edb56883dad4786b473e3bea65e5453, user_id=4b81aa7848f34a4ca38e86020c795e22, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:17.039365 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645508f-89f6-49ac-8df1-80fb9d76fce9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:17.053900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1393/2812] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:16 2022] PUT /identity/v3/projects/4edb56883dad4786b473e3bea65e5453/users/4b81aa7848f34a4ca38e86020c795e22/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:17.065088 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fcdb2-f9ff-4cf5-8bf1-8d5f6265337e None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:17.065364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fcdb2-f9ff-4cf5-8bf1-8d5f6265337e None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:17.065654 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fcdb2-f9ff-4cf5-8bf1-8d5f6265337e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:17.092532 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-6c9fcdb2-f9ff-4cf5-8bf1-8d5f6265337e None None] MFA Rules not processed for user `4b81aa7848f34a4ca38e86020c795e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:17.093754 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-6c9fcdb2-f9ff-4cf5-8bf1-8d5f6265337e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:17.160064 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1420/2813] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:17.165494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645508f-89f6-49ac-8df1-80fb9d76fce9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:17.236455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645508f-89f6-49ac-8df1-80fb9d76fce9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:17.241824 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78469238-66ea-4cf0-afe2-f9c2e1efc1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:17.242597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78469238-66ea-4cf0-afe2-f9c2e1efc1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:17.242912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78469238-66ea-4cf0-afe2-f9c2e1efc1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:17.243209 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78469238-66ea-4cf0-afe2-f9c2e1efc1f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:17.244225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78469238-66ea-4cf0-afe2-f9c2e1efc1f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:17.246165 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78469238-66ea-4cf0-afe2-f9c2e1efc1f2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:17.275177 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1394/2814] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:28:17 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:17.279481 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fcdb2-f9ff-4cf5-8bf1-8d5f6265337e None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:17.292569 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fcdb2-f9ff-4cf5-8bf1-8d5f6265337e None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:17.362992 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13312d-de93-446a-9338-88c8922bdcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:17.363722 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13312d-de93-446a-9338-88c8922bdcbc admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:17.364009 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13312d-de93-446a-9338-88c8922bdcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:17.364428 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13312d-de93-446a-9338-88c8922bdcbc admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:17.365489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13312d-de93-446a-9338-88c8922bdcbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:17.367686 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13312d-de93-446a-9338-88c8922bdcbc admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:17.393829 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1421/2815] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:28:17 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:17.398086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78469238-66ea-4cf0-afe2-f9c2e1efc1f2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:17.410951 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78469238-66ea-4cf0-afe2-f9c2e1efc1f2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:17.416338 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c57a9-3a24-4625-a7e3-f185d71064b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:17.417022 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c57a9-3a24-4625-a7e3-f185d71064b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:17.417302 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c57a9-3a24-4625-a7e3-f185d71064b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:17.417572 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c57a9-3a24-4625-a7e3-f185d71064b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:17.418308 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c57a9-3a24-4625-a7e3-f185d71064b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:17.419969 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c57a9-3a24-4625-a7e3-f185d71064b4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:17.432133 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1395/2816] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:17.436582 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13312d-de93-446a-9338-88c8922bdcbc admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:17.447249 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13312d-de93-446a-9338-88c8922bdcbc admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:17.453036 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f99ab-220d-4f93-a7da-6a9e6011701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:17.453944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f99ab-220d-4f93-a7da-6a9e6011701b admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:17.454230 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f99ab-220d-4f93-a7da-6a9e6011701b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:17.461372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f99ab-220d-4f93-a7da-6a9e6011701b admin admin] PATH_INFO: `/v3/projects/8d554082eae140a0b28a32f7fa63ee7d/users/a4faf85aaa4144398009040784a1dab7/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:17.476395 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f99ab-220d-4f93-a7da-6a9e6011701b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d554082eae140a0b28a32f7fa63ee7d, user_id=a4faf85aaa4144398009040784a1dab7, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:17.479236 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f99ab-220d-4f93-a7da-6a9e6011701b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:17.483259 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:17.497960 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1422/2817] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:17 2022] PUT /identity/v3/projects/8d554082eae140a0b28a32f7fa63ee7d/users/a4faf85aaa4144398009040784a1dab7/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:17.501937 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c57a9-3a24-4625-a7e3-f185d71064b4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:17.513405 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c57a9-3a24-4625-a7e3-f185d71064b4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:17.571820 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc28af-ff63-468b-abcd-a59c3be53538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:17.572495 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc28af-ff63-468b-abcd-a59c3be53538 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:17.572776 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc28af-ff63-468b-abcd-a59c3be53538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:17.573196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc28af-ff63-468b-abcd-a59c3be53538 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:17.574421 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc28af-ff63-468b-abcd-a59c3be53538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:17.576860 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc28af-ff63-468b-abcd-a59c3be53538 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:17.591168 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1396/2818] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:17.595553 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f99ab-220d-4f93-a7da-6a9e6011701b admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:17.606745 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f99ab-220d-4f93-a7da-6a9e6011701b admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:17.613395 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af1783-2004-4de3-970e-5a00f5c9127b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:17.614293 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af1783-2004-4de3-970e-5a00f5c9127b admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:17.614712 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af1783-2004-4de3-970e-5a00f5c9127b admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:17.615000 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af1783-2004-4de3-970e-5a00f5c9127b admin admin] PATH_INFO: `/v3/projects/8d554082eae140a0b28a32f7fa63ee7d/users/a4faf85aaa4144398009040784a1dab7/roles/67cd90b899c54fe38f14a99c18fa2ce2` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:17.617376 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af1783-2004-4de3-970e-5a00f5c9127b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d554082eae140a0b28a32f7fa63ee7d, user_id=a4faf85aaa4144398009040784a1dab7, role_id=67cd90b899c54fe38f14a99c18fa2ce2)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:17.620416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af1783-2004-4de3-970e-5a00f5c9127b admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:17.632581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1423/2819] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:17 2022] PUT /identity/v3/projects/8d554082eae140a0b28a32f7fa63ee7d/users/a4faf85aaa4144398009040784a1dab7/roles/67cd90b899c54fe38f14a99c18fa2ce2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:17.649275 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e12bb-586e-49ef-97cd-e15d116bf2a3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:17.649575 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e12bb-586e-49ef-97cd-e15d116bf2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:17.649865 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441e12bb-586e-49ef-97cd-e15d116bf2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:17.678442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:17.681871 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-441e12bb-586e-49ef-97cd-e15d116bf2a3 None None] MFA Rules not processed for user `a4faf85aaa4144398009040784a1dab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:17.683949 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-441e12bb-586e-49ef-97cd-e15d116bf2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:17.758663 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1397/2820] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:17.767757 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af1783-2004-4de3-970e-5a00f5c9127b admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:17.769469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-31af1783-2004-4de3-970e-5a00f5c9127b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:17.836707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af1783-2004-4de3-970e-5a00f5c9127b admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:17.840979 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ffc87-c7f3-416a-8850-4303b58b6990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:17.841629 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ffc87-c7f3-416a-8850-4303b58b6990 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:17.841875 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ffc87-c7f3-416a-8850-4303b58b6990 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:17.842235 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ffc87-c7f3-416a-8850-4303b58b6990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:17.902965 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ffc87-c7f3-416a-8850-4303b58b6990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:17.904477 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ffc87-c7f3-416a-8850-4303b58b6990 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:17.913957 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1424/2821] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:19.411502 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e12bb-586e-49ef-97cd-e15d116bf2a3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:19.413233 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-441e12bb-586e-49ef-97cd-e15d116bf2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:19.426104 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441e12bb-586e-49ef-97cd-e15d116bf2a3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:19.430538 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdd5c8-a3c1-4430-8138-7eb5e66c681c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:19.431200 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdd5c8-a3c1-4430-8138-7eb5e66c681c service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:19.431483 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdd5c8-a3c1-4430-8138-7eb5e66c681c service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:19.431756 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdd5c8-a3c1-4430-8138-7eb5e66c681c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:19.498381 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdd5c8-a3c1-4430-8138-7eb5e66c681c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:19.499875 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdd5c8-a3c1-4430-8138-7eb5e66c681c service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:19.510032 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1398/2822] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:20.069394 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ffc87-c7f3-416a-8850-4303b58b6990 service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:20.079372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ffc87-c7f3-416a-8850-4303b58b6990 service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:20.084423 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49e6e0-7830-4147-9f85-21e79477ba15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:20.085515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49e6e0-7830-4147-9f85-21e79477ba15 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:20.085937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49e6e0-7830-4147-9f85-21e79477ba15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:20.086450 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49e6e0-7830-4147-9f85-21e79477ba15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:20.097641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49e6e0-7830-4147-9f85-21e79477ba15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:20.099111 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49e6e0-7830-4147-9f85-21e79477ba15 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:20.110153 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1425/2823] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:24.007234 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdd5c8-a3c1-4430-8138-7eb5e66c681c service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:24.072821 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdd5c8-a3c1-4430-8138-7eb5e66c681c service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:24.078517 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2eec17-ea99-4a80-9536-20d22ccb9cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:24.079398 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2eec17-ea99-4a80-9536-20d22ccb9cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:24.079682 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2eec17-ea99-4a80-9536-20d22ccb9cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:24.079957 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2eec17-ea99-4a80-9536-20d22ccb9cb3 admin admin] PATH_INFO: `/v3/users/79e215a779ed4cc784b31fa5da339442` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:24.081228 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2eec17-ea99-4a80-9536-20d22ccb9cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79e215a779ed4cc784b31fa5da339442)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:24.083220 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2eec17-ea99-4a80-9536-20d22ccb9cb3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:24.131707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:24.139342 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9c2eec17-ea99-4a80-9536-20d22ccb9cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79e215a779ed4cc784b31fa5da339442'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:24.151763 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9c2eec17-ea99-4a80-9536-20d22ccb9cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79e215a779ed4cc784b31fa5da339442'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:24.152449 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9c2eec17-ea99-4a80-9536-20d22ccb9cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79e215a779ed4cc784b31fa5da339442'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:24.166880 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9c2eec17-ea99-4a80-9536-20d22ccb9cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79e215a779ed4cc784b31fa5da339442'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:24.174450 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9c2eec17-ea99-4a80-9536-20d22ccb9cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79e215a779ed4cc784b31fa5da339442'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:24.181196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1399/2824] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:28:24 2022] DELETE /identity/v3/users/79e215a779ed4cc784b31fa5da339442 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 14:28:24.186358 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573dcf6-0318-4625-be96-992a2decb3c3 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:24.186866 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573dcf6-0318-4625-be96-992a2decb3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:24.186966 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573dcf6-0318-4625-be96-992a2decb3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:24.205188 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-f573dcf6-0318-4625-be96-992a2decb3c3 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:24.206302 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f573dcf6-0318-4625-be96-992a2decb3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:24.269000 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1426/2825] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:24.279310 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2eec17-ea99-4a80-9536-20d22ccb9cb3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:24.280933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9c2eec17-ea99-4a80-9536-20d22ccb9cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:24.343496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2eec17-ea99-4a80-9536-20d22ccb9cb3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:24.347678 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacdaf8-2891-4cec-9540-2d72cdfb5a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:24.348346 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacdaf8-2891-4cec-9540-2d72cdfb5a74 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:24.348628 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacdaf8-2891-4cec-9540-2d72cdfb5a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:24.348900 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacdaf8-2891-4cec-9540-2d72cdfb5a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:24.361816 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacdaf8-2891-4cec-9540-2d72cdfb5a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:24.363345 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacdaf8-2891-4cec-9540-2d72cdfb5a74 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:24.373909 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1400/2826] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:24.667429 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573dcf6-0318-4625-be96-992a2decb3c3 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:24.668862 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f573dcf6-0318-4625-be96-992a2decb3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:24.681564 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573dcf6-0318-4625-be96-992a2decb3c3 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:24.688093 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202dbf7-16dd-455b-96d7-c7b567c95e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:24.689001 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202dbf7-16dd-455b-96d7-c7b567c95e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:24.689292 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202dbf7-16dd-455b-96d7-c7b567c95e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:24.689559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202dbf7-16dd-455b-96d7-c7b567c95e85 admin admin] PATH_INFO: `/v3/projects/8c7d87a10ff14f1dbe0d8ec54aea16f1` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:24.691024 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202dbf7-16dd-455b-96d7-c7b567c95e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c7d87a10ff14f1dbe0d8ec54aea16f1)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:24.693244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202dbf7-16dd-455b-96d7-c7b567c95e85 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:24.718910 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:24.747308 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e202dbf7-16dd-455b-96d7-c7b567c95e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c7d87a10ff14f1dbe0d8ec54aea16f1', 'request_id': 'req-e202dbf7-16dd-455b-96d7-c7b567c95e85'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:24.752669 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e202dbf7-16dd-455b-96d7-c7b567c95e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c7d87a10ff14f1dbe0d8ec54aea16f1', 'request_id': 'req-e202dbf7-16dd-455b-96d7-c7b567c95e85'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:24.759189 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e202dbf7-16dd-455b-96d7-c7b567c95e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c7d87a10ff14f1dbe0d8ec54aea16f1', 'request_id': 'req-e202dbf7-16dd-455b-96d7-c7b567c95e85'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:24.772941 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e202dbf7-16dd-455b-96d7-c7b567c95e85 admin admin] The token cache is being invalidate because project 8c7d87a10ff14f1dbe0d8ec54aea16f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:28:24.773232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e202dbf7-16dd-455b-96d7-c7b567c95e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:24.773834 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-e202dbf7-16dd-455b-96d7-c7b567c95e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:24.775415 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1427/2827] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:28:24 2022] DELETE /identity/v3/projects/8c7d87a10ff14f1dbe0d8ec54aea16f1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:24.779881 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacdaf8-2891-4cec-9540-2d72cdfb5a74 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:24.793376 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacdaf8-2891-4cec-9540-2d72cdfb5a74 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:24.855912 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58654fa4-a144-4a3b-aace-79a086896605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:24.856920 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58654fa4-a144-4a3b-aace-79a086896605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:24.857267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58654fa4-a144-4a3b-aace-79a086896605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:24.857545 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58654fa4-a144-4a3b-aace-79a086896605 admin admin] PATH_INFO: `/v3/users/4b81aa7848f34a4ca38e86020c795e22` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:24.861178 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58654fa4-a144-4a3b-aace-79a086896605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b81aa7848f34a4ca38e86020c795e22)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:24.863155 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58654fa4-a144-4a3b-aace-79a086896605 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:24.916769 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-58654fa4-a144-4a3b-aace-79a086896605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b81aa7848f34a4ca38e86020c795e22'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:24.925264 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-58654fa4-a144-4a3b-aace-79a086896605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b81aa7848f34a4ca38e86020c795e22'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:24.926062 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-58654fa4-a144-4a3b-aace-79a086896605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b81aa7848f34a4ca38e86020c795e22'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:24.932355 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:24.941541 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-58654fa4-a144-4a3b-aace-79a086896605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b81aa7848f34a4ca38e86020c795e22'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:24.948296 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-58654fa4-a144-4a3b-aace-79a086896605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b81aa7848f34a4ca38e86020c795e22'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:24.954283 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1401/2828] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:28:24 2022] DELETE /identity/v3/users/4b81aa7848f34a4ca38e86020c795e22 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:25.259464 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202dbf7-16dd-455b-96d7-c7b567c95e85 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:25.261088 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e202dbf7-16dd-455b-96d7-c7b567c95e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:25.276610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202dbf7-16dd-455b-96d7-c7b567c95e85 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:25.343524 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd1a92-fab0-4113-a505-9a0fe0783ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:25.344759 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd1a92-fab0-4113-a505-9a0fe0783ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:25.345003 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd1a92-fab0-4113-a505-9a0fe0783ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:25.345277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd1a92-fab0-4113-a505-9a0fe0783ffe admin admin] PATH_INFO: `/v3/projects/4edb56883dad4786b473e3bea65e5453` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:25.346592 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd1a92-fab0-4113-a505-9a0fe0783ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4edb56883dad4786b473e3bea65e5453)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:25.348517 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd1a92-fab0-4113-a505-9a0fe0783ffe admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:25.400733 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-76bd1a92-fab0-4113-a505-9a0fe0783ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4edb56883dad4786b473e3bea65e5453', 'request_id': 'req-76bd1a92-fab0-4113-a505-9a0fe0783ffe'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:25.407116 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-76bd1a92-fab0-4113-a505-9a0fe0783ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4edb56883dad4786b473e3bea65e5453', 'request_id': 'req-76bd1a92-fab0-4113-a505-9a0fe0783ffe'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:25.414274 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-76bd1a92-fab0-4113-a505-9a0fe0783ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4edb56883dad4786b473e3bea65e5453', 'request_id': 'req-76bd1a92-fab0-4113-a505-9a0fe0783ffe'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:25.427796 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-76bd1a92-fab0-4113-a505-9a0fe0783ffe admin admin] The token cache is being invalidate because project 4edb56883dad4786b473e3bea65e5453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:28:25.428081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-76bd1a92-fab0-4113-a505-9a0fe0783ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:25.428693 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-76bd1a92-fab0-4113-a505-9a0fe0783ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:25.430467 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1428/2829] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:28:25 2022] DELETE /identity/v3/projects/4edb56883dad4786b473e3bea65e5453 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:25.434736 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58654fa4-a144-4a3b-aace-79a086896605 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:25.436263 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-58654fa4-a144-4a3b-aace-79a086896605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:25.450401 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58654fa4-a144-4a3b-aace-79a086896605 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:25.514710 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2bd47-cb09-4b2c-bd05-c9c9fbf30202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:25.515576 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2bd47-cb09-4b2c-bd05-c9c9fbf30202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:25.515857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2bd47-cb09-4b2c-bd05-c9c9fbf30202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:25.516127 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2bd47-cb09-4b2c-bd05-c9c9fbf30202 admin admin] PATH_INFO: `/v3/users/a4faf85aaa4144398009040784a1dab7` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:25.517348 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2bd47-cb09-4b2c-bd05-c9c9fbf30202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4faf85aaa4144398009040784a1dab7)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:25.519768 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2bd47-cb09-4b2c-bd05-c9c9fbf30202 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:25.571630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-46e2bd47-cb09-4b2c-bd05-c9c9fbf30202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4faf85aaa4144398009040784a1dab7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:25.586260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-46e2bd47-cb09-4b2c-bd05-c9c9fbf30202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4faf85aaa4144398009040784a1dab7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:25.586897 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-46e2bd47-cb09-4b2c-bd05-c9c9fbf30202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4faf85aaa4144398009040784a1dab7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:25.599553 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-46e2bd47-cb09-4b2c-bd05-c9c9fbf30202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4faf85aaa4144398009040784a1dab7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:25.606752 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-46e2bd47-cb09-4b2c-bd05-c9c9fbf30202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4faf85aaa4144398009040784a1dab7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:25.613270 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1402/2830] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:28:25 2022] DELETE /identity/v3/users/a4faf85aaa4144398009040784a1dab7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:25.901631 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd1a92-fab0-4113-a505-9a0fe0783ffe admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:25.903200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-76bd1a92-fab0-4113-a505-9a0fe0783ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:25.921424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd1a92-fab0-4113-a505-9a0fe0783ffe admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:25.958691 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:25.985106 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb48ccf-facf-4cd2-bdef-f99116ad22d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:25.986088 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48ccf-facf-4cd2-bdef-f99116ad22d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:25.986295 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48ccf-facf-4cd2-bdef-f99116ad22d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:25.986627 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb48ccf-facf-4cd2-bdef-f99116ad22d7 admin admin] PATH_INFO: `/v3/projects/8d554082eae140a0b28a32f7fa63ee7d` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:25.987862 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb48ccf-facf-4cd2-bdef-f99116ad22d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d554082eae140a0b28a32f7fa63ee7d)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:25.989767 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb48ccf-facf-4cd2-bdef-f99116ad22d7 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:26.040424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2fb48ccf-facf-4cd2-bdef-f99116ad22d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d554082eae140a0b28a32f7fa63ee7d', 'request_id': 'req-2fb48ccf-facf-4cd2-bdef-f99116ad22d7'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:26.045878 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2fb48ccf-facf-4cd2-bdef-f99116ad22d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d554082eae140a0b28a32f7fa63ee7d', 'request_id': 'req-2fb48ccf-facf-4cd2-bdef-f99116ad22d7'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:26.052154 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2fb48ccf-facf-4cd2-bdef-f99116ad22d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d554082eae140a0b28a32f7fa63ee7d', 'request_id': 'req-2fb48ccf-facf-4cd2-bdef-f99116ad22d7'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:26.065998 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2fb48ccf-facf-4cd2-bdef-f99116ad22d7 admin admin] The token cache is being invalidate because project 8d554082eae140a0b28a32f7fa63ee7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:28:26.066305 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2fb48ccf-facf-4cd2-bdef-f99116ad22d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:26.067119 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-2fb48ccf-facf-4cd2-bdef-f99116ad22d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:28:26.069062 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1429/2831] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:28:25 2022] DELETE /identity/v3/projects/8d554082eae140a0b28a32f7fa63ee7d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:26.075145 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38905115-0533-4b95-97a7-21d3b4241255 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:26.075546 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38905115-0533-4b95-97a7-21d3b4241255 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:26.075972 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38905115-0533-4b95-97a7-21d3b4241255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:26.094883 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-38905115-0533-4b95-97a7-21d3b4241255 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:26.096108 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-38905115-0533-4b95-97a7-21d3b4241255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:26.155494 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:26.173950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1403/2832] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:26.175998 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9ce86-84fd-41af-b11b-74ac0bef6307 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:26.176289 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9ce86-84fd-41af-b11b-74ac0bef6307 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:26.176570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9ce86-84fd-41af-b11b-74ac0bef6307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:26.196615 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-9da9ce86-84fd-41af-b11b-74ac0bef6307 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:26.197830 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-9da9ce86-84fd-41af-b11b-74ac0bef6307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:26.210922 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1430/2833] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:26.213997 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38905115-0533-4b95-97a7-21d3b4241255 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:26.224089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38905115-0533-4b95-97a7-21d3b4241255 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:26.229684 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbd600-3019-47c3-8eef-d69c2145e83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:26.230630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbd600-3019-47c3-8eef-d69c2145e83a admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:26.230927 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbd600-3019-47c3-8eef-d69c2145e83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:26.231226 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbd600-3019-47c3-8eef-d69c2145e83a admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:26.231970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbd600-3019-47c3-8eef-d69c2145e83a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:28:26.232276 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbd600-3019-47c3-8eef-d69c2145e83a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:26.234016 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbd600-3019-47c3-8eef-d69c2145e83a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:26.249221 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1404/2834] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:28:26.253746 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9ce86-84fd-41af-b11b-74ac0bef6307 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:26.268345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9ce86-84fd-41af-b11b-74ac0bef6307 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:26.274037 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b8c1e-1a0d-474b-be3d-05e025ba287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:26.274811 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8c1e-1a0d-474b-be3d-05e025ba287c admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:26.275121 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8c1e-1a0d-474b-be3d-05e025ba287c admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:26.275581 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b8c1e-1a0d-474b-be3d-05e025ba287c admin admin] PATH_INFO: `/v3/projects` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:26.276357 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b8c1e-1a0d-474b-be3d-05e025ba287c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:26.278587 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b8c1e-1a0d-474b-be3d-05e025ba287c admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:26.307817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1431/2835] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:28:26 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:28:26.312232 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbd600-3019-47c3-8eef-d69c2145e83a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:26.322966 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbd600-3019-47c3-8eef-d69c2145e83a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:26.389091 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98576a7e-3d4c-4d92-9ed7-3e946cca6b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:26.389820 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98576a7e-3d4c-4d92-9ed7-3e946cca6b42 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:26.390111 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98576a7e-3d4c-4d92-9ed7-3e946cca6b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:26.390417 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98576a7e-3d4c-4d92-9ed7-3e946cca6b42 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:26.391281 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98576a7e-3d4c-4d92-9ed7-3e946cca6b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:26.393313 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98576a7e-3d4c-4d92-9ed7-3e946cca6b42 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:26.418819 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1405/2836] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:28:26 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:28:26.420380 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b8c1e-1a0d-474b-be3d-05e025ba287c admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:26.432040 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b8c1e-1a0d-474b-be3d-05e025ba287c admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:26.437408 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e5e7b-cf21-4ffe-9092-85cb070c5ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:26.438092 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e5e7b-cf21-4ffe-9092-85cb070c5ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:26.438370 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e5e7b-cf21-4ffe-9092-85cb070c5ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:26.438694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e5e7b-cf21-4ffe-9092-85cb070c5ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:26.439465 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e5e7b-cf21-4ffe-9092-85cb070c5ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:26.441086 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e5e7b-cf21-4ffe-9092-85cb070c5ec0 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:26.452085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1432/2837] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:26.456300 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98576a7e-3d4c-4d92-9ed7-3e946cca6b42 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:26.467858 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98576a7e-3d4c-4d92-9ed7-3e946cca6b42 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:26.473089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55661535-a6b1-4b6e-aa69-c030bfba3e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:26.473799 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55661535-a6b1-4b6e-aa69-c030bfba3e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:26.474123 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55661535-a6b1-4b6e-aa69-c030bfba3e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:26.474430 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55661535-a6b1-4b6e-aa69-c030bfba3e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:26.475194 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55661535-a6b1-4b6e-aa69-c030bfba3e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:26.476910 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55661535-a6b1-4b6e-aa69-c030bfba3e12 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:26.487943 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1406/2838] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:28:26.492620 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e5e7b-cf21-4ffe-9092-85cb070c5ec0 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:26.503345 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e5e7b-cf21-4ffe-9092-85cb070c5ec0 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:26.508180 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784621f-a2b5-4a43-a031-12a742310397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:26.509060 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784621f-a2b5-4a43-a031-12a742310397 admin admin] REQUEST_METHOD: `PUT` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:26.509338 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784621f-a2b5-4a43-a031-12a742310397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:26.509612 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784621f-a2b5-4a43-a031-12a742310397 admin admin] PATH_INFO: `/v3/projects/b8433629d1be4adaa2910ba8ee80b1c3/users/fa4524e444bd4e3da9b88802f2d18e31/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:26.526091 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784621f-a2b5-4a43-a031-12a742310397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8433629d1be4adaa2910ba8ee80b1c3, user_id=fa4524e444bd4e3da9b88802f2d18e31, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:26.529153 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784621f-a2b5-4a43-a031-12a742310397 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:26.544987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1433/2839] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:28:26 2022] PUT /identity/v3/projects/b8433629d1be4adaa2910ba8ee80b1c3/users/fa4524e444bd4e3da9b88802f2d18e31/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:28:26.556712 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b150d-c5fd-4b19-ba8e-41f23cfde07d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:26.556986 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b150d-c5fd-4b19-ba8e-41f23cfde07d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:26.557284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b150d-c5fd-4b19-ba8e-41f23cfde07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:26.586567 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a58b150d-c5fd-4b19-ba8e-41f23cfde07d None None] MFA Rules not processed for user `fa4524e444bd4e3da9b88802f2d18e31`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:26.587784 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a58b150d-c5fd-4b19-ba8e-41f23cfde07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:26.660403 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1407/2840] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:28:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:26.672384 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784621f-a2b5-4a43-a031-12a742310397 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:26.674283 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-4784621f-a2b5-4a43-a031-12a742310397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:26.736976 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784621f-a2b5-4a43-a031-12a742310397 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:26.741050 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee895811-fcd1-4815-b7d7-6d58e051e682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:26.741770 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee895811-fcd1-4815-b7d7-6d58e051e682 service cinder] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:26.742058 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee895811-fcd1-4815-b7d7-6d58e051e682 service cinder] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:26.742344 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee895811-fcd1-4815-b7d7-6d58e051e682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:26.751837 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee895811-fcd1-4815-b7d7-6d58e051e682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:26.753291 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee895811-fcd1-4815-b7d7-6d58e051e682 service cinder] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:26.762807 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1434/2841] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:36.657098 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:36.758337 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:42.139075 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd82c9-6732-44fc-a4c5-50ba98ccf941 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:42.139617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd82c9-6732-44fc-a4c5-50ba98ccf941 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:42.139617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd82c9-6732-44fc-a4c5-50ba98ccf941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:42.159463 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-54cd82c9-6732-44fc-a4c5-50ba98ccf941 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:42.160722 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-54cd82c9-6732-44fc-a4c5-50ba98ccf941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:42.224304 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1408/2842] 10.222.0.102 () {58 vars in 1017 bytes} [Mon Jul 18 14:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:42.249759 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee895811-fcd1-4815-b7d7-6d58e051e682 service cinder] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:42.251495 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ee895811-fcd1-4815-b7d7-6d58e051e682 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:42.328524 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee895811-fcd1-4815-b7d7-6d58e051e682 service cinder] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:42.334915 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f203a-789b-4fef-8916-63e83c64947d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:42.335656 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f203a-789b-4fef-8916-63e83c64947d service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:42.335944 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f203a-789b-4fef-8916-63e83c64947d service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:42.336226 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f203a-789b-4fef-8916-63e83c64947d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:42.345560 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f203a-789b-4fef-8916-63e83c64947d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:42.347220 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f203a-789b-4fef-8916-63e83c64947d service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:42.357467 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1435/2843] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:28:46.230844 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3b219-5c08-4c45-b3f3-5a9ed3a07043 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:46.231459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3b219-5c08-4c45-b3f3-5a9ed3a07043 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:46.231459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3b219-5c08-4c45-b3f3-5a9ed3a07043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:46.252641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3ee3b219-5c08-4c45-b3f3-5a9ed3a07043 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:46.253892 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3ee3b219-5c08-4c45-b3f3-5a9ed3a07043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:46.263694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1409/2844] 10.222.0.102 () {58 vars in 1017 bytes} [Mon Jul 18 14:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:46.286409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f203a-789b-4fef-8916-63e83c64947d service nova] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:46.288600 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b98f203a-789b-4fef-8916-63e83c64947d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:46.305407 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f203a-789b-4fef-8916-63e83c64947d service nova] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:46.312010 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26133626-a32d-4f30-ac7c-32397da9b030 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:46.312702 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26133626-a32d-4f30-ac7c-32397da9b030 service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:46.312981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26133626-a32d-4f30-ac7c-32397da9b030 service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:46.313244 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26133626-a32d-4f30-ac7c-32397da9b030 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:46.322646 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26133626-a32d-4f30-ac7c-32397da9b030 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:46.324226 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26133626-a32d-4f30-ac7c-32397da9b030 service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:46.334828 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1436/2845] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:49.970744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3b219-5c08-4c45-b3f3-5a9ed3a07043 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:49.972389 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3ee3b219-5c08-4c45-b3f3-5a9ed3a07043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:50.034821 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3b219-5c08-4c45-b3f3-5a9ed3a07043 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:50.038772 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90150d76-7965-4016-85ea-593facc94e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:50.039424 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90150d76-7965-4016-85ea-593facc94e89 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:50.039703 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90150d76-7965-4016-85ea-593facc94e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:50.039979 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90150d76-7965-4016-85ea-593facc94e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:50.041833 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-90150d76-7965-4016-85ea-593facc94e89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:50.051554 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90150d76-7965-4016-85ea-593facc94e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:50.053018 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90150d76-7965-4016-85ea-593facc94e89 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:50.061522 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1410/2846] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:50.875987 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc2bee-d37e-4f19-a521-1a9cf3c7465d None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:50.876539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc2bee-d37e-4f19-a521-1a9cf3c7465d None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:50.876539 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc2bee-d37e-4f19-a521-1a9cf3c7465d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:50.895435 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-ecdc2bee-d37e-4f19-a521-1a9cf3c7465d None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:50.896647 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-ecdc2bee-d37e-4f19-a521-1a9cf3c7465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:50.905164 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1437/2847] 10.222.0.102 () {58 vars in 1017 bytes} [Mon Jul 18 14:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:51.007664 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90150d76-7965-4016-85ea-593facc94e89 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:51.027336 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90150d76-7965-4016-85ea-593facc94e89 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:51.033630 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0863a4f-acfc-49b4-9754-4d047c8e8648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:51.034271 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863a4f-acfc-49b4-9754-4d047c8e8648 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:51.034583 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863a4f-acfc-49b4-9754-4d047c8e8648 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:51.034861 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863a4f-acfc-49b4-9754-4d047c8e8648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:51.043645 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0863a4f-acfc-49b4-9754-4d047c8e8648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:51.045267 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0863a4f-acfc-49b4-9754-4d047c8e8648 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:51.056021 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1411/2848] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:54.632206 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3139de-50e3-4efb-aeb2-b94ad7a188d0 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:54.632842 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3139de-50e3-4efb-aeb2-b94ad7a188d0 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:54.632842 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3139de-50e3-4efb-aeb2-b94ad7a188d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:54.651534 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-5c3139de-50e3-4efb-aeb2-b94ad7a188d0 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:54.653266 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-5c3139de-50e3-4efb-aeb2-b94ad7a188d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:54.662715 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1438/2849] 10.222.0.102 () {58 vars in 1017 bytes} [Mon Jul 18 14:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:54.685370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0863a4f-acfc-49b4-9754-4d047c8e8648 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:54.697795 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0863a4f-acfc-49b4-9754-4d047c8e8648 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:54.704750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a9359-b585-419a-8a80-c1d16c718dce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:54.705372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a9359-b585-419a-8a80-c1d16c718dce service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:54.705675 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a9359-b585-419a-8a80-c1d16c718dce service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:54.705950 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a9359-b585-419a-8a80-c1d16c718dce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:54.715188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a9359-b585-419a-8a80-c1d16c718dce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:54.716859 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a9359-b585-419a-8a80-c1d16c718dce service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:54.727697 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1412/2850] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:28:59.838996 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ec71d-62d7-463f-a29a-4f60d856bca6 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:59.839614 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ec71d-62d7-463f-a29a-4f60d856bca6 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:59.839614 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ec71d-62d7-463f-a29a-4f60d856bca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:59.859960 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-b03ec71d-62d7-463f-a29a-4f60d856bca6 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:28:59.861436 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-b03ec71d-62d7-463f-a29a-4f60d856bca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:28:59.871142 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1439/2851] 10.222.0.102 () {58 vars in 1017 bytes} [Mon Jul 18 14:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:28:59.919759 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a9359-b585-419a-8a80-c1d16c718dce service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:28:59.931581 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a9359-b585-419a-8a80-c1d16c718dce service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:28:59.938691 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c1f2d-51c5-42c0-92ff-88961c79af69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:28:59.939335 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c1f2d-51c5-42c0-92ff-88961c79af69 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:28:59.939627 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c1f2d-51c5-42c0-92ff-88961c79af69 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:28:59.939906 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c1f2d-51c5-42c0-92ff-88961c79af69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:28:59.949609 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c1f2d-51c5-42c0-92ff-88961c79af69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:28:59.951186 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c1f2d-51c5-42c0-92ff-88961c79af69 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:28:59.961860 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1413/2852] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:29:02.943212 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ec71d-62d7-463f-a29a-4f60d856bca6 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:02.954295 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ec71d-62d7-463f-a29a-4f60d856bca6 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:02.959646 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a4706-8ca1-4fa9-9cbe-e590c332dfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:02.960395 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a4706-8ca1-4fa9-9cbe-e590c332dfc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:02.960678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a4706-8ca1-4fa9-9cbe-e590c332dfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:02.960960 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a4706-8ca1-4fa9-9cbe-e590c332dfc2 admin admin] PATH_INFO: `/v3/users/fa4524e444bd4e3da9b88802f2d18e31` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:02.962327 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a4706-8ca1-4fa9-9cbe-e590c332dfc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4524e444bd4e3da9b88802f2d18e31)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:02.964409 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a4706-8ca1-4fa9-9cbe-e590c332dfc2 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:02.995565 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83adcba-4dbd-4518-885e-ec5c07ba6d03 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:02.996372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83adcba-4dbd-4518-885e-ec5c07ba6d03 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:02.996372 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83adcba-4dbd-4518-885e-ec5c07ba6d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:03.014750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b83adcba-4dbd-4518-885e-ec5c07ba6d03 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:29:03.016238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b83adcba-4dbd-4518-885e-ec5c07ba6d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:03.019901 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-165a4706-8ca1-4fa9-9cbe-e590c332dfc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4524e444bd4e3da9b88802f2d18e31'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:03.024894 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1414/2853] 10.222.0.102 () {58 vars in 1017 bytes} [Mon Jul 18 14:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:29:03.029195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-165a4706-8ca1-4fa9-9cbe-e590c332dfc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4524e444bd4e3da9b88802f2d18e31'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:03.029813 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-165a4706-8ca1-4fa9-9cbe-e590c332dfc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4524e444bd4e3da9b88802f2d18e31'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:03.041989 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-165a4706-8ca1-4fa9-9cbe-e590c332dfc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4524e444bd4e3da9b88802f2d18e31'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:03.055664 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83adcba-4dbd-4518-885e-ec5c07ba6d03 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:03.055952 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-165a4706-8ca1-4fa9-9cbe-e590c332dfc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4524e444bd4e3da9b88802f2d18e31'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:03.063193 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1440/2854] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:29:02 2022] DELETE /identity/v3/users/fa4524e444bd4e3da9b88802f2d18e31 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:29:03.068099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3fc21-36ae-4d7e-8044-638fbda0a95b None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:03.068391 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3fc21-36ae-4d7e-8044-638fbda0a95b None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:03.068670 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3fc21-36ae-4d7e-8044-638fbda0a95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:03.069913 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83adcba-4dbd-4518-885e-ec5c07ba6d03 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:03.086641 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-dcc3fc21-36ae-4d7e-8044-638fbda0a95b None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:29:03.087857 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-dcc3fc21-36ae-4d7e-8044-638fbda0a95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:03.106725 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:03.118217 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:03.137978 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62e91f-552f-4dbc-a883-950e55f78e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:03.138694 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62e91f-552f-4dbc-a883-950e55f78e97 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:03.138954 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62e91f-552f-4dbc-a883-950e55f78e97 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:03.139260 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62e91f-552f-4dbc-a883-950e55f78e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:03.141207 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7c62e91f-552f-4dbc-a883-950e55f78e97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:03.155334 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1441/2855] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:29:03.165364 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3fc21-36ae-4d7e-8044-638fbda0a95b None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:03.166858 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-dcc3fc21-36ae-4d7e-8044-638fbda0a95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:03.206709 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62e91f-552f-4dbc-a883-950e55f78e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:03.208347 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62e91f-552f-4dbc-a883-950e55f78e97 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:03.218503 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1415/2856] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:29:03.225726 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3fc21-36ae-4d7e-8044-638fbda0a95b None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:03.229846 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfcf60-467b-40a0-a27a-5421793757f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:03.230649 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfcf60-467b-40a0-a27a-5421793757f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:03.230927 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfcf60-467b-40a0-a27a-5421793757f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:03.231196 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfcf60-467b-40a0-a27a-5421793757f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:03.240938 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfcf60-467b-40a0-a27a-5421793757f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:03.242550 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfcf60-467b-40a0-a27a-5421793757f6 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:03.254281 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1442/2857] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:29:03.544884 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62e91f-552f-4dbc-a883-950e55f78e97 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:03.546332 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7c62e91f-552f-4dbc-a883-950e55f78e97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:03.559161 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62e91f-552f-4dbc-a883-950e55f78e97 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:03.565219 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98027da2-530a-46f2-b911-deb6eba338b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:03.566157 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98027da2-530a-46f2-b911-deb6eba338b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:03.566480 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98027da2-530a-46f2-b911-deb6eba338b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:03.566781 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98027da2-530a-46f2-b911-deb6eba338b3 admin admin] PATH_INFO: `/v3/projects/b8433629d1be4adaa2910ba8ee80b1c3` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:03.568086 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98027da2-530a-46f2-b911-deb6eba338b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8433629d1be4adaa2910ba8ee80b1c3)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:03.570100 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98027da2-530a-46f2-b911-deb6eba338b3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:03.620135 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-98027da2-530a-46f2-b911-deb6eba338b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8433629d1be4adaa2910ba8ee80b1c3', 'request_id': 'req-98027da2-530a-46f2-b911-deb6eba338b3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:03.625680 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-98027da2-530a-46f2-b911-deb6eba338b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8433629d1be4adaa2910ba8ee80b1c3', 'request_id': 'req-98027da2-530a-46f2-b911-deb6eba338b3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:03.632253 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-98027da2-530a-46f2-b911-deb6eba338b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8433629d1be4adaa2910ba8ee80b1c3', 'request_id': 'req-98027da2-530a-46f2-b911-deb6eba338b3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:03.645323 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-98027da2-530a-46f2-b911-deb6eba338b3 admin admin] The token cache is being invalidate because project b8433629d1be4adaa2910ba8ee80b1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:29:03.645621 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-98027da2-530a-46f2-b911-deb6eba338b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:03.646238 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-98027da2-530a-46f2-b911-deb6eba338b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:03.647915 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1416/2858] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:29:03 2022] DELETE /identity/v3/projects/b8433629d1be4adaa2910ba8ee80b1c3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:29:03.653048 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc8cba-d437-478f-8fe2-f82df4d0a482 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:03.653404 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc8cba-d437-478f-8fe2-f82df4d0a482 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:03.653603 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc8cba-d437-478f-8fe2-f82df4d0a482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:03.674841 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-89cc8cba-d437-478f-8fe2-f82df4d0a482 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:29:03.676029 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-89cc8cba-d437-478f-8fe2-f82df4d0a482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:03.743105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1443/2859] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:29:03.753524 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47537040-0574-4781-91c8-8231baf34d10 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:03.753818 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47537040-0574-4781-91c8-8231baf34d10 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:03.754100 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47537040-0574-4781-91c8-8231baf34d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:03.775139 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-47537040-0574-4781-91c8-8231baf34d10 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:29:03.776456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-47537040-0574-4781-91c8-8231baf34d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:03.785637 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1417/2860] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:29:03.790410 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc8cba-d437-478f-8fe2-f82df4d0a482 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:03.805234 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc8cba-d437-478f-8fe2-f82df4d0a482 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:03.810014 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a2c7a-e695-4b07-852d-dec5ef3e0524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:03.810731 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a2c7a-e695-4b07-852d-dec5ef3e0524 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:03.811006 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a2c7a-e695-4b07-852d-dec5ef3e0524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:03.811277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a2c7a-e695-4b07-852d-dec5ef3e0524 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:03.812018 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a2c7a-e695-4b07-852d-dec5ef3e0524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:29:03.812320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a2c7a-e695-4b07-852d-dec5ef3e0524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:03.813943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a2c7a-e695-4b07-852d-dec5ef3e0524 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:03.827440 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1444/2861] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:29:03.832515 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47537040-0574-4781-91c8-8231baf34d10 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:03.842453 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47537040-0574-4781-91c8-8231baf34d10 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:03.847735 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694f24f-7e53-4ebb-9d80-2398884abd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:03.848502 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694f24f-7e53-4ebb-9d80-2398884abd81 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:03.848871 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694f24f-7e53-4ebb-9d80-2398884abd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:03.849244 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694f24f-7e53-4ebb-9d80-2398884abd81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:03.850262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694f24f-7e53-4ebb-9d80-2398884abd81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:03.852416 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694f24f-7e53-4ebb-9d80-2398884abd81 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:03.884902 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1418/2862] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:29:03 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:29:03.889484 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a2c7a-e695-4b07-852d-dec5ef3e0524 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:03.903031 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a2c7a-e695-4b07-852d-dec5ef3e0524 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:03.954559 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:03.969130 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d3a2f-0729-4216-b072-ec688f7f4e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:03.969817 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d3a2f-0729-4216-b072-ec688f7f4e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:03.970516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d3a2f-0729-4216-b072-ec688f7f4e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:03.970516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d3a2f-0729-4216-b072-ec688f7f4e16 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:03.971137 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d3a2f-0729-4216-b072-ec688f7f4e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:03.973163 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d3a2f-0729-4216-b072-ec688f7f4e16 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:03.995802 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1445/2863] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:29:03 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:29:04.000158 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694f24f-7e53-4ebb-9d80-2398884abd81 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:04.011771 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694f24f-7e53-4ebb-9d80-2398884abd81 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:04.016635 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152c364-dd26-4333-99ae-edccd94c01a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:04.017314 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152c364-dd26-4333-99ae-edccd94c01a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:04.017594 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152c364-dd26-4333-99ae-edccd94c01a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:04.017870 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152c364-dd26-4333-99ae-edccd94c01a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:04.018647 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152c364-dd26-4333-99ae-edccd94c01a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:04.020262 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152c364-dd26-4333-99ae-edccd94c01a4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:04.032566 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1419/2864] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:29:04.037321 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d3a2f-0729-4216-b072-ec688f7f4e16 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:04.049699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d3a2f-0729-4216-b072-ec688f7f4e16 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:04.055863 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1952c8-109f-479a-abae-14fdbbcd3bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:04.056535 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1952c8-109f-479a-abae-14fdbbcd3bee admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:04.056819 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1952c8-109f-479a-abae-14fdbbcd3bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:04.057097 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1952c8-109f-479a-abae-14fdbbcd3bee admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:04.057834 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1952c8-109f-479a-abae-14fdbbcd3bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:04.059470 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1952c8-109f-479a-abae-14fdbbcd3bee admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:04.069969 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1446/2865] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:29:04.074243 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152c364-dd26-4333-99ae-edccd94c01a4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:04.085124 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152c364-dd26-4333-99ae-edccd94c01a4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:04.091016 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88b7a0-db00-4477-a73e-f3a267386f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:04.091915 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88b7a0-db00-4477-a73e-f3a267386f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:04.092321 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88b7a0-db00-4477-a73e-f3a267386f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:04.092596 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88b7a0-db00-4477-a73e-f3a267386f63 admin admin] PATH_INFO: `/v3/projects/480861d7c43f48e19fdcf2f682cf27f5/users/0669623b97dd4583bbd9731a106963ab/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:04.108120 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88b7a0-db00-4477-a73e-f3a267386f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480861d7c43f48e19fdcf2f682cf27f5, user_id=0669623b97dd4583bbd9731a106963ab, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:04.110840 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88b7a0-db00-4477-a73e-f3a267386f63 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:04.124959 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1420/2866] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:29:04 2022] PUT /identity/v3/projects/480861d7c43f48e19fdcf2f682cf27f5/users/0669623b97dd4583bbd9731a106963ab/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:29:04.135371 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284a93d-4e66-4a3d-877f-55b593c5f680 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:04.135643 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284a93d-4e66-4a3d-877f-55b593c5f680 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:04.135920 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284a93d-4e66-4a3d-877f-55b593c5f680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:04.163238 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-c284a93d-4e66-4a3d-877f-55b593c5f680 None None] MFA Rules not processed for user `0669623b97dd4583bbd9731a106963ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:29:04.164461 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-c284a93d-4e66-4a3d-877f-55b593c5f680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:04.232177 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1447/2867] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:29:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:29:04.244527 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88b7a0-db00-4477-a73e-f3a267386f63 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:04.246617 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bf88b7a0-db00-4477-a73e-f3a267386f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:04.252633 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:04.318884 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88b7a0-db00-4477-a73e-f3a267386f63 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:04.322729 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdad55-8ae1-4437-a99e-3619c278f3df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:04.323389 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdad55-8ae1-4437-a99e-3619c278f3df service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:04.323674 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdad55-8ae1-4437-a99e-3619c278f3df service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:04.323941 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdad55-8ae1-4437-a99e-3619c278f3df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:04.334497 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cdad55-8ae1-4437-a99e-3619c278f3df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:04.335983 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cdad55-8ae1-4437-a99e-3619c278f3df service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:04.345933 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1421/2868] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:29:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:29:04.371033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284a93d-4e66-4a3d-877f-55b593c5f680 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:04.440005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284a93d-4e66-4a3d-877f-55b593c5f680 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:04.447017 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf8ac0-9ed9-4fbf-82c8-ddf4c7819cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:04.447933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf8ac0-9ed9-4fbf-82c8-ddf4c7819cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:04.448217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf8ac0-9ed9-4fbf-82c8-ddf4c7819cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:04.448469 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf8ac0-9ed9-4fbf-82c8-ddf4c7819cff admin admin] PATH_INFO: `/v3/users/0669623b97dd4583bbd9731a106963ab` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:04.449747 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf8ac0-9ed9-4fbf-82c8-ddf4c7819cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0669623b97dd4583bbd9731a106963ab)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:04.451703 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf8ac0-9ed9-4fbf-82c8-ddf4c7819cff admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:04.513660 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-58cf8ac0-9ed9-4fbf-82c8-ddf4c7819cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0669623b97dd4583bbd9731a106963ab'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:04.521699 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-58cf8ac0-9ed9-4fbf-82c8-ddf4c7819cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0669623b97dd4583bbd9731a106963ab'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:04.522372 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-58cf8ac0-9ed9-4fbf-82c8-ddf4c7819cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0669623b97dd4583bbd9731a106963ab'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:04.530675 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:04.536348 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-58cf8ac0-9ed9-4fbf-82c8-ddf4c7819cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0669623b97dd4583bbd9731a106963ab'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:04.545547 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-58cf8ac0-9ed9-4fbf-82c8-ddf4c7819cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0669623b97dd4583bbd9731a106963ab'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:04.551543 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1448/2869] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:29:04 2022] DELETE /identity/v3/users/0669623b97dd4583bbd9731a106963ab => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:29:04.556204 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d11eea-243a-431a-b0c0-c401a4932c8e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:04.556499 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d11eea-243a-431a-b0c0-c401a4932c8e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:04.556813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d11eea-243a-431a-b0c0-c401a4932c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:04.574926 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-21d11eea-243a-431a-b0c0-c401a4932c8e None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:29:04.576184 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-21d11eea-243a-431a-b0c0-c401a4932c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:04.640031 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1422/2870] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:29:04.650169 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf8ac0-9ed9-4fbf-82c8-ddf4c7819cff admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:04.651863 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-58cf8ac0-9ed9-4fbf-82c8-ddf4c7819cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:04.710277 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf8ac0-9ed9-4fbf-82c8-ddf4c7819cff admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:04.714639 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6ffb8-8e19-4bdd-a8d1-1e867b57afa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:04.715862 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6ffb8-8e19-4bdd-a8d1-1e867b57afa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:04.716341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6ffb8-8e19-4bdd-a8d1-1e867b57afa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:04.717043 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6ffb8-8e19-4bdd-a8d1-1e867b57afa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:04.726370 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6ffb8-8e19-4bdd-a8d1-1e867b57afa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:04.727912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6ffb8-8e19-4bdd-a8d1-1e867b57afa2 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:04.747522 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1449/2871] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 14:29:05.028084 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d11eea-243a-431a-b0c0-c401a4932c8e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:05.029690 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-21d11eea-243a-431a-b0c0-c401a4932c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:05.044299 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d11eea-243a-431a-b0c0-c401a4932c8e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:05.049459 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60586313-9156-4dc8-80b1-8ce46a0d1c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:05.050967 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60586313-9156-4dc8-80b1-8ce46a0d1c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:05.051409 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60586313-9156-4dc8-80b1-8ce46a0d1c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:05.051700 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60586313-9156-4dc8-80b1-8ce46a0d1c5c admin admin] PATH_INFO: `/v3/projects/480861d7c43f48e19fdcf2f682cf27f5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:05.052981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60586313-9156-4dc8-80b1-8ce46a0d1c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=480861d7c43f48e19fdcf2f682cf27f5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:05.054932 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60586313-9156-4dc8-80b1-8ce46a0d1c5c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:05.103012 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-60586313-9156-4dc8-80b1-8ce46a0d1c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480861d7c43f48e19fdcf2f682cf27f5', 'request_id': 'req-60586313-9156-4dc8-80b1-8ce46a0d1c5c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:05.110338 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-60586313-9156-4dc8-80b1-8ce46a0d1c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480861d7c43f48e19fdcf2f682cf27f5', 'request_id': 'req-60586313-9156-4dc8-80b1-8ce46a0d1c5c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:05.117353 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-60586313-9156-4dc8-80b1-8ce46a0d1c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480861d7c43f48e19fdcf2f682cf27f5', 'request_id': 'req-60586313-9156-4dc8-80b1-8ce46a0d1c5c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:05.136438 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-60586313-9156-4dc8-80b1-8ce46a0d1c5c admin admin] The token cache is being invalidate because project 480861d7c43f48e19fdcf2f682cf27f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:29:05.136739 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-60586313-9156-4dc8-80b1-8ce46a0d1c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:05.137370 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-60586313-9156-4dc8-80b1-8ce46a0d1c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:05.138981 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1423/2872] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:29:05 2022] DELETE /identity/v3/projects/480861d7c43f48e19fdcf2f682cf27f5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:29:05.144161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cead2-41f8-4643-ac7e-df4686ac3052 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:05.144636 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cead2-41f8-4643-ac7e-df4686ac3052 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:05.144731 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cead2-41f8-4643-ac7e-df4686ac3052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:05.163051 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-f32cead2-41f8-4643-ac7e-df4686ac3052 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:29:05.164250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f32cead2-41f8-4643-ac7e-df4686ac3052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:05.225723 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1450/2873] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:29:05.234936 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d802cd-27a6-414b-a38e-616e01c1f9c7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:05.235252 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d802cd-27a6-414b-a38e-616e01c1f9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:05.235535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d802cd-27a6-414b-a38e-616e01c1f9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:05.254954 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f2d802cd-27a6-414b-a38e-616e01c1f9c7 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:29:05.256172 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f2d802cd-27a6-414b-a38e-616e01c1f9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:05.265225 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1424/2874] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:29:05.269535 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cead2-41f8-4643-ac7e-df4686ac3052 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:05.280356 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cead2-41f8-4643-ac7e-df4686ac3052 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:05.286466 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f77227-8163-4ffc-9a68-407d944baab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:05.287146 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f77227-8163-4ffc-9a68-407d944baab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:05.287468 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f77227-8163-4ffc-9a68-407d944baab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:05.287744 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f77227-8163-4ffc-9a68-407d944baab8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:05.288520 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f77227-8163-4ffc-9a68-407d944baab8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80436) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 14:29:05.288827 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f77227-8163-4ffc-9a68-407d944baab8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:05.290480 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f77227-8163-4ffc-9a68-407d944baab8 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:05.303718 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1451/2875] 10.222.0.99 () {58 vars in 1152 bytes} [Mon Jul 18 14:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 14:29:05.308637 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d802cd-27a6-414b-a38e-616e01c1f9c7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:05.318337 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d802cd-27a6-414b-a38e-616e01c1f9c7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:05.324152 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e462ad7-3f9d-4c8b-b0d0-c3e0278c2e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:05.324847 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e462ad7-3f9d-4c8b-b0d0-c3e0278c2e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:05.325113 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e462ad7-3f9d-4c8b-b0d0-c3e0278c2e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:05.325386 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e462ad7-3f9d-4c8b-b0d0-c3e0278c2e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:05.326067 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e462ad7-3f9d-4c8b-b0d0-c3e0278c2e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:05.328076 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e462ad7-3f9d-4c8b-b0d0-c3e0278c2e9b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:05.349413 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:05.357506 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1425/2876] 10.222.0.99 () {60 vars in 1152 bytes} [Mon Jul 18 14:29:05 2022] POST /identity/v3/projects => generated 397 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 14:29:05.361610 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f77227-8163-4ffc-9a68-407d944baab8 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:05.373166 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f77227-8163-4ffc-9a68-407d944baab8 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:05.435457 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fa708-c3f0-4560-a78b-fefd0f734c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:05.436265 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fa708-c3f0-4560-a78b-fefd0f734c96 admin admin] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:05.436548 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fa708-c3f0-4560-a78b-fefd0f734c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:05.436820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fa708-c3f0-4560-a78b-fefd0f734c96 admin admin] PATH_INFO: `/v3/users` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:05.437743 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fa708-c3f0-4560-a78b-fefd0f734c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:05.439716 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fa708-c3f0-4560-a78b-fefd0f734c96 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:05.460584 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1452/2877] 10.222.0.99 () {60 vars in 1143 bytes} [Mon Jul 18 14:29:05 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 14:29:05.464887 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e462ad7-3f9d-4c8b-b0d0-c3e0278c2e9b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:05.475674 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e462ad7-3f9d-4c8b-b0d0-c3e0278c2e9b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:05.480847 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355b22d-864f-4250-a6fb-431c6614a36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:05.481551 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355b22d-864f-4250-a6fb-431c6614a36b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:05.481835 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355b22d-864f-4250-a6fb-431c6614a36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:05.482109 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355b22d-864f-4250-a6fb-431c6614a36b admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:05.482903 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355b22d-864f-4250-a6fb-431c6614a36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:05.484732 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355b22d-864f-4250-a6fb-431c6614a36b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:05.497939 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1426/2878] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 14:29:05.502604 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fa708-c3f0-4560-a78b-fefd0f734c96 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:05.507996 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:05.515359 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fa708-c3f0-4560-a78b-fefd0f734c96 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:05.521589 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c2e50-92be-4e58-9f38-caa2f500fe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:05.522227 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c2e50-92be-4e58-9f38-caa2f500fe73 admin admin] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:05.522561 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c2e50-92be-4e58-9f38-caa2f500fe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:05.522844 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c2e50-92be-4e58-9f38-caa2f500fe73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:05.523604 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c2e50-92be-4e58-9f38-caa2f500fe73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:05.525223 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c2e50-92be-4e58-9f38-caa2f500fe73 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:05.535935 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1453/2879] 10.222.0.99 () {58 vars in 1121 bytes} [Mon Jul 18 14:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 14:29:05.540402 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355b22d-864f-4250-a6fb-431c6614a36b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:05.551191 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355b22d-864f-4250-a6fb-431c6614a36b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:05.558455 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bab8b2-0621-4c92-bd23-e10e00e046d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:05.559371 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab8b2-0621-4c92-bd23-e10e00e046d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:05.559651 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab8b2-0621-4c92-bd23-e10e00e046d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:05.560968 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bab8b2-0621-4c92-bd23-e10e00e046d9 admin admin] PATH_INFO: `/v3/projects/02ee815ccdd14bf39852f48d4e433d87/users/9ef094ec1f4f46d78ad9490680e9e5b8/roles/9e92f0503b5c47a4a7368e618f37c6ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:05.575666 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bab8b2-0621-4c92-bd23-e10e00e046d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ee815ccdd14bf39852f48d4e433d87, user_id=9ef094ec1f4f46d78ad9490680e9e5b8, role_id=9e92f0503b5c47a4a7368e618f37c6ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:05.578419 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bab8b2-0621-4c92-bd23-e10e00e046d9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:05.596293 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1427/2880] 10.222.0.99 () {60 vars in 1482 bytes} [Mon Jul 18 14:29:05 2022] PUT /identity/v3/projects/02ee815ccdd14bf39852f48d4e433d87/users/9ef094ec1f4f46d78ad9490680e9e5b8/roles/9e92f0503b5c47a4a7368e618f37c6ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:29:05.610516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fe4ca-1d53-4393-95df-0b121c529a67 None None] REQUEST_METHOD: `POST` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:05.610724 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fe4ca-1d53-4393-95df-0b121c529a67 None None] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:05.610996 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fe4ca-1d53-4393-95df-0b121c529a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:05.642466 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.auth.core [None req-553fe4ca-1d53-4393-95df-0b121c529a67 None None] MFA Rules not processed for user `9ef094ec1f4f46d78ad9490680e9e5b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80436) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:29:05.643681 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-553fe4ca-1d53-4393-95df-0b121c529a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:05.710241 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1454/2881] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:29:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:29:05.721809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bab8b2-0621-4c92-bd23-e10e00e046d9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:05.723707 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-25bab8b2-0621-4c92-bd23-e10e00e046d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:05.783448 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bab8b2-0621-4c92-bd23-e10e00e046d9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:05.787369 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ec217-ae02-4dc0-a6b0-149310fa7fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19eb97598f774389ad927867a7023fc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:05.788141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ec217-ae02-4dc0-a6b0-149310fa7fdc service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:05.788417 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ec217-ae02-4dc0-a6b0-149310fa7fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:05.788686 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ec217-ae02-4dc0-a6b0-149310fa7fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:05.797596 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ec217-ae02-4dc0-a6b0-149310fa7fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:05.799141 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ec217-ae02-4dc0-a6b0-149310fa7fdc service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:05.809178 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1428/2882] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:29:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:29:11.024035 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fe4ca-1d53-4393-95df-0b121c529a67 None None] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:11.089190 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fe4ca-1d53-4393-95df-0b121c529a67 None None] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:11.094318 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb0393-ff67-4975-ab57-0a0a3bedb30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:11.095232 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb0393-ff67-4975-ab57-0a0a3bedb30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:11.095515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb0393-ff67-4975-ab57-0a0a3bedb30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:11.095796 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb0393-ff67-4975-ab57-0a0a3bedb30e admin admin] PATH_INFO: `/v3/users/9ef094ec1f4f46d78ad9490680e9e5b8` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:11.097025 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb0393-ff67-4975-ab57-0a0a3bedb30e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef094ec1f4f46d78ad9490680e9e5b8)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:11.099032 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb0393-ff67-4975-ab57-0a0a3bedb30e admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:11.156971 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-81fb0393-ff67-4975-ab57-0a0a3bedb30e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef094ec1f4f46d78ad9490680e9e5b8'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:11.166132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-81fb0393-ff67-4975-ab57-0a0a3bedb30e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef094ec1f4f46d78ad9490680e9e5b8'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:11.166792 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-81fb0393-ff67-4975-ab57-0a0a3bedb30e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef094ec1f4f46d78ad9490680e9e5b8'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:11.178805 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-81fb0393-ff67-4975-ab57-0a0a3bedb30e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef094ec1f4f46d78ad9490680e9e5b8'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:11.185905 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-81fb0393-ff67-4975-ab57-0a0a3bedb30e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef094ec1f4f46d78ad9490680e9e5b8'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:11.188126 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:11.193146 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1455/2883] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:29:11 2022] DELETE /identity/v3/users/9ef094ec1f4f46d78ad9490680e9e5b8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:29:11.197744 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87720729-7fbb-45e8-9568-1e8e02485548 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:11.198232 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87720729-7fbb-45e8-9568-1e8e02485548 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:11.198579 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87720729-7fbb-45e8-9568-1e8e02485548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:11.216535 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-87720729-7fbb-45e8-9568-1e8e02485548 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:29:11.217747 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-87720729-7fbb-45e8-9568-1e8e02485548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:11.280215 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1429/2884] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:29:11.290023 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb0393-ff67-4975-ab57-0a0a3bedb30e admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:11.291570 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-81fb0393-ff67-4975-ab57-0a0a3bedb30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:11.352099 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb0393-ff67-4975-ab57-0a0a3bedb30e admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:11.356398 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397f65-29da-4722-8042-b02f6a0c7be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:11.357054 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397f65-29da-4722-8042-b02f6a0c7be2 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:11.357341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397f65-29da-4722-8042-b02f6a0c7be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:11.357624 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397f65-29da-4722-8042-b02f6a0c7be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:11.367195 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397f65-29da-4722-8042-b02f6a0c7be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:11.368633 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397f65-29da-4722-8042-b02f6a0c7be2 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:11.379267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1456/2885] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:29:11.663350 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87720729-7fbb-45e8-9568-1e8e02485548 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:11.664876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-87720729-7fbb-45e8-9568-1e8e02485548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:11.679654 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87720729-7fbb-45e8-9568-1e8e02485548 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:11.684456 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189832b-efd8-4ace-b678-890b4bc01979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:11.685326 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189832b-efd8-4ace-b678-890b4bc01979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:11.685605 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189832b-efd8-4ace-b678-890b4bc01979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:11.685886 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189832b-efd8-4ace-b678-890b4bc01979 admin admin] PATH_INFO: `/v3/projects/02ee815ccdd14bf39852f48d4e433d87` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:11.687125 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189832b-efd8-4ace-b678-890b4bc01979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02ee815ccdd14bf39852f48d4e433d87)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:11.689083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189832b-efd8-4ace-b678-890b4bc01979 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:11.736211 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5189832b-efd8-4ace-b678-890b4bc01979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02ee815ccdd14bf39852f48d4e433d87', 'request_id': 'req-5189832b-efd8-4ace-b678-890b4bc01979'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:11.742531 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5189832b-efd8-4ace-b678-890b4bc01979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02ee815ccdd14bf39852f48d4e433d87', 'request_id': 'req-5189832b-efd8-4ace-b678-890b4bc01979'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:11.749391 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5189832b-efd8-4ace-b678-890b4bc01979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02ee815ccdd14bf39852f48d4e433d87', 'request_id': 'req-5189832b-efd8-4ace-b678-890b4bc01979'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:11.751226 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:11.766346 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5189832b-efd8-4ace-b678-890b4bc01979 admin admin] The token cache is being invalidate because project 02ee815ccdd14bf39852f48d4e433d87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:29:11.767052 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5189832b-efd8-4ace-b678-890b4bc01979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:11.768296 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5189832b-efd8-4ace-b678-890b4bc01979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:29:11.770029 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1430/2886] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:29:11 2022] DELETE /identity/v3/projects/02ee815ccdd14bf39852f48d4e433d87 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:29:13.401033 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397f65-29da-4722-8042-b02f6a0c7be2 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:13.402837 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f6397f65-29da-4722-8042-b02f6a0c7be2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:13.494626 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397f65-29da-4722-8042-b02f6a0c7be2 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:13.563115 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6785189-7dfa-49a0-8127-1371e02cafe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:13.563776 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6785189-7dfa-49a0-8127-1371e02cafe2 service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:13.564063 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6785189-7dfa-49a0-8127-1371e02cafe2 service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:13.564343 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6785189-7dfa-49a0-8127-1371e02cafe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:13.566165 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e6785189-7dfa-49a0-8127-1371e02cafe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:13.578912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6785189-7dfa-49a0-8127-1371e02cafe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:13.580535 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6785189-7dfa-49a0-8127-1371e02cafe2 service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:13.592132 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1457/2887] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:29:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:29:18.177083 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeabc6d-8f5d-4218-ad11-aa43a769773b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:18.177633 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeabc6d-8f5d-4218-ad11-aa43a769773b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:18.177633 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeabc6d-8f5d-4218-ad11-aa43a769773b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:18.196659 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cbeabc6d-8f5d-4218-ad11-aa43a769773b None None] MFA Rules not processed for user `42ad97b236f9465e82c57ceede53f0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:29:18.197876 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cbeabc6d-8f5d-4218-ad11-aa43a769773b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:18.255528 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1431/2888] 10.222.0.99 () {58 vars in 957 bytes} [Mon Jul 18 14:29:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:29:19.814625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6785189-7dfa-49a0-8127-1371e02cafe2 service nova] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:19.816084 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e6785189-7dfa-49a0-8127-1371e02cafe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:19.847787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=100 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:19.890250 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6785189-7dfa-49a0-8127-1371e02cafe2 service nova] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:19.895717 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1177d-2b89-4011-9aec-0303254fecb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92b73e1a514148b19bb6a1d2a39e32cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:19.896377 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1177d-2b89-4011-9aec-0303254fecb5 service placement] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:19.896657 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1177d-2b89-4011-9aec-0303254fecb5 service placement] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:19.896933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1177d-2b89-4011-9aec-0303254fecb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:19.898877 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-dfd1177d-2b89-4011-9aec-0303254fecb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:19.910788 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1177d-2b89-4011-9aec-0303254fecb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:19.912486 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1177d-2b89-4011-9aec-0303254fecb5 service placement] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:19.923525 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1458/2889] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:29:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:29:28.247736 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=27 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:29.919263 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=20 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:37.722944 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ec546-2c95-460f-9110-0130ab71cb77 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:37.723544 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ec546-2c95-460f-9110-0130ab71cb77 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:37.723544 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ec546-2c95-460f-9110-0130ab71cb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:37.742875 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-572ec546-2c95-460f-9110-0130ab71cb77 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:29:37.744377 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-572ec546-2c95-460f-9110-0130ab71cb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:37.806955 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1432/2890] 10.222.0.102 () {58 vars in 1017 bytes} [Mon Jul 18 14:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:29:37.828060 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1177d-2b89-4011-9aec-0303254fecb5 service placement] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:37.829635 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-dfd1177d-2b89-4011-9aec-0303254fecb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:37.845735 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1177d-2b89-4011-9aec-0303254fecb5 service placement] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:37.853255 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12c966-5258-481b-b596-9b5c02b5f78c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:37.853918 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12c966-5258-481b-b596-9b5c02b5f78c service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:37.854200 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12c966-5258-481b-b596-9b5c02b5f78c service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:37.854509 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12c966-5258-481b-b596-9b5c02b5f78c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:37.863274 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12c966-5258-481b-b596-9b5c02b5f78c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:37.865081 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12c966-5258-481b-b596-9b5c02b5f78c service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:37.875683 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1459/2891] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:29:40.990623 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5d42-cf4d-4f54-936c-6122f2d626d8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:40.991208 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5d42-cf4d-4f54-936c-6122f2d626d8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:40.991208 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5d42-cf4d-4f54-936c-6122f2d626d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:41.012032 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9f5b5d42-cf4d-4f54-936c-6122f2d626d8 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:29:41.013242 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9f5b5d42-cf4d-4f54-936c-6122f2d626d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:41.021196 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1433/2892] 10.222.0.102 () {58 vars in 1017 bytes} [Mon Jul 18 14:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 14:29:41.055284 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12c966-5258-481b-b596-9b5c02b5f78c service nova] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:41.056943 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-2c12c966-5258-481b-b596-9b5c02b5f78c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:41.072617 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12c966-5258-481b-b596-9b5c02b5f78c service nova] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:41.079787 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a3afa-fbd0-4705-8adb-7dfbc9fe070a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:41.080412 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a3afa-fbd0-4705-8adb-7dfbc9fe070a service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:41.080696 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a3afa-fbd0-4705-8adb-7dfbc9fe070a service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:41.080966 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a3afa-fbd0-4705-8adb-7dfbc9fe070a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:41.089714 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a3afa-fbd0-4705-8adb-7dfbc9fe070a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:41.091324 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a3afa-fbd0-4705-8adb-7dfbc9fe070a service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:41.101191 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1460/2893] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:29:44.077911 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b90c0-522a-41f7-8353-a128d32f6336 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:44.078901 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b90c0-522a-41f7-8353-a128d32f6336 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:44.078901 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b90c0-522a-41f7-8353-a128d32f6336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:44.099218 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1c4b90c0-522a-41f7-8353-a128d32f6336 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:29:44.100471 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1c4b90c0-522a-41f7-8353-a128d32f6336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:44.110284 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1434/2894] 10.222.0.102 () {58 vars in 1017 bytes} [Mon Jul 18 14:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:29:44.132837 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a3afa-fbd0-4705-8adb-7dfbc9fe070a service nova] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:44.144761 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a3afa-fbd0-4705-8adb-7dfbc9fe070a service nova] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:44.150953 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb39b1-26eb-4052-9640-ecb96258c648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:44.151494 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb39b1-26eb-4052-9640-ecb96258c648 service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:44.151882 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb39b1-26eb-4052-9640-ecb96258c648 service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:44.152161 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb39b1-26eb-4052-9640-ecb96258c648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:44.162320 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb39b1-26eb-4052-9640-ecb96258c648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:44.163994 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb39b1-26eb-4052-9640-ecb96258c648 service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:44.174085 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1461/2895] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:29:48.268857 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ae2b5-eb70-4dcc-b9ea-7735ff7d54db None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:48.269383 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ae2b5-eb70-4dcc-b9ea-7735ff7d54db None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:48.269383 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ae2b5-eb70-4dcc-b9ea-7735ff7d54db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:48.294877 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ea8ae2b5-eb70-4dcc-b9ea-7735ff7d54db None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:29:48.296103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ea8ae2b5-eb70-4dcc-b9ea-7735ff7d54db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:48.305552 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1435/2896] 10.222.0.102 () {58 vars in 1017 bytes} [Mon Jul 18 14:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:29:48.330425 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb39b1-26eb-4052-9640-ecb96258c648 service nova] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:48.346862 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb39b1-26eb-4052-9640-ecb96258c648 service nova] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:48.354856 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54304b1-d943-448a-a85f-88a453482763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:48.355502 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54304b1-d943-448a-a85f-88a453482763 service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:48.355782 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54304b1-d943-448a-a85f-88a453482763 service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:48.356052 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54304b1-d943-448a-a85f-88a453482763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:48.364967 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54304b1-d943-448a-a85f-88a453482763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:48.366571 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54304b1-d943-448a-a85f-88a453482763 service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:48.376697 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1462/2897] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:29:52.490361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ee03d-6b09-4610-a9aa-901240362ce2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:52.490956 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ee03d-6b09-4610-a9aa-901240362ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:52.491100 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ee03d-6b09-4610-a9aa-901240362ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:52.513015 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-de0ee03d-6b09-4610-a9aa-901240362ce2 None None] MFA Rules not processed for user `920f62903fc54cf3b0dedf0810c30914`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 14:29:52.514240 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-de0ee03d-6b09-4610-a9aa-901240362ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:29:52.524431 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1436/2898] 10.222.0.102 () {58 vars in 1017 bytes} [Mon Jul 18 14:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 14:29:52.550366 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54304b1-d943-448a-a85f-88a453482763 service nova] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:29:52.562267 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54304b1-d943-448a-a85f-88a453482763 service nova] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:29:52.568727 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55792d-16f5-44f2-a6a9-1607a56d825e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:29:52.569341 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55792d-16f5-44f2-a6a9-1607a56d825e service nova] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:29:52.569625 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55792d-16f5-44f2-a6a9-1607a56d825e service nova] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:29:52.569902 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55792d-16f5-44f2-a6a9-1607a56d825e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:29:52.579281 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55792d-16f5-44f2-a6a9-1607a56d825e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:29:52.580872 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55792d-16f5-44f2-a6a9-1607a56d825e service nova] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:29:52.590977 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1463/2899] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:30:02.506516 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=39 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:30:02.586433 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=30 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:30:21.232508 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ee03d-6b09-4610-a9aa-901240362ce2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:30:21.234307 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-de0ee03d-6b09-4610-a9aa-901240362ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:30:21.299662 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ee03d-6b09-4610-a9aa-901240362ce2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:30:21.305961 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648eedf-5a60-410b-baed-03489eec50f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:30:21.306793 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648eedf-5a60-410b-baed-03489eec50f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:30:21.307072 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648eedf-5a60-410b-baed-03489eec50f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:30:21.307354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648eedf-5a60-410b-baed-03489eec50f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:30:21.309188 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3648eedf-5a60-410b-baed-03489eec50f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:30:21.320151 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648eedf-5a60-410b-baed-03489eec50f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:30:21.321975 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648eedf-5a60-410b-baed-03489eec50f3 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:30:21.330563 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1437/2900] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:30:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:30:21.428993 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55792d-16f5-44f2-a6a9-1607a56d825e service nova] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:30:21.441903 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55792d-16f5-44f2-a6a9-1607a56d825e service nova] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:30:21.447273 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bb4c3-a98b-42c9-adc6-2a7c5c971c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:30:21.447937 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bb4c3-a98b-42c9-adc6-2a7c5c971c1a service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:30:21.448217 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bb4c3-a98b-42c9-adc6-2a7c5c971c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:30:21.448490 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bb4c3-a98b-42c9-adc6-2a7c5c971c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:30:21.450677 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-866bb4c3-a98b-42c9-adc6-2a7c5c971c1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:30:21.466275 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bb4c3-a98b-42c9-adc6-2a7c5c971c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:30:21.468020 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bb4c3-a98b-42c9-adc6-2a7c5c971c1a service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:30:21.479214 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1464/2901] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:30:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:30:24.089409 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648eedf-5a60-410b-baed-03489eec50f3 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:30:24.103960 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648eedf-5a60-410b-baed-03489eec50f3 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:30:24.109809 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b241902-7b75-4ad0-8eb7-76dcee1066b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1b66b55e0374152828913910c4002f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:30:24.110498 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b241902-7b75-4ad0-8eb7-76dcee1066b2 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:30:24.110785 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b241902-7b75-4ad0-8eb7-76dcee1066b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:30:24.111065 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b241902-7b75-4ad0-8eb7-76dcee1066b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:30:24.113007 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9b241902-7b75-4ad0-8eb7-76dcee1066b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:30:24.127368 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b241902-7b75-4ad0-8eb7-76dcee1066b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:30:24.129437 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b241902-7b75-4ad0-8eb7-76dcee1066b2 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:30:24.141965 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1438/2902] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:30:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:30:25.156595 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bb4c3-a98b-42c9-adc6-2a7c5c971c1a service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:30:25.158124 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-866bb4c3-a98b-42c9-adc6-2a7c5c971c1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:30:25.172749 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bb4c3-a98b-42c9-adc6-2a7c5c971c1a service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:30:25.177941 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5bb06-6fb2-47eb-acd5-e2c91cfd318e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92b73e1a514148b19bb6a1d2a39e32cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:30:25.178775 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5bb06-6fb2-47eb-acd5-e2c91cfd318e service placement] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:30:25.179117 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5bb06-6fb2-47eb-acd5-e2c91cfd318e service placement] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:30:25.179591 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5bb06-6fb2-47eb-acd5-e2c91cfd318e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:30:25.181530 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-14d5bb06-6fb2-47eb-acd5-e2c91cfd318e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:30:25.193773 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5bb06-6fb2-47eb-acd5-e2c91cfd318e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:30:25.195848 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5bb06-6fb2-47eb-acd5-e2c91cfd318e service placement] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:30:25.215813 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b241902-7b75-4ad0-8eb7-76dcee1066b2 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:30:25.217442 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9b241902-7b75-4ad0-8eb7-76dcee1066b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:30:25.220300 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1465/2903] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:30:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:30:25.236439 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b241902-7b75-4ad0-8eb7-76dcee1066b2 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:30:25.242641 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f81792-2977-442e-be89-49b8550fade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:30:25.243915 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f81792-2977-442e-be89-49b8550fade7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:30:25.244731 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f81792-2977-442e-be89-49b8550fade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:30:25.245072 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f81792-2977-442e-be89-49b8550fade7 admin admin] PATH_INFO: `/v3/users/42ad97b236f9465e82c57ceede53f0d3` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:30:25.247595 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f81792-2977-442e-be89-49b8550fade7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42ad97b236f9465e82c57ceede53f0d3)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:30:25.249616 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f81792-2977-442e-be89-49b8550fade7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:30:25.300720 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-37f81792-2977-442e-be89-49b8550fade7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42ad97b236f9465e82c57ceede53f0d3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:30:25.310223 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-37f81792-2977-442e-be89-49b8550fade7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42ad97b236f9465e82c57ceede53f0d3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:30:25.311000 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-37f81792-2977-442e-be89-49b8550fade7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42ad97b236f9465e82c57ceede53f0d3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:30:25.323532 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-37f81792-2977-442e-be89-49b8550fade7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42ad97b236f9465e82c57ceede53f0d3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:30:25.331318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-37f81792-2977-442e-be89-49b8550fade7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42ad97b236f9465e82c57ceede53f0d3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:30:25.339346 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1439/2904] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:30:25 2022] DELETE /identity/v3/users/42ad97b236f9465e82c57ceede53f0d3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:30:25.525040 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5bb06-6fb2-47eb-acd5-e2c91cfd318e service placement] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:30:25.537694 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5bb06-6fb2-47eb-acd5-e2c91cfd318e service placement] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:30:25.600424 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd64bb-9363-45b4-a56f-d64116acce6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:30:25.601510 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd64bb-9363-45b4-a56f-d64116acce6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:30:25.602313 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd64bb-9363-45b4-a56f-d64116acce6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:30:25.602678 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd64bb-9363-45b4-a56f-d64116acce6a admin admin] PATH_INFO: `/v3/projects/18d4af6db39946e7850746bf8edca3f3` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:30:25.604005 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd64bb-9363-45b4-a56f-d64116acce6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d4af6db39946e7850746bf8edca3f3)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:30:25.606123 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd64bb-9363-45b4-a56f-d64116acce6a admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:30:25.654785 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-34cd64bb-9363-45b4-a56f-d64116acce6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d4af6db39946e7850746bf8edca3f3', 'request_id': 'req-34cd64bb-9363-45b4-a56f-d64116acce6a'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:30:25.660108 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-34cd64bb-9363-45b4-a56f-d64116acce6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d4af6db39946e7850746bf8edca3f3', 'request_id': 'req-34cd64bb-9363-45b4-a56f-d64116acce6a'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:30:25.666590 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-34cd64bb-9363-45b4-a56f-d64116acce6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d4af6db39946e7850746bf8edca3f3', 'request_id': 'req-34cd64bb-9363-45b4-a56f-d64116acce6a'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:30:25.680186 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-34cd64bb-9363-45b4-a56f-d64116acce6a admin admin] The token cache is being invalidate because project 18d4af6db39946e7850746bf8edca3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80436) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:30:25.680481 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-34cd64bb-9363-45b4-a56f-d64116acce6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:30:25.681105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-34cd64bb-9363-45b4-a56f-d64116acce6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:30:25.682733 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1466/2905] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:30:25 2022] DELETE /identity/v3/projects/18d4af6db39946e7850746bf8edca3f3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:30:35.334119 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=61,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:30:35.676700 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:31:49.584610 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f81792-2977-442e-be89-49b8550fade7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:31:49.586367 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-37f81792-2977-442e-be89-49b8550fade7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:31:49.660003 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f81792-2977-442e-be89-49b8550fade7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:31:49.721394 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9755453-7ddb-496b-8cce-da737c85fb10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92b73e1a514148b19bb6a1d2a39e32cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:31:49.722049 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9755453-7ddb-496b-8cce-da737c85fb10 service placement] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:31:49.722361 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9755453-7ddb-496b-8cce-da737c85fb10 service placement] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:31:49.722676 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9755453-7ddb-496b-8cce-da737c85fb10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:31:49.724505 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a9755453-7ddb-496b-8cce-da737c85fb10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:31:49.736791 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9755453-7ddb-496b-8cce-da737c85fb10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:31:49.738496 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9755453-7ddb-496b-8cce-da737c85fb10 service placement] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:31:49.749254 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1440/2906] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:31:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:31:59.744750 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=58 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:32:04.086197 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd64bb-9363-45b4-a56f-d64116acce6a admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:32:04.088516 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-34cd64bb-9363-45b4-a56f-d64116acce6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:32:04.160138 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd64bb-9363-45b4-a56f-d64116acce6a admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:32:04.165192 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bd370-6160-4c41-ade0-8d17c535b307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:32:04.165853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bd370-6160-4c41-ade0-8d17c535b307 service neutron] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:32:04.166139 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bd370-6160-4c41-ade0-8d17c535b307 service neutron] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:32:04.166412 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bd370-6160-4c41-ade0-8d17c535b307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:32:04.173105 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-340bd370-6160-4c41-ade0-8d17c535b307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:32:04.248919 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bd370-6160-4c41-ade0-8d17c535b307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:32:04.250379 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bd370-6160-4c41-ade0-8d17c535b307 service neutron] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:32:04.259771 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1467/2907] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:32:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:32:10.361886 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9755453-7ddb-496b-8cce-da737c85fb10 service placement] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:32:10.376757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9755453-7ddb-496b-8cce-da737c85fb10 service placement] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:32:10.383360 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c467b9-671e-428a-abc8-f53027a6bf4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abc51e98d0054609b6ce10723f70bf49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:32:10.384300 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c467b9-671e-428a-abc8-f53027a6bf4c service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:32:10.384629 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c467b9-671e-428a-abc8-f53027a6bf4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:32:10.385148 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c467b9-671e-428a-abc8-f53027a6bf4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:32:10.387430 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c4c467b9-671e-428a-abc8-f53027a6bf4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:32:10.453334 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c467b9-671e-428a-abc8-f53027a6bf4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:32:10.454757 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c467b9-671e-428a-abc8-f53027a6bf4c service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:32:10.465318 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1441/2908] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:32:14.255403 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=48 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:32:16.842782 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bd370-6160-4c41-ade0-8d17c535b307 service neutron] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:32:16.844514 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-340bd370-6160-4c41-ade0-8d17c535b307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:32:16.860653 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bd370-6160-4c41-ade0-8d17c535b307 service neutron] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:32:16.866489 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359af1a-9308-469e-be03-1e34f8951b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:32:16.867419 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359af1a-9308-469e-be03-1e34f8951b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:32:16.867707 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359af1a-9308-469e-be03-1e34f8951b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:32:16.867988 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359af1a-9308-469e-be03-1e34f8951b7d admin admin] PATH_INFO: `/v3/users/12e003af750a4033856dca442d9bc677` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:32:16.869661 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359af1a-9308-469e-be03-1e34f8951b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e003af750a4033856dca442d9bc677)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:32:16.871933 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359af1a-9308-469e-be03-1e34f8951b7d admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:32:16.923926 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f359af1a-9308-469e-be03-1e34f8951b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e003af750a4033856dca442d9bc677'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:16.932974 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f359af1a-9308-469e-be03-1e34f8951b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e003af750a4033856dca442d9bc677'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:16.933635 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f359af1a-9308-469e-be03-1e34f8951b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e003af750a4033856dca442d9bc677'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:16.946515 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f359af1a-9308-469e-be03-1e34f8951b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e003af750a4033856dca442d9bc677'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:16.953351 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f359af1a-9308-469e-be03-1e34f8951b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e003af750a4033856dca442d9bc677'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:16.959527 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1468/2909] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:32:16 2022] DELETE /identity/v3/users/12e003af750a4033856dca442d9bc677 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:32:17.154503 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c467b9-671e-428a-abc8-f53027a6bf4c service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:32:17.165597 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c467b9-671e-428a-abc8-f53027a6bf4c service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:32:17.223549 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:32:17.224354 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:32:17.224648 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:32:17.224929 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba admin admin] PATH_INFO: `/v3/projects/df2d58c6ad3640a89c104419945f4797` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:32:17.226183 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=df2d58c6ad3640a89c104419945f4797)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:32:17.228171 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:32:17.279296 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df2d58c6ad3640a89c104419945f4797', 'request_id': 'req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:17.285287 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df2d58c6ad3640a89c104419945f4797', 'request_id': 'req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:17.292040 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df2d58c6ad3640a89c104419945f4797', 'request_id': 'req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:17.310527 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba admin admin] The token cache is being invalidate because project df2d58c6ad3640a89c104419945f4797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:32:17.310807 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:17.311428 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:17.313101 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1442/2910] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:32:17 2022] DELETE /identity/v3/projects/df2d58c6ad3640a89c104419945f4797 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:32:17.317370 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359af1a-9308-469e-be03-1e34f8951b7d admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:32:17.319941 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f359af1a-9308-469e-be03-1e34f8951b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:32:17.333950 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359af1a-9308-469e-be03-1e34f8951b7d admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:32:17.395912 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553e0ff-51ab-40ae-a97d-ea30117e6382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:32:17.396820 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553e0ff-51ab-40ae-a97d-ea30117e6382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:32:17.397109 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553e0ff-51ab-40ae-a97d-ea30117e6382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:32:17.397387 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553e0ff-51ab-40ae-a97d-ea30117e6382 admin admin] PATH_INFO: `/v3/users/c4b1c08e912c433c8f5544fbfd53faff` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:32:17.398784 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553e0ff-51ab-40ae-a97d-ea30117e6382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b1c08e912c433c8f5544fbfd53faff)` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:32:17.400875 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553e0ff-51ab-40ae-a97d-ea30117e6382 admin admin] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:32:17.450853 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f553e0ff-51ab-40ae-a97d-ea30117e6382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b1c08e912c433c8f5544fbfd53faff'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:17.461206 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f553e0ff-51ab-40ae-a97d-ea30117e6382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b1c08e912c433c8f5544fbfd53faff'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:17.462069 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f553e0ff-51ab-40ae-a97d-ea30117e6382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b1c08e912c433c8f5544fbfd53faff'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:17.476865 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f553e0ff-51ab-40ae-a97d-ea30117e6382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b1c08e912c433c8f5544fbfd53faff'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:17.478925 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:32:17.490316 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.notifications [None req-f553e0ff-51ab-40ae-a97d-ea30117e6382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b1c08e912c433c8f5544fbfd53faff'} {{(pid=80436) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:17.497981 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1469/2911] 10.222.0.99 () {58 vars in 1223 bytes} [Mon Jul 18 14:32:17 2022] DELETE /identity/v3/users/c4b1c08e912c433c8f5544fbfd53faff => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:32:17.681558 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:32:17.683089 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:32:17.705213 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cef6b-8a42-46ea-9b69-403f19f5f6ba admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:32:17.726560 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:32:17.774436 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab98ad-78cb-41d4-b397-80e4f05ca926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920f62903fc54cf3b0dedf0810c30914', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '268276b3ee674678ab5061125ae1a657', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:32:17.775219 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab98ad-78cb-41d4-b397-80e4f05ca926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:32:17.775500 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab98ad-78cb-41d4-b397-80e4f05ca926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:32:17.776836 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab98ad-78cb-41d4-b397-80e4f05ca926 admin admin] PATH_INFO: `/v3/projects/5c684c14c1034f849d6a4e1b73ee5968` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:32:17.777564 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab98ad-78cb-41d4-b397-80e4f05ca926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c684c14c1034f849d6a4e1b73ee5968)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:32:17.778970 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab98ad-78cb-41d4-b397-80e4f05ca926 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:32:17.830584 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5fab98ad-78cb-41d4-b397-80e4f05ca926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c684c14c1034f849d6a4e1b73ee5968', 'request_id': 'req-5fab98ad-78cb-41d4-b397-80e4f05ca926'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:17.836924 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5fab98ad-78cb-41d4-b397-80e4f05ca926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c684c14c1034f849d6a4e1b73ee5968', 'request_id': 'req-5fab98ad-78cb-41d4-b397-80e4f05ca926'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:17.846514 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5fab98ad-78cb-41d4-b397-80e4f05ca926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c684c14c1034f849d6a4e1b73ee5968', 'request_id': 'req-5fab98ad-78cb-41d4-b397-80e4f05ca926'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:17.863146 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5fab98ad-78cb-41d4-b397-80e4f05ca926 admin admin] The token cache is being invalidate because project 5c684c14c1034f849d6a4e1b73ee5968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 14:32:17.863434 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5fab98ad-78cb-41d4-b397-80e4f05ca926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:17.864103 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-5fab98ad-78cb-41d4-b397-80e4f05ca926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 14:32:17.865660 dv-cinder-797608-58-smb devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1443/2912] 10.222.0.99 () {58 vars in 1232 bytes} [Mon Jul 18 14:32:17 2022] DELETE /identity/v3/projects/5c684c14c1034f849d6a4e1b73ee5968 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 14:32:27.494461 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=4 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:32:27.860140 dv-cinder-797608-58-smb devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:36:55.587461 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553e0ff-51ab-40ae-a97d-ea30117e6382 admin admin] Authenticating user token {{(pid=80436) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 14:36:55.589136 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-f553e0ff-51ab-40ae-a97d-ea30117e6382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:36:55.734270 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553e0ff-51ab-40ae-a97d-ea30117e6382 admin admin] Validating token access rules against request {{(pid=80436) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 14:36:55.801187 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc5641-1600-4625-afea-6897c885db07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92b73e1a514148b19bb6a1d2a39e32cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50b78e16c86b4e6cac3a725f536a8274', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80436) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 14:36:55.802027 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc5641-1600-4625-afea-6897c885db07 service placement] REQUEST_METHOD: `GET` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 14:36:55.802312 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc5641-1600-4625-afea-6897c885db07 service placement] SCRIPT_NAME: `/identity` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 14:36:55.802634 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc5641-1600-4625-afea-6897c885db07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80436) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 14:36:55.805815 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.fernet_utils [None req-e5bc5641-1600-4625-afea-6897c885db07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80436) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 14:36:55.818796 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc5641-1600-4625-afea-6897c885db07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 14:36:55.820416 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc5641-1600-4625-afea-6897c885db07 service placement] RBAC: Authorization granted {{(pid=80436) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 14:36:55.831150 dv-cinder-797608-58-smb devstack@keystone.service[80436]: [pid: 80436|app: 0|req: 1470/2913] 10.222.0.99 () {60 vars in 1365 bytes} [Mon Jul 18 14:36:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 14:37:05.826346 dv-cinder-797608-58-smb devstack@keystone.service[80436]: DEBUG dbcounter [-] [80436] Writing DB stats keystone:SELECT=89 {{(pid=80436) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}